docs: serve an llms.txt index of the documentation - #1939
ghostiee-11 wants to merge 8 commits into
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1939 +/- ##
==========================================
+ Coverage 75.27% 76.96% +1.68%
==========================================
Files 212 216 +4
Lines 39238 40674 +1436
==========================================
+ Hits 29538 31303 +1765
+ Misses 9700 9371 -329 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
|
Let's wait for https://github.com/holoviz/hvplot/pull/1732/changes to settle |
|
Okay!! |
|
Do you have an example artifact I can look at |
Is this necessary for the LLM to know? And is it named These markdown files should help the LLM develop (think of it like a CLAUDE.md file). |
|
Let's wait until holoviz-dev/nbsite#361 is merged |
Zensical copies static files from docs/ to the site root, so this needs no build changes. A test keeps the link list in sync with the pages that actually exist.
Replaces the hand-written docs/llms.txt with a build step, following the approach in holoviz/hvplot#1732. The zensical nav is the single source of truth, so pages and labels can never drift from the site, and the linked markdown is mirrored under /markdown so an LLM can fetch the prose without parsing the rendered HTML.
The tutorials index links seven tutorials but the nav only carried four, so the rest were published without a sidebar entry and were skipped by llms.txt, which is generated from the nav. Labels match the index page.
2eafabc to
fbdd7a2
Compare
|
Can you attach the latest llms.txt |
|
Here's the current output: llms.txt |
|
I think it seems too long and not too useful for developing Lumen (lots of the docs are user-facing). Can we figure a way to consolidate? |
|
Updated output after consolidating the index around development and API documentation: llms.txt |

LLM assistants now handle a large share of the "which library should I use for this" questions that used to go to search, and they read a site far better when it publishes a curated index than when they have to crawl it. llms.txt is the convention for that. marimo and Vizro both serve one. No HoloViz site does.
This adds
docs/llms.txt.