🎃 Generate llms.txt and llms-full.txt from the repo docs so AI agents can read them
I maintainer di solito rispondono entro 1 giorno
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 3/5
- Tempo stimato
- 1-2 giorni
- Idoneità per principianti
- 65/100
- Tipo di issue
- Funzionalità
- Chiarezza
- Specificata chiaramente
- Stato di attività
- Attiva
- Stack tecnologico
- github-actions, markdown, nodejs
- Ambito
- ci-cd, documentation
Direzione di ricerca
Start with scripts/adapter-count.mjs for the --check pattern and repository-root resolution, and with .github/workflows/ci.yml lines 48-75 for the existing generated-file checks. Build scripts/generate-llms-txt.mjs to write llms.txt and llms-full.txt deterministically, then add scripts/generate-llms-txt.test.mjs. Done means the generator runs twice with no diff, --check fails after a doc edit and passes after regenerating, and the tests pass.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Part of the October Challenge #997.
Why
AI assistants and coding agents increasingly look for an llms.txt file (the llmstxt.org proposal): a short Markdown index of a project's documentation with links, plus an optional llms-full.txt with the full text in one file. An agent asked "how do I add a SOAP connector to AnythingMCP?" can then read the right page instead of guessing. This repository has about 40 Markdown documents under docs/ (connectors, client integrations, deployment, operations, API reference, the tool definition format) but no llms.txt. The anythingmcp.com/llms.txt linked from README.md:268 belongs to the website and covers the site and its guides, not these docs. AGENTS.md tells coding agents how to work on the code; llms.txt is about using and operating the product.
Self-hosted vs Cloud
- Self-hosted: no runtime change. The two files live in the repository and are read from GitHub. They are not copied into the Docker image (the runner stage copies only build output and
start.sh,Dockerfile:127-146) and instances do not serve them. - Cloud (
DEPLOYMENT_MODE=cloud): no change. Do not put the files intopackages/frontend/public/:proxy.ts:42lets every path containing a dot through without sign-in, so they would be served by every self-hosted instance and by Cloud, which is not the goal. - Who can use it: anyone reading the public repository. Nothing is per user or per organization.
What to build
-
Generator
scripts/generate-llms-txt.mjs: plain Node, no new dependency, in the style ofscripts/adapter-count.mjsandscripts/regenerate-catalog.mjs. It writesllms.txtandllms-full.txtat the repository root. With--checkit exits 1 when the committed files differ from what it would write, likeadapter-count.mjs --check. -
llms.txtin the llmstxt.org format:# AnythingMCP, a one-paragraph>summary (reuse thedescriptionof the rootpackage.json), then##sections of- [Title](url): descriptionlines:- Getting started:
README.md,docs/deployment.md,docs/guides.md. - Connectors:
docs/connectors/*.md,docs/tool-definition.md. - AI clients:
docs/integrations/*.md. - Operations and security:
docs/operations/*.md,docs/sso.md,docs/scim-entra-setup.md,docs/license-faq.md. - Reference:
docs/api-reference.md,docs/mcp-resources.md,docs/knowledge-graph.md. - Contributing:
.github/CONTRIBUTING.md,AGENTS.md. ## Optional:docs/guides/*.md,docs/ROADMAP.md,docs/ADOPTERS.md.
Titles come from each file's first
#heading, descriptions from its first paragraph (first sentence, about 160 characters at most), with an override map in the script for files whose first paragraph is not a good summary. Links are absolute raw URLs onmain(https://raw.githubusercontent.com/HelpCode-ai/anythingmcp/main/<path>), which agents can fetch as plain Markdown. - Getting started:
-
llms-full.txt: the same files in the same order, each introduced by a separator heading with its path and source URL. Rewrite relative links ((connectors/rest.md),(../README.md#…)) to absolute GitHub URLs, and drop images and HTML-only blocks. ForREADME.md:1-35, keep the title and the summary sentence and drop the banner, the star-history<picture>and the badge rows.docs/is about 300 KB today, which is fine for one file. -
Deterministic output: sorted file lists, no timestamps, LF line endings, so
--checkis stable. -
CI: one step in the backend job of
.github/workflows/ci.yml, next to "Verify the quoted adapter count and license wording" (:57-58):node scripts/generate-llms-txt.mjs --check. Addscripts/generate-llms-txt.test.mjsto thenode --testline that already runsscripts/validate-adapters.test.mjs(:51-52). Changes under.github/get extra review, so keep the workflow diff to these lines. -
Pointers: next to the website line in
README.md:268, add one for the repository's ownllms.txt, and the same inREADME.de.md,README.ja.mdandREADME.zh-CN.md(:286). In.github/CONTRIBUTING.mdandAGENTS.md, add one line: after changing docs, runnode scripts/generate-llms-txt.mjsand commit the result.
Where to look
docs/anddocs/guides.md(the current human-written index).scripts/adapter-count.mjs:--checkpattern and repository-root resolution..github/workflows/ci.yml:48-75: existing generated-file checks.README.md:1-35(HTML header),:268(website llms.txt link).packages/frontend/src/proxy.ts:42: why the files must not go intopublic/.
Acceptance criteria
-
node scripts/generate-llms-txt.mjswrites both files; running it twice produces no diff. - Every link in
llms.txtpoints to a file that exists in the repository (checked by the test). -
llms-full.txtcontains no relative Markdown links and no<picture>or<img>HTML (checked by the test). -
--checkfails after a doc is edited and passes after regenerating (checked by the test). -
node --test scripts/generate-llms-txt.test.mjspasses and the CI step is green. - README lines and contributor notes added.
Out of scope
- The website's
anythingmcp.com/llms.txt, which is maintained with the website. content/guides/(website guides in several languages, synced byscripts/sync-guides-to-website.sh) and the translated READMEs.- Serving the files from the app, or exposing the docs as an MCP resource.
Size
M (1–2 days)
How to claim
Comment "I'd like to work on this" and we'll assign you. Rules in #997.
- Lingua principale
- TypeScript
- Stelle
- 856
- Fork
- 82
- Merge medio
- 6h 15m
- PR unite (30g)
- 141
Preparare l'ambiente
Questo progetto non fornisce container di sviluppo, Dockerfile né guida per i contributori, quindi l'ambiente è a tuo carico: parti dal suo README e consulta la nostra guida al primo contributo per i passaggi generali.
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di HelpCode-ai/anythingmcp
-
enhancement
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
HelpCode-ai/anythingmcp#1049 · 2 commenti ·
I maintainer di solito rispondono entro 1 giorno
-
good first issue hacktoberfest
Difficoltà 2/5 Mezza giornata Idoneità per principianti 70/100
HelpCode-ai/anythingmcp#996 ·
I maintainer di solito rispondono entro 1 giorno
-
good first issue hacktoberfest
Difficoltà 2/5 Mezza giornata Idoneità per principianti 72/100
HelpCode-ai/anythingmcp#995 ·
I maintainer di solito rispondono entro 1 giorno
-
enhancement good first issue hacktoberfest help wanted
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
HelpCode-ai/anythingmcp#982 ·
I maintainer di solito rispondono entro 1 giorno
-
good first issue hacktoberfest
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100
HelpCode-ai/anythingmcp#745 ·
I maintainer di solito rispondono entro 1 giorno
Tutte le issue di HelpCode-ai/anythingmcp
Issue simili
-
priority:high
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
immich-app/immich#32426 ·
I maintainer di solito rispondono entro 1 giorno
-
documentation good first issue hacktoberfest help wanted
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
libredb/libredb-studio#1756 ·
I maintainer di solito rispondono entro 1 giorno
-
state:triage-needed
Difficoltà 2/5 1-3 ore Idoneità per principianti 62/100
I maintainer di solito rispondono entro 1 giorno