LLMs.txt for AutoGen Documentation Guides

For each page in documentation, we can compile a comparable llms.txt (or llms.md??) with markdown compilation of the content. The links in it should also reference corresponding links in llms.txt.  

Discussed in https://github.com/microsoft/autogen/discussions/6262

Originally posted by cc0zh April 10, 2025 Hello AutoGen Team, I hope this message finds you well. I'd like to suggest adding an LLMs.txt file specifically for the AutoGen user guide documentation hosted at https://microsoft.github.io/autogen/stable/user-guide/. An LLMs.txt file can provide valuable directives for large language models (LLMs) and AI agents interacting with the documentation. This guidance could include preferred crawl paths, sections suitable for summarization, disallowed areas, citation preferences, etc.