Closed
docs: update llms.txt with documentation index and add Playwright test#46287
Conversation
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
…GEO optimization Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Add robots.txt and llms.txt to docs site for AI bot crawling
docs: update llms.txt with documentation index and add Playwright test
Jul 17, 2026
Contributor
|
Great work on the The PR includes a standards-compliant rewrite that properly groups docs pages into ordered sections, and adds a new Playwright test verifying the endpoint — exactly the kind of quality infrastructure improvement this project benefits from. The workflow lock file changes look like automated bumps. This looks ready for review! ✅
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
GEO audit scored the docs site 0/18 on llms.txt — the existing
llms.txt.tsserved agent prompt links identical toagents.txt, rather than a proper documentation index.Changes
docs/src/pages/llms.txt.ts— Rewrites the endpoint to generate a standards-compliantllms.txtdocumentation index:getCollection('docs')to fetch all docs pages at build timetitle+description, linking tohttps://github.github.com/gh-aw/<id>/.github/aw/*.md) at the end, preserving prior content for AI agentsDocPageDatainterface to avoid repeated type assertionsdocs/tests/llms-txt.spec.ts— New Playwright test verifying/gh-aw/llms.txtreturns 200, correctContent-Type, expected section headings, and well-formed- [Title](url)link linesThe existing
robots.txt(inpublic/) and its test are unchanged.