Skip to content

feat: generate llms.txt #1074

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from
Closed

feat: generate llms.txt #1074

wants to merge 3 commits into from

Conversation

felixzieger
Copy link
Contributor

No description provided.

@felixzieger felixzieger requested a review from sttomm May 6, 2025 18:54
Copy link

This pull request is automatically being deployed by Amplify Hosting (learn more).

Access this pull request here: https://pr-1074.d17q6gob2fx97d.amplifyapp.com

Copy link
Contributor

@sttomm sttomm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added an idea for a different solution that relies on the drill-down approach

TEMP_FILE=$(mktemp)

# Find all markdown files and concatenate their content
find "$CONTENT_DIR" -type f -name "*.md" | while read -r file; do
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

d: Would it make sense to also write an llm-toc.txt or similar, that only contains the headlines? Probably it then simply makes sense to only write the llm-toc.txt, which basically provides only the different md files on a top-level with all sub-headlines as "content" and then in the drill down we can get the specific md file. I guess we can just retrieve those files from github directly. That way, we would only generate the toc and don't need that super huge file.

Copy link

This PR has seen no activity in the last 7 days and has been marked as stale.

@github-actions github-actions bot added the Stale label May 15, 2025
@sttomm
Copy link
Contributor

sttomm commented Jun 20, 2025

We will probably not go with the llm.txt. At least nit for now, so this PR gets closed

@sttomm sttomm closed this Jun 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants