llms-txt-from-website
CommunityGenerate llms.txt from any website in one go.
Authorprateek
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Generate llms.txt and llms-full.txt for docs sites from a URL by discovering documentation sources, reusing existing manifests when possible, and assembling a curated set of sources for reliable downstream use.
Core Features & Use Cases
- Reuse existing llms.txt/llms-full.txt when available to minimize redundant work.
- Discover documentation sources by following "Edit this page" / GitHub links, cloning the docs repo, and extracting markdown sources.
- Fall back to sitemap.xml or crawling when direct repo discovery is not possible, then generate a high-signal manifest.
- Produce a structured llms-full.txt by concatenating and attaching source context for downstream models.
Quick Start
Provide a website URL and run the skill to generate llms.txt and llms-full.txt.
Dependency Matrix
Required Modules
None requiredComponents
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: llms-txt-from-website Download link: https://github.com/prateek/dotfiles/archive/main.zip#llms-txt-from-website Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.