Crawl GitHub repositories to retrieve file contents and READMEs.
npx skills add https://github.com/yuma588/skill-gallery --skill github-crawler
Please help me install this Agent Skill. Skill: github-crawler Source: https://github.com/yuma588/skill-gallery/tree/main/skills/github-crawler Command: npx skills add https://github.com/yuma588/skill-gallery --skill github-crawler
GitHub Crawler provides a reliable way to fetch file contents and repository READMEs from GitHub, eliminating manual scraping and speeding up data collection workflows.
Request a file or README by providing the repository URL (and file path if fetching a specific file).
High-intent search queries and answers about installing and using this skill.
Yes, you can crawl private GitHub repositories by providing token authentication. This grants the necessary permissions to extract file contents and READMEs from restricted repositories securely.
Yes, crawling private GitHub repositories requires token authentication. Public repositories are accessible by default, but a token is necessary to fetch file contents and READMEs from private sources.
The best way to extract code snippets without manual scraping is using a dedicated crawler. It retrieves arbitrary file contents and repository READMEs by URL and path, automating data collection workflows reliably.
Yes, the GitHub crawler handles errors resiliently when fetching files. It implements robust retry logic and raw-content fallback mechanisms to ensure reliable extraction operations even when paths are unavailable.
You can retrieve documentation overviews from multiple GitHub repositories automatically by fetching READMEs. This surfaces project documentation quickly without manual browsing, streamlining data collection workflows.
robertbr123Configure GitHub authentication via HTTPS tokens, SSH keys, or gh CLI.
1ambdaGenerate API docs, code comments, READMEs, and changelogs via symbol introspection.
jg-chalk-ioAutomates Markdown documentation generation and publication workflows for Claude Code.
HeldinhowImplement token bucket or sliding window rate limiting with HTTP status codes.
