Automate website exploration and document discovered APIs into crawl blueprints.
npx skills add https://github.com/alpoxdev/claude-code --skill crawler
Please help me install this Agent Skill. Skill: crawler Source: https://github.com/alpoxdev/claude-code/tree/main/.claude/skills/crawler Command: npx skills add https://github.com/alpoxdev/claude-code --skill crawler
This Skill automates the exploration of websites and documentation of discovered APIs, turning manual crawling into reproducible automation.
To begin, create a session and navigate to the target site, then collect structure and API hints to generate a crawler skeleton.
High-intent search queries and answers about installing and using this skill.
Automate website crawling and API discovery by using a Playwriter workflow to intercept network requests, handle authentication, and scrape DOM elements. This process generates a crawl blueprint, API documentation, and TypeScript starter code for local execution.
Generate TypeScript crawler templates by running an automated exploration of target web pages. The workflow analyzes live DOM structures and intercepted API endpoints to scaffold CRAWLER.ts templates ready for local execution.
DOM-based scraping and API interception for documentation generation is the process of exploring live websites to capture network traffic and page selectors, producing structured ANALYSIS.md, SELECTORS.md, API.md, and NETWORK.md files.
Yes, the Playwriter workflow supports automated crawl planning by outlining pages, selectors, and API endpoints. It handles authentication scenarios during exploration to produce reproducible crawl blueprints and starter code.
Document discovered APIs automatically during web scraping by intercepting network requests in real-time. The workflow outputs structured API.md and NETWORK.md documentation based on live exploration of the target site.
Turn manual website crawling into reproducible automation by creating a session, navigating to the target site, and collecting structure and API hints. This generates a crawler skeleton with TypeScript templates and reference documentation.
Alex980102Set up and administer CKL environments with credential setup and daemon management.
moveonhaCrawl websites to discover APIs, cookies, tokens, and headers and generate structured artifacts.
vikingokftAutomate web data extraction using traffic interception, sitemaps, APIs, and DOM scraping.
pacphiDebug web pages via Chrome DevTools MCP with performance, network, and DOM inspection.
