Crawls websites following links to bulk extract content from multiple pages.
npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-crawl-ovisan
Please help me install this Agent Skill. Skill: firecrawl-crawl Source: https://github.com/ovisan/dotfiles/tree/main/.grok/skills/firecrawl-crawl Command: npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-crawl-ovisan
High-intent search queries and answers about installing and using this skill.
Run firecrawl crawl with the target URL, adding --wait to block until completion and -o to save results to a JSON file. Use --limit and --max-depth to control how many pages are crawled and how deep links are followed.
Use the --include-paths option with firecrawl crawl to restrict the crawl to URLs matching that path, for example --include-paths /docs. This prevents crawling the entire site when you only need one section.
Scrape extracts a single page, map discovers URLs on a site without extracting content, and crawl follows links to bulk extract many pages. A typical workflow is map first to discover URLs, then crawl when you need content from all of them.
Yes, without the --wait flag the crawl returns a job ID immediately for async polling. You can check status later with firecrawl crawl followed by the job ID, or add --wait and --progress to block until completion.
Crawls consume credits per page extracted, so unscoped crawls of large sites get expensive. Use --include-paths, --limit, and --max-depth to narrow scope, and check firecrawl credit-usage before starting large crawls.
olostepDiscover and list all URLs on a website with keyword and pattern filtering.
WILLOSCARExtract plain text from PDF documents and generate index files.
cascade-protocolCrawl URLs with dynamic rendering and anti-bot bypass via paid API.
r1cA18Download entire websites into local Markdown and screenshot files.
