Scrape websites and extract data using the Firecrawl API.
npx skills add https://github.com/vm0-ai/vm0-skills --skill firecrawl
Please help me install this Agent Skill. Skill: firecrawl Source: https://github.com/vm0-ai/vm0-skills/tree/main/firecrawl Command: npx skills add https://github.com/vm0-ai/vm0-skills --skill firecrawl
Firecrawl provides curl-based access to web scraping, crawling, and data extraction, enabling AI-ready data collection.
Scrape a page to Markdown: bash -c 'curl -s -X POST "https://api.firecrawl.dev/v1/scrape" -H "Authorization: Bearer ${FIRECRAWL_API_KEY}" -H "Content-Type: application/json" -d '{"url":"https://example.com","formats":["markdown"]}' | jq .'
High-intent search queries and answers about installing and using this skill.
Web scraping with curl converts pages to markdown by sending POST requests to the Firecrawl API with your API key, target URL, and desired format. The API returns structured markdown content suitable for AI processing, eliminating manual extraction work.
Full-site crawling discovers and extracts all URLs across a domain by setting crawl parameters like maxDepth and includePaths. The API asynchronously processes pages and returns a complete link inventory for mapping site structure or AI ingestion.
Firecrawl supports markdown, html, rawHtml, screenshot, and links formats. Each format serves different downstream uses: markdown for AI readability, html for structured parsing, screenshots for visual capture, and links for URL discovery.
Yes, a Firecrawl API key is required for authentication. You pass it as a Bearer token in the Authorization header of curl POST requests to access scraping, crawling, and data extraction endpoints.
Structured data extraction combines crawling with format selection and filtering parameters like excludePaths and timeout. Send JSON payloads specifying your URL, depth limits, and desired output format to collect AI-ready content from multiple pages in one workflow.
Single-page scraping targets one URL with immediate results, while full-site crawling traverses linked pages asynchronously up to a specified maxDepth. Crawling discovers all content within scope; scraping focuses on immediate extraction for faster, focused collection.
theslashdojoConstruct and send HTTP requests with curl across REST and GraphQL workflows.
xberg-ioExtract HTML tables and convert them to Markdown and structured JSON.
shobcoderExtract structured JSON data from websites using curl-only or browser-only modes.
davidgfolchScrape and crawl websites with Scrapling, bypassing anti-bot protections like Cloudflare Turnstile.
