skills.rest
webdevarif
webdevarifCOMMUNITY
Explore all skills by this author →
Website𝕏@webdevarifGitHub

firecrawl-agent

Extract structured JSON data from multi-page websites using autonomous agent navigation.

Updated Apr 18, 2026
Search Tags:#automation#structured data#data extraction#pricing#firecrawl#json#web scraping
One-click install
npx skills add https://github.com/webdevarif/claude-skills --skill firecrawl-agent-webdevarif
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-agent
Source: https://github.com/webdevarif/claude-skills/tree/main/firecrawl-agent
Command: npx skills add https://github.com/webdevarif/claude-skills --skill firecrawl-agent-webdevarif

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Manually scraping complex multi-page websites to gather structured data like pricing tiers, product listings, or directory entries is slow and error-prone. This Skill automates that process by letting an agent navigate the site and return the data as structured JSON. ## Core Features & Use Cases - Autonomous Multi-Page Extraction: The agent navigates complex sites on its own to find and collect the requested data. - Schema-Guided Output: Provide a JSON schema via --schema or --schema-file to get predictable, structured results instead of freeform data. - Cost and Model Controls: Choose between spark-1-mini and spark-1-pro models, and cap spending with --max-credits. - Use Case: You need every pricing tier from a SaaS competitor's site. Run the agent with a prompt like "extract all pricing tiers" and receive a clean JSON file with the results. ## Quick Start Ask the agent to extract all pricing tiers from a target website and save the structured JSON output to a local file using the firecrawl agent command with the --wait flag.

Frequently Asked Questions about firecrawl-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from a website as JSON?▼

Run the firecrawl agent command with a natural language prompt describing the data you want, and add the --wait flag to get results inline. Use the -o flag to save the output to a JSON file.

How do I get structured output with a JSON schema from web extraction?▼

Pass a JSON schema using the --schema flag or point to a file with --schema-file. The agent then returns data matching your defined structure instead of freeform output, making results predictable for downstream processing.

When should I use firecrawl agent instead of firecrawl scrape?▼

Use the agent for multi-page sites where the data location is unknown and navigation is required. For simple single-page extraction, scrape is faster and consumes fewer credits.

How do I limit costs when running web extraction agents?▼

Set the --max-credits flag to cap spending for a single agent run. Agent runs consume more credits than simple scrapes, so defining a limit prevents unexpected usage on large sites.

Why does firecrawl agent return a job ID instead of results?▼

Without the --wait flag, the command returns a job ID immediately rather than waiting for completion. Always include --wait to receive the extraction results inline once the agent finishes.

Related Skills

Explore More Data & Analytics Skills→
ZJU-REALZJU-REAL
195

firecrawl-agent

Extract structured JSON data from multi-page websites via the Firecrawl CLI.

Official
Advanced
LeroyAdonisLeroyAdonis

competitor-intel

Scrapes competitor pricing pages with Playwright and extracts structured feature intelligence.

Community
Intermediate
samymitysamymity
1

data-scraper-agent

Scrape public websites, APIs, and RSS feeds on a schedule.

Community
Advanced
roach88roach88
2

scraping-websites

Crawl static and JavaScript-rendered websites and extract structured data.

Community
Intermediate