skills.rest
The-Focus-AI
The-Focus-AIOFFICIAL
Explore all skills by this author →
WebsiteGitHub

firecrawl-agent

Extracts structured JSON data from multi-page websites using an autonomous Firecrawl agent.

Updated Jul 16, 2026
Search Tags:#automation#structured data#data extraction#firecrawl#json#web scraping#crawling
One-click install
npx skills add https://github.com/The-Focus-AI/walking-thoughts --skill firecrawl-agent-the-focus-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-agent
Source: https://github.com/The-Focus-AI/walking-thoughts/tree/main/.agents/skills/firecrawl-agent
Command: npx skills add https://github.com/The-Focus-AI/walking-thoughts --skill firecrawl-agent-the-focus-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Manually navigating complex multi-page websites to collect structured data like pricing tiers, product listings, or directory entries is slow and error-prone. This Skill runs an autonomous Firecrawl agent that navigates the site for you and returns the data as structured JSON. ## Core Features & Use Cases - Autonomous Multi-Page Extraction: The agent navigates complex sites on its own to find where the requested data lives, taking 2-5 minutes per run. - Schema-Guided Output: Pass a JSON schema via --schema or --schema-file to get predictable, structured results instead of freeform data. - Cost and Scope Controls: Limit spending with --max-credits, choose between spark-1-mini and spark-1-pro models, and restrict crawling with --urls. - Use Case: You need every pricing tier from a SaaS competitor's site. Run the agent with a prompt and a JSON schema, and receive a structured JSON file with all tiers. ## Quick Start Ask the agent to extract all pricing tiers from a target website and wait for the structured JSON output to be saved to a file.

Frequently Asked Questions about firecrawl-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from a website as JSON?▼

Run firecrawl agent with a natural-language prompt describing the data, add --schema with a JSON schema for predictable output, and use --wait with -o to save results to a file. The agent navigates the site autonomously and returns structured JSON.

When should I use firecrawl agent instead of firecrawl scrape?▼

Use the agent for multi-page sites where the data location is unknown and navigation is required. For simple single-page extraction, scrape is faster and consumes fewer credits.

How do I limit credit usage for a Firecrawl agent run?▼

Pass the --max-credits option with a numeric limit to cap spending for that run. Agent runs consume more credits than simple scrapes, so setting a cap prevents unexpected costs.

Why does firecrawl agent return a job ID instead of results?▼

Without the --wait flag, the command returns a job ID immediately instead of waiting for completion. Always include --wait to get results inline once the agent finishes, which typically takes 2-5 minutes.

Can I restrict which pages the Firecrawl agent visits?▼

Yes, use the --urls option to specify starting URLs for the agent. This focuses extraction on specific pages rather than letting the agent navigate the entire site.

Related Skills

Explore More Data & Analytics Skills→
ZJU-REALZJU-REAL
195

firecrawl-agent

Extract structured JSON data from multi-page websites via the Firecrawl CLI.

Official
Advanced
LeroyAdonisLeroyAdonis

competitor-intel

Scrapes competitor pricing pages with Playwright and extracts structured feature intelligence.

Community
Intermediate
TeamWiseFlowTeamWiseFlow
8.4k

intel-gathering

Monitor social and web sources to extract and summarize new business intelligence.

Official
Intermediate
orthogonal-shorthogonal-sh
12

scrape

Extracts structured data from web pages and URLs via modular scraping workflows.

Official
Advanced