seo-firecrawl

Execute full-site crawls, single-page scrapes, and URL mapping via Firecrawl MCP.

19.4k|2.8k|Updated Feb 7, 2026

Search Tags:#firecrawl #mcp #web crawling #broken links #seo audit #site mapping #js rendering

Ready to run

npx skills add https://github.com/AgriciDaniel/claude-seo --skill seo-firecrawl-agricidaniel

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/AgriciDaniel/claude-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/AgriciDaniel/claude-seo --skill seo-firecrawl-agricidaniel

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Manual audits of large websites are slow and often miss JavaScript-rendered content, broken links, and orphan pages. Full-site crawling, scraping, and URL mapping through Firecrawl MCP automate the discovery of technical SEO problems at scale. ## Core Features & Use Cases - Full-Site Crawl: Extract page content, metadata, and links across an entire domain for comprehensive audits. - Site Mapping: Discover all URLs quickly without fetching content to analyze site structure and crawl budget. - Single-Page Scrape: Render JavaScript and extract clean markdown from dynamic pages for E-E-A-T and content analysis. - Site-Scoped Search: Find specific content within a domain to validate content gaps and internal linking opportunities. - Use Case: An SEO agency needs to audit a client's 500-page e-commerce site. Map all URLs, crawl key product and category pages, extract titles and meta descriptions, and feed the content to technical and schema subagents for a prioritized action plan. ## Quick Start Use the seo-firecrawl skill to map and crawl https://example.com, extracting page content and site structure for a full SEO audit.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I crawl an entire website for SEO analysis?▼

Use the firecrawl_crawl command with a starting URL to extract page content, metadata, and links across the site. Set the limit and maxDepth parameters to control scope, then feed the results to technical and content subagents for analysis.

What is the difference between Firecrawl map and crawl?▼

The map command discovers all URLs on a site without fetching content, making it fast and credit-efficient for structure analysis. The crawl command fetches full page content, metadata, and links for every discovered page up to the specified limit.

Does Firecrawl scrape JavaScript-rendered pages?▼

Yes, the firecrawl_scrape tool executes JavaScript and waits for dynamic content, making it suitable for single-page applications built with React, Vue, or Angular. Use the waitFor parameter to delay scraping until specific elements load.

Why does Firecrawl return a 402 Payment Required error?▼

A 402 error indicates exhausted Firecrawl credits. Check usage at firecrawl.dev/app and upgrade the plan if necessary. The free tier provides 500 credits per month, with one credit consumed per page crawled or scraped.

When should I use fetch_page instead of Firecrawl scrape?▼

Use fetch_page.py for static HTML pages when response headers are needed and to avoid API costs. Use firecrawl_scrape for JavaScript-rendered single-page applications, clean markdown extraction, or when the target site employs anti-bot protections.

Can Firecrawl detect broken links across a website?▼

Yes, run a full-site crawl with the links format to collect all internal hrefs, then check each URL for 404 status codes. This identifies broken internal links at scale across the entire domain.