skills.rest
agencedajm
agencedajmCOMMUNITY
Explore all skills by this author →
GitHub

seo-firecrawl

Crawl and map website URLs to extract rendered page content for SEO audits.

Updated Apr 22, 2026
Search Tags:#crawl budget#site mapping#internal links#firecrawl mcp#seo crawling#js scraping#broken link detection
One-click install
npx skills add https://github.com/agencedajm/claude-seo --skill seo-firecrawl-agencedajm
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/agencedajm/claude-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/agencedajm/claude-seo --skill seo-firecrawl-agencedajm

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It solves the problem of discovering and extracting site-wide page data needed for an SEO audit when sites are large, dynamic (JS-rendered), or hard to inventory manually.

Core Features & Use Cases

  • Full-site crawling with extraction: Crawl all discoverable pages and return page content, metadata, and links for large-scale analysis.
  • Credit-efficient URL mapping: Quickly discover and inventory URLs without fetching full page content.
  • JS-rendered scraping: Scrape a single page with JavaScript rendering to surface dynamic content for accurate on-page and E-E-A-T evaluation.

Quick Start

Run a full crawl for your target site by issuing: /seo firecrawl crawl https://example.com

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl and extract content from JavaScript-rendered pages for an SEO audit?▼

To crawl JS-rendered pages for an SEO audit, you scrape pages with JavaScript rendering enabled to surface dynamic content. This ensures accurate on-page evaluation for SPA sites where standard static HTML extraction fails.

What is the most credit-efficient way to discover all URLs on a large site?▼

The most credit-efficient way to discover URLs on a large site is URL mapping. Mapping quickly inventories discoverable URLs without fetching full page content, saving crawl budget while preparing data for site audits.

Can I limit my SEO crawling to specific site sections using include and exclude patterns?▼

Yes, you can limit SEO crawling to specific site sections using include and exclude patterns. This section-focused crawling targets specific directories or URL structures while excluding irrelevant paths from your audit workflow.

Do I need a Firecrawl API key and MCP tools to run a full-site crawl?▼

Yes, you need a Firecrawl API key and MCP tools to run a full-site crawl. The workflow requires firecrawl_crawl, firecrawl_map, firecrawl_scrape, or firecrawl_search MCP availability checks before execution.

How do I detect broken links and map internal links across my website?▼

You detect broken links and map internal links by crawling all discoverable pages and returning page content, metadata, and links. This returns comprehensive site data for large-scale link analysis within audit workflows.

Why does static HTML extraction fail on my SPA site and how do I get rendered content?▼

Static HTML extraction fails on SPA sites because content loads dynamically via JavaScript. You get rendered content by using JS-rendered scraping, which executes JavaScript to surface dynamic content for accurate on-page and E-E-A-T evaluation.

Related Skills

Explore More Marketing & Sales Skills→
REVREBELREVREBEL

seo-firecrawl

Crawl, scrape, and map full websites for SEO analysis via Firecrawl MCP.

Official
Advanced
safeai-aussafeai-aus
6

Site Review

Audit Zensical site builds, links, headings, assets, and SEO metadata.

Community
Advanced
smarmen86smarmen86

seo-firecrawl

Crawl and map websites via Firecrawl MCP for SEO audits.

Community
Advanced
DaddyElonMusk69DaddyElonMusk69

scrapling

Scrape JavaScript-rendered and Cloudflare-protected web pages via CLI or Python.

Community
Advanced