skills.rest
smarmen86
smarmen86COMMUNITY
Explore all skills by this author →
GitHub

seo-firecrawl

Crawl and map websites via Firecrawl MCP for SEO audits.

Updated Jun 5, 2026
Search Tags:#audit#firecrawl#scraping#sitemap#seo#crawling
One-click install
npx skills add https://github.com/smarmen86/claude-code-kit --skill seo-firecrawl-smarmen86
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/smarmen86/claude-code-kit/tree/main/skills/seo-firecrawl
Command: npx skills add https://github.com/smarmen86/claude-code-kit --skill seo-firecrawl-smarmen86

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires firecrawl-mcp.

What problem does it solve?

This skill solves the challenge of gathering comprehensive site data for SEO audits by automating the discovery, mapping, and deep scraping of entire websites, including complex JavaScript-rendered pages.

Core Features & Use Cases

  • Full-Site Crawling: Automatically discover and extract content from every page on a domain to identify structural issues or content gaps.
  • Site Mapping: Quickly generate a map of site architecture to detect orphan pages and analyze crawl budget.
  • JS-Rendered Scraping: Perform deep scrapes on modern web applications that require JavaScript execution to reveal content.
  • Use Case: Use this to perform a comprehensive technical audit by mapping a site's structure, identifying broken links, and extracting content for E-E-A-T analysis.

Quick Start

Use the seo firecrawl crawl command followed by the target website URL to begin a full site analysis.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl an entire website for a technical SEO audit?▼

To perform a technical SEO audit, this skill automates full-site crawling to extract content and map site architecture. It discovers all pages on a domain to identify structural issues, broken links, and content gaps.

Can I scrape JavaScript-rendered pages for SEO site mapping?▼

Yes, this skill performs deep scraping on modern web applications that require JavaScript execution. It reveals dynamically loaded content so you can accurately map site architecture and extract data from static and dynamic web environments.

Do I need a Firecrawl MCP connection to extract site URLs?▼

Yes, an active Firecrawl MCP connection is required to execute site-wide data extraction and URL discovery tasks. The skill uses this server dependency to facilitate comprehensive crawling and structural mapping.

What is the best way to find broken links and orphan pages during site crawling?▼

The best way to find broken links and orphan pages is by generating a structural site map. This skill crawls the domain to discover all URLs, allowing you to analyze crawl budget, detect missing connections, and extract content for E-E-A-T analysis.

Does full-site scraping work for managing content inventory on large domains?▼

Yes, full-site scraping is effective for content inventory management across large domains. By automatically discovering and extracting content from every page, the skill helps identify structural issues and catalog all available site assets.

When should I use automated crawling instead of manual scraping for SEO?▼

Automated crawling should be used when you need comprehensive site-wide data extraction for SEO audits. It replaces manual scraping to efficiently map complex site architectures, identify broken links, and handle JavaScript-rendered pages.

Related Skills

Explore More Marketing & Sales Skills→
REVREBELREVREBEL

seo-firecrawl

Crawl, scrape, and map full websites for SEO analysis via Firecrawl MCP.

Official
Advanced
vibecodevibecode
1

SEO Auditor

Crawl websites and analyze on-page SEO to generate prioritized audit reports.

Official
Advanced
naveedharrinaveedharri
53

seo-content

Analyze content quality and E-E-A-T signals to produce a structured report.

Community
Advanced
nishchaydevnishchaydev

seo-firecrawl

Crawl full websites and map pages for SEO audits using Firecrawl MCP tools.

Community
Intermediate