skills.rest
kabde
kabdeCOMMUNITY
Explore all skills by this author →
GitHub

seo-firecrawl

Crawl websites to map pages, content, and metadata via Firecrawl MCP.

11|4|Updated Apr 23, 2026
Search Tags:#firecrawl#web-scraping#crawl#js-rendering#site-map#seo-audit
One-click install
npx skills add https://github.com/kabde/seo-skills --skill seo-firecrawl-kabde
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/kabde/seo-skills/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/kabde/seo-skills --skill seo-firecrawl-kabde

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Full-site crawling, mapping, and content discovery across large websites using Firecrawl MCP. This enables you to quickly inventory pages, assess site structure, and surface content for SEO analyses.

Core Features & Use Cases

  • Full-site crawl with content extraction and metadata collection.
  • Site-structure discovery, URL pattern analysis, and orphan-page detection.
  • JS-rendered page scraping for SPA content and dynamic elements.
  • Quick cross-skill integration for SEO audits (technical, content, and schema) when Firecrawl is available.

Quick Start

Install the Firecrawl extension and run a full-site crawl starting from the target URL.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl a website to create a full content inventory and site map?▼

To create a site map and content inventory, you can crawl a target URL to extract metadata, discover site structure, and identify URL patterns. This process surfaces all pages for comprehensive SEO audits.

Can I scrape JS-rendered pages and dynamic content from a single page application?▼

Yes, JS-rendered page scraping captures dynamic elements and SPA content. The crawl mechanism executes JavaScript to ensure dynamically loaded content is fully extracted and mapped.

Do I need a Firecrawl MCP server to perform a full-site crawl?▼

Yes, a Firecrawl MCP server is required to execute crawl, map, scrape, and search commands. The server processes the target URL and returns the extracted content, metadata, and structure data.

What is the best way to detect orphan pages during a site structure discovery?▼

Site structure discovery analyzes URL patterns and internal links across the crawled site to detect orphan pages. This maps isolated URLs that are not linked from the main site architecture.

Can I use the extracted crawl data for a technical SEO audit?▼

Yes, the extracted content, metadata, and site structure data integrate quickly into technical, content, and schema SEO audits. This provides the necessary inventory to assess broken links and site-wide page health.

Related Skills

Explore More Data & Analytics Skills→
upmarkingupmarking

seo-firecrawl

Crawl websites via Firecrawl MCP to gather pages, metadata, and links.

Official
Advanced
oldwinteroldwinter
5

audit-website

Audit websites for SEO, technical, content, and security issues with squirrelscan CLI.

Community
Advanced
ryan-mtryan-mt
3

seo-page

Analyze a single web page's on-page SEO, content, schema, images, and performance.

Community
Advanced
leto-labsleto-labs

firecrawl

Automate web research, content extraction, and browser interactions into markdown outputs.

Official
Advanced