skills.rest
lugondev
lugondevCOMMUNITY
Explore all skills by this author →
𝕏@tegufyGitHub

seo-firecrawl

Crawl websites and extract page content, metadata, and links for SEO audits.

Updated May 23, 2026
Search Tags:#broken links#javascript rendering#site mapping#seo crawl#firecrawl mcp#sitemap audit
One-click install
npx skills add https://github.com/lugondev/claude-seo --skill seo-firecrawl-lugondev
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/lugondev/claude-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/lugondev/claude-seo --skill seo-firecrawl-lugondev

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It solves the problem of discovering and extracting complete website content for SEO audits, especially on sites that rely on JavaScript rendering and complex internal linking.

Core Features & Use Cases

  • Full-site crawling: Crawl a site from a starting URL and return page content, metadata, and discovered links.
  • Site structure mapping: Discover URL structures quickly (URLs only) to support sitemap comparisons and orphan-page detection.
  • Single-page deep scraping: Scrape one page with full JS rendering and optional screenshots for visual/UX validation.
  • Site-scoped search: Search within a website without crawling everything, useful for content-gap checks and internal linking opportunities.
  • SEO audit workflows: Use the crawl/map outputs to feed technical, content, and schema analysis agents.

Quick Start

Ask to crawl a site by telling the AI: use /seo firecrawl crawl https://example.com and extract content for the first 50 pages.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl a JavaScript-rendered site for a full SEO audit?▼

Site structure mapping discovers URLs quickly to support sitemap comparisons and orphan-page detection. This mapping process returns URL structures only, allowing you to evaluate sitemap coverage without crawling full page content.

Does crawling large sites require setting specific limits for depth and paths?▼

Yes, crawling large sites requires honoring crawl limits, depth, and include/exclude paths. The Skill operates via Firecrawl MCP tools and respects these output format options to manage scale during site-scoped search and extraction.

How do I check for broken links and content gaps without crawling everything?▼

You can perform a site-scoped search to check for content gaps and broken links without crawling everything. This allows targeted URL discovery and internal linking opportunity identification across the website.

Do I need a connected Firecrawl server to scrape single pages for SEO?▼

Yes, you need a connected Firecrawl server to scrape single pages for SEO. The Skill operates via Firecrawl MCP tools to execute deep scraping with full JS rendering and optional screenshots for visual validation.

Related Skills

Explore More Marketing & Sales Skills→
REVREBELREVREBEL

seo-firecrawl

Crawl, scrape, and map full websites for SEO analysis via Firecrawl MCP.

Official
Advanced
AgriciDanielAgriciDaniel
566

seo-firecrawl

Crawl and map websites to reveal pages, structure, and content gaps.

Community
Advanced
tapanshahtapanshah

seo-sitemap

Analyze and generate XML sitemaps with URL validation and Google guideline adherence.

Community
Intermediate
kostja94kostja94
872

rendering-strategies

Guide selection of SSG, SSR, ISR, or CSR rendering for SEO crawlers.

Community
Intermediate