skills.rest
AgriciDaniel
AgriciDanielCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

seo-firecrawl

Crawl and map websites to reveal pages, structure, and content gaps.

566|81|Updated Apr 27, 2026
Search Tags:#firecrawl#sitemap#seo#js-rendering#site-crawl#site-mapping
One-click install
npx skills add https://github.com/AgriciDaniel/codex-seo --skill seo-firecrawl-agricidaniel
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/AgriciDaniel/codex-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/AgriciDaniel/codex-seo --skill seo-firecrawl-agricidaniel

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Full-site crawling, scraping, and site mapping via Firecrawl MCP. Quickly identify pages, structure, and JS-rendered content to support technical SEO audits.

Core Features & Use Cases

  • Full-site crawl with content extraction and page metadata
  • Site structure discovery and sitemap comparison
  • JS-rendering support for SPA pages
  • Broken-link detection and page inventory
  • Seamless integration with Codex SEO workflows (seo-technical, seo-sitemap, seo-content)

Quick Start

Run the seo-firecrawl crawl <url> to begin a full-site crawl and generate a site map.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl JavaScript-rendered pages for an SEO audit?▼

To crawl JavaScript-rendered pages, this Skill uses Firecrawl MCP to execute client-side scripts during the site crawl. It supports SPA page rendering, extracts page metadata, and surfaces content inventory for technical SEO audits.

How do I generate a full site map and compare it against an existing sitemap?▼

Generating a full site map involves discovering the site structure and comparing it against existing sitemaps. This Skill applies the Firecrawl map command to discover site structure and validates it against sitemap data to identify missing or broken pages.

Do I need a Firecrawl MCP server to perform a full-site crawl?▼

Yes, you need a Firecrawl MCP server to perform a full-site crawl. The Skill requires this server to execute the crawl, map, and scrape commands that surface outputs for downstream agents and SEO workflows.

Can I detect broken links during a website content inventory?▼

Yes, broken-link detection is integrated into the full-site crawl process. The Skill identifies broken links while generating a page inventory, revealing site structure and content gaps alongside the extracted page metadata.

What is the best way to scrape site content for downstream agents?▼

Using the Firecrawl scrape command is the best way to scrape site content for downstream agents. This Skill extracts content and page metadata, formatting outputs specifically for integration with downstream Codex SEO workflows.

Why does my site crawl miss dynamically loaded SPA content?▼

A site crawl misses dynamically loaded SPA content if the crawler lacks JavaScript-rendering support. This Skill uses Firecrawl JS-rendering to execute client-side scripts, ensuring dynamically loaded SPA content is fully extracted during the crawl.

Related Skills

Explore More Data & Analytics Skills→
rothwellmawela-cyberrothwellmawela-cyber

seo-firecrawl

Crawl, map, and scrape large websites into structured site data.

Community
Advanced
IdkwhatImD0ingIdkwhatImD0ing

audit-website

Audit websites for SEO, performance, accessibility, and security issues.

Community
Advanced
humanerd-drewhumanerd-drew
2

seo-audit

Audits websites for SEO and GEO performance using AI search engines and Python modules.

Official
Advanced
roach88roach88
2

scraping-websites

Crawl static and JavaScript-rendered websites and extract structured data.

Community
Intermediate