skills.rest
BestLemoon
BestLemoonCOMMUNITY
Explore all skills by this author →
Website𝕏@Real_Jewel_AIGitHub

seo-firecrawl

Crawl and map websites using Firecrawl MCP tools.

6|Updated Apr 3, 2026
Search Tags:#automation#firecrawl#spa#seo#crawl#site-map#js-render
One-click install
npx skills add https://github.com/BestLemoon/codex-seo --skill seo-firecrawl
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/BestLemoon/codex-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/BestLemoon/codex-seo --skill seo-firecrawl

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Full-site crawling, scraping, and site mapping via Firecrawl MCP. Use when user says "crawl site", "map site", "full crawl", "find all pages", "broken links", "site structure", "discover pages", "JS rendering", or needs site-wide analysis.

Core Features & Use Cases

  • Crawl an entire website starting from a given URL and collect page content, metadata, and links for comprehensive analysis.
  • Map site structure quickly to discover all URLs, detect orphan pages, and assess crawl budget.
  • SPA/JS-rendered pages: render JavaScript content to extract dynamic data and screenshots for visual inspection.
  • Integrate with seo-technical, seo-content, seo-schema to feed data into downstream analyses.

Quick Start

Install the Firecrawl extension using ./extensions/firecrawl/install.sh and run the appropriate slash command to begin crawling.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl a full website with JS-rendered content?▼

To crawl a full website with JS-rendered content, this Skill uses the Firecrawl MCP to render JavaScript, extract dynamic data, and collect page content. It supports full-site audits and section-focused crawls with credit-aware usage.

What is the best way to map site structure and discover all URLs?▼

Mapping site structure to discover all URLs is handled by the Firecrawl MCP. It quickly maps site structure to find all pages, detect orphan pages, and assess crawl budget for comprehensive analysis.

Can I detect broken links across domains during a full site crawl?▼

Yes, you can detect broken links across domains during a full site crawl. The Skill uses Firecrawl MCP to analyze site structure and identify broken links, with format options and credit-aware usage.

Do I need to install the Firecrawl extension to crawl and extract content?▼

Yes, you need to install the Firecrawl extension to crawl and extract content. The Skill requires running the install script and uses MCP tools like firecrawl_crawl, including graceful fallbacks if Firecrawl is unavailable.

Related Skills

Explore More Marketing & Sales Skills→
agencedajmagencedajm

seo-firecrawl

Crawl and map website URLs to extract rendered page content for SEO audits.

Community
Intermediate
NormVgNormVg

on-page-seo-auditor

Audit web pages for on-page SEO issues across metadata, content, and structure.

Community
Advanced
humanerd-drewhumanerd-drew
2

seo-audit

Audits websites for SEO and GEO performance using AI search engines and Python modules.

Official
Advanced
abdullah1854abdullah1854
1

crawl-cli

Crawl websites and extract content into Markdown, JSON, or text.

Community
Basic