skills.rest
narr07
narr07COMMUNITY
Explore all skills by this author →
WebsiteGitHub

seo-firecrawl

Crawl, map, and scrape websites via Firecrawl MCP for SEO analysis.

Updated Aug 10, 2026
Search Tags:#firecrawl#mcp#web crawling#scraping#seo#broken links#site mapping
One-click install
npx skills add https://github.com/narr07/permadi --skill seo-firecrawl-narr07
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/narr07/permadi/tree/main/.agents/skills/claude-seo/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/narr07/permadi --skill seo-firecrawl-narr07

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Auditing an entire website for SEO requires discovering every page, rendering JavaScript-heavy content, and extracting metadata at scale, which manual browsing and simple fetch tools cannot handle. ## Core Features & Use Cases - Full-Site Crawling: Crawl up to 500 pages with configurable depth, path filters, and markdown/HTML/links output formats. - Site Mapping: Discover all URLs on a domain quickly and cheaply to compare against XML sitemaps and detect orphan pages. - JS-Rendered Scraping: Scrape single pages with full JavaScript execution, browser actions, and main-content extraction for SPA audits. - Site-Scoped Search: Find pages mentioning specific topics for content gap validation and internal linking opportunities. - Use Case: Run a map operation on a domain, compare discovered URLs against the sitemap to find orphan pages, then crawl the top 50 pages and feed the content to technical, content, and schema SEO agents. ## Quick Start Ask the AI to crawl https://example.com with Firecrawl and list all discovered pages with their titles and meta descriptions.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl an entire website for SEO analysis?▼

Use the firecrawl_crawl MCP tool with a starting URL, a page limit up to 500, and optional includePaths or excludePaths glob patterns. It returns page content, metadata, and links for all discovered pages, which can feed technical and content SEO agents.

How to find orphan pages and broken links on a website?▼

Run firecrawl_map to discover all linked URLs, then compare them against the XML sitemap to find orphan pages. For broken links, crawl with the links output format and check every internal href for 404 responses.

Firecrawl scrape vs fetch_page.py: which should I use?▼

Use fetch_page.py for static HTML pages and when you need response headers at no API cost. Use firecrawl_scrape for JavaScript-rendered SPAs, lazy-loaded content, clean markdown extraction, or sites with anti-bot protection.

Does Firecrawl work with JavaScript-rendered React or Vue sites?▼

Yes, firecrawl_scrape executes JavaScript and waits for dynamic content before extraction, so it handles React, Vue, and Angular SPAs. You can set waitFor selectors, timeouts, and browser actions like click and scroll.

Why does Firecrawl return a 402 or 429 error?▼

A 402 error means your Firecrawl credits are exhausted; check usage at firecrawl.dev/app or upgrade the plan. A 429 error means you are rate limited; wait 60 seconds and reduce crawl concurrency before retrying.

What are the limitations of Firecrawl free tier crawling?▼

The free tier provides 500 credits per month, where one credit equals one page crawled or scraped and map operations cost 0.5 credits per URL. Large crawls should be estimated and confirmed with the user before running.

Related Skills

Explore More Marketing & Sales Skills→
upmarkingupmarking

seo-firecrawl

Crawl websites via Firecrawl MCP to gather pages, metadata, and links.

Official
Advanced
PostalocityPostalocity
1

seo-audit

Crawl websites up to 500 pages and generate SEO health scores with prioritized action plans.

Official
Advanced
Focus-GTSFocus-GTS

product-page-seo

Audit AEM Edge Delivery Services product pages for crawlability and indexing gaps.

Official
Advanced
MCERQUAMCERQUA
1

screaming-frog

Execute technical SEO audits with Screaming Frog SEO Spider headless CLI.

Community
Advanced