seo-firecrawl

Crawl, map, scrape, and search websites for SEO analysis.

Updated Jun 12, 2026
One-click install
npx skills add https://github.com/somarjun/hermes-seo --skill seo-firecrawl-somarjun
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: seo-firecrawl
Source: https://github.com/somarjun/hermes-seo/tree/main/extensions/firecrawl/skills/seo-firecrawl
Command: npx skills add https://github.com/somarjun/hermes-seo --skill seo-firecrawl-somarjun

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the manual effort of discovering, crawling, and inspecting large websites for SEO analysis, especially when pages are dynamically rendered or spread across complex site structures.

Core Features & Use Cases

  • Full-site crawling: Collect page content, metadata, and links across an entire domain for comprehensive SEO audits.
  • Site mapping: Discover URL structures quickly without fetching full content, which is useful for sitemap comparison, orphan page detection, and crawl budget analysis.
  • Single-page scraping: Render JavaScript-heavy pages and extract clean main content, links, or screenshots for deep page-level review.
  • Site-scoped search: Find pages mentioning specific topics to validate content coverage and internal linking opportunities.
  • Operational fallback guidance: Detect when Firecrawl is unavailable or misconfigured and provide clear next steps.

Quick Start

Ask the assistant to crawl a website with the seo-firecrawl skill and return the key pages, structural patterns, and priority SEO issues.

Frequently Asked Questions about seo-firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl a full website for SEO analysis when pages are JavaScript-rendered?

Full-site crawling of JavaScript-rendered pages is achieved by extracting page content, metadata, and links across an entire domain. This enables comprehensive SEO audits even when content loads dynamically or relies on complex site structures.

What is the best way to discover URL structures without fetching full page content?

Site mapping quickly discovers URL structures without fetching full content. This technique is useful for sitemap comparison, orphan page detection, and crawl budget analysis to ensure search engines efficiently index important pages.

Can I scrape a single page that uses heavy JavaScript rendering?

Single-page scraping renders JavaScript-heavy pages to extract clean main content, links, or screenshots. This allows for deep page-level review of dynamically loaded elements that standard scrapers might miss.

How do I find internal linking opportunities for specific topics across my site?

Site-scoped search finds pages mentioning specific topics to validate content coverage. This identifies internal linking opportunities and ensures topical relevance across the discovered website structure.

What should I do if crawling fails or Firecrawl is unavailable?

When Firecrawl is unavailable or misconfigured, the workflow provides operational fallback guidance. This detects configuration issues and offers clear next steps to resolve extraction failures and resume crawling.

Do I need Firecrawl MCP tools to use this site crawling capability?

Firecrawl MCP tools are required to execute crawl, map, scrape, and search workflows. These tools provide the necessary infrastructure for coverage analysis, link discovery, and handling blocked sites.