Skills
.Work. You
Rest

42-screaming-frog

Community

CLI-driven Screaming Frog SEO Spider automation

Data & Analytics#cli#audit#seo#redirects#crawl#indexability#screamingfrog
Authorchapter42
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Running Screaming Frog crawls traditionally relies on GUI or brittle workarounds; this skill enables CLI-driven, headless crawls with automated exports, fitting into Claude Code workflows and 42: skill orchestration.

Core Features & Use Cases

  • CLI-based crawl control with commands for crawl, status, export, and analysis.
  • Profile-driven crawls using standard Screaming Frog .seospider profiles to tailor technical audits, content checks, and link analysis.
  • Rich data exports across multiple tabs (Internal, Canonicals, Hreflang, Images, Sitemaps, etc.) and optional Python API for programmatic insights.
  • Integrates with MCP server and Claude Code workflows to feed crawl data into other 42: skills.

Quick Start

Start a headless crawl with a chosen profile and export the results to a local folder for downstream analysis.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: 42-screaming-frog
Download link: https://github.com/chapter42/SEO-Skills-42/archive/main.zip#42-screaming-frog

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.