skills.rest
nowork-studio
nowork-studioOFFICIAL
Explore all skills by this author →
GitHub

broken-link-checker

Crawl website pages and validate URLs to identify broken links.

3.3k|414|Updated Mar 27, 2026
Search Tags:#python#crawl#broken-links#seo-audit#website-health#link-checker
One-click install
npx skills add https://github.com/nowork-studio/toprank --skill broken-link-checker
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: broken-link-checker
Source: https://github.com/nowork-studio/toprank/tree/main/seo/broken-link-checker
Command: npx skills add https://github.com/nowork-studio/toprank --skill broken-link-checker

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill scans a website to identify broken links (404s and 5xx errors). It crawls internal pages, identifies broken outbound links, and reports source pages for easy fixing. Use this when the user asks to "check for broken links", "find 404s", "audit my links", or "is my site healthy".

Core Features & Use Cases

  • Crawl internal pages and collect both internal and outbound links.
  • Detect 404s and 5xx errors and map each broken URL to its source page.
  • Generate a JSON-style report documenting the start URL, examined pages, and broken links for remediation.

Quick Start

Start by providing the target URL and run the script to begin crawling for broken links.

Frequently Asked Questions about broken-link-checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check my website for broken links and 404 errors?▼

To check for broken links, this scanner crawls internal pages and validates each URL using HEAD/GET requests. It identifies 404s and 5xx errors, mapping broken outbound links to their source pages for easy remediation.

How does a broken link checker handle robots.txt and crawling limits?▼

A broken link checker with robots.txt awareness respects crawling rules while scanning pages. It allows you to set a max_pages limit, ensuring the crawler examines a controlled number of internal pages concurrently.

Can I audit outbound links and find their source pages automatically?▼

Yes, you can audit outbound links automatically. The crawler collects both internal and external URLs, detects failures, and generates a report mapping each broken link directly to its source page.

What is included in a broken link audit JSON report?▼

A broken link audit JSON report includes the start_url, max_pages examined, and a detailed list of broken_links. This structured output documents the scanned pages and errors for immediate site health remediation.

Do I need Python to run a concurrent website health check for 404s?▼

Yes, you need Python to run this concurrent website health check. It operates as a Python-based scanner, using concurrent HEAD/GET requests to efficiently validate URLs and find 404s across your site.

Related Skills

Explore More Data & Analytics Skills→
boringdataboringdata
2

content-ingestion

Map sitemaps, fetch selected URLs, and extract content as markdown with metadata.

Community
Intermediate
BerryKuipersBerryKuipers
7

audit-dependencies

Audit npm dependencies for security vulnerabilities and outdated packages.

Community
Intermediate
PletnushaPletnusha

seo-audit

Audit websites for technical SEO, on-page SEO, content quality, and site structure issues.

Community
Advanced
seppegadeyneseppegadeyne

toprank-broken-link-checker

Detect broken internal and external links during bounded website crawls.

Community
Intermediate