link-checker

Crawls websites and detects broken links and 404 errors, generating CSV reports of inaccessible URLs.

145|28|Updated Jan 31, 2026
One-click install
npx skills add https://github.com/guia-matthieu/clawfu-skills --skill link-checker-guia-matthieu
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: link-checker
Source: https://github.com/guia-matthieu/clawfu-skills/tree/main/skills/seo-tools/link-checker
Command: npx skills add https://github.com/guia-matthieu/clawfu-skills --skill link-checker-guia-matthieu

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires aiohttp, beautifulsoup4, click, and includes scripts (resource) components.

What problem does it solve?

This Skill identifies broken links and 404 errors on websites, which is crucial for maintaining SEO health and ensuring a positive user experience.

Core Features & Use Cases

  • Crawl Websites: Scans web pages to discover all outgoing links.
  • Detect Broken Links: Identifies links that return errors (e.g., 404 Not Found) or are otherwise inaccessible.
  • Generate Reports: Outputs a list of broken links, optionally saved to a CSV file.
  • Use Case: Before launching a new version of a website, use this Skill to perform a comprehensive check for any broken internal or external links to avoid user frustration and SEO penalties.

Quick Start

Use the link checker skill to find broken links on https://example.com with a crawl depth of 2.

Frequently Asked Questions about link-checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find broken links and 404 errors on my website?

To find broken links and 404 errors on your website, you can crawl web pages to discover outgoing links and identify inaccessible URLs. This process scans internal and external links across a specified crawl depth to ensure website integrity and SEO performance.

How do I check for broken links before launching a new version of my site?

Checking for broken links before a site launch involves crawling your website to detect 404 errors and inaccessible URLs. You can perform a comprehensive check across specified crawl depths and generate a detailed report of broken internal and external links.

Can I use a link checker to crawl external links and save the results to a CSV file?

Yes, you can crawl external links and save the results. The link checker identifies inaccessible URLs and generates reports of broken links, which can optionally be saved to a CSV file for later analysis and website auditing.

What is the best way to perform a website audit for SEO health using Python?

The best way to perform a website audit for SEO health in Python is using web scraping libraries like aiohttp and beautifulsoup4. These dependencies allow you to crawl pages, detect 404 errors, and ensure website integrity by identifying broken links.

Does this broken link detection approach work with command-line interfaces?

Yes, this broken link detection approach works with command-line interfaces by utilizing the click dependency. You can specify the target website URL and crawl depth directly from the command line to start scanning for inaccessible links.

Why does crawling for broken links require setting a specific crawl depth?

Crawling for broken links requires setting a specific crawl depth to limit how many layers deep the web scraper follows outgoing links. Defining this depth controls the scope of the website audit, ensuring comprehensive yet manageable detection of 404 errors.