broken-link-checker

Broken link checkers scan website pages by crawling internal links and validating HTTP responses to identify 4xx and 5xx errors. They distinguish internal versus external targets and map each broken link back to its source page for quick fixes.

A website crawler detects 404 and 500 server errors by requesting URLs found on your internal pages and evaluating their returned HTTP status codes. It categorizes any 4xx or 5xx response as a broken link and logs the specific source page where the dead link was found.

You audit website links by crawling internal pages and categorizing broken outbound links by their HTTP status codes. The audit distinguishes whether the broken targets are internal pages or external domains, mapping each error to its source page for targeted fixes.

Yes, you can limit crawl depth by specifying a max-pages parameter when running the broken link checker script. This configurable limit restricts the number of internal pages scanned, allowing you to control the scope and duration of the website audit.

The broken link audit outputs a structured JSON report. This format contains source-page mappings that categorize broken links by their HTTP status codes and distinguish between internal and external targets for actionable website fixes.

No external dependencies are required to run the broken link checker script. You simply execute the provided Python script with your target URL and an optional max-pages parameter to start scanning and generating the JSON report.