blocked-page-recovery

Recover blocked or paywalled web pages from Wayback Machine, archive.today, and Jina Reader.

Updated Jul 3, 2026
One-click install
npx skills add https://github.com/CHENHUI-X/toolbox --skill blocked-page-recovery-chenhui-x
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: blocked-page-recovery
Source: https://github.com/CHENHUI-X/toolbox/tree/main/official-skills/web/blocked-page-recovery
Command: npx skills add https://github.com/CHENHUI-X/toolbox --skill blocked-page-recovery-chenhui-x

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Web fetches frequently fail with 403/429 errors, paywalls, Cloudflare interstitials, or bot-detection walls, leaving you without the content you need. This Skill recovers copies of blocked pages from third-party archives and rendering services instead of retrying the same blocked URL. ## Core Features & Use Cases - Ordered recovery ladder: Tries Wayback Machine first, then archive.today domain rotation, then Jina Reader (when JINA_API_KEY is set), with an API-first pivot and real browser as last resorts. - Fake-success detection: Validates every response body against byte floors, interstitial titles, and redirect stubs so dead ends like Google Cache and AMP caches are never mistaken for real content. - Provenance tracking: Labels every result as a dated snapshot or live render so citations correctly reflect whether content is archived or current. - Use Case: A news article returns a paywall. Run the bundled script with the URL to get the first genuine archived copy, its snapshot timestamp, and guidance on how to cite it. ## Quick Start Ask the agent to recover the blocked article at a given URL using the recovery script and report which archive route succeeded with its snapshot date.

Frequently Asked Questions about blocked-page-recovery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I recover a webpage blocked by a paywall or 403 error?

Run the bundled recover_page.py script with the blocked URL. It tries the Wayback Machine first, then archive.today domain rotation, then Jina Reader, returning the first validated copy with its provenance and snapshot timestamp.

What is the best way to bypass Cloudflare bot detection for fetching a page?

Instead of fighting the WAF directly, fetch a third-party copy from the Wayback Machine or archive.today. If those fail, pivot to the site's API, GraphQL, JSON, or RSS endpoints, which are typically less protected than the HTML surface.

Does the Jina Reader route work without an API key?

No. Anonymous access to r.jina.ai returns 401 with a Turnstile challenge, so the JINA_API_KEY environment variable must be set. The script skips the Jina route entirely when the key is unset.

Why does Google Cache not work for recovering pages anymore?

Google Cache was discontinued in mid-2024. The webcache.googleusercontent.com endpoint returns HTTP 200 with a Google Search interstitial and JavaScript redirect, not a cached page, so it must never be treated as a successful recovery.

Can I cite an archived snapshot as the current live page?

No. Snapshots from Wayback or archive.today may be stale and must be cited with their archive date. For current data like prices or breaking news, treat a snapshot as context only and state its age explicitly.