blocked-page-recovery

Recover blocked or paywalled web pages from archive services and reader proxies.

1|Updated Aug 11, 2026
One-click install
npx skills add https://github.com/Chia1104/agent-air --skill blocked-page-recovery-chia1104
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: blocked-page-recovery
Source: https://github.com/Chia1104/agent-air/tree/main/skills/hermes/web/blocked-page-recovery
Command: npx skills add https://github.com/Chia1104/agent-air --skill blocked-page-recovery-chia1104

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Web fetches frequently fail with 403/429 errors, paywalls, Cloudflare interstitials, or bot-detection walls, leaving you without the content you need. This Skill provides an ordered fallback ladder that retrieves third-party copies of the page instead of retrying the same blocked URL. ## Core Features & Use Cases - Multi-route recovery ladder: Tries the Wayback Machine, archive.today domain rotation, and Jina Reader (when JINA_API_KEY is set) in cheapest-first order via the bundled recover_page.py script. - Fake-success detection: Validates every candidate body with byte floors, interstitial-title rejection, and redirect-stub detection so dead Google Cache pages, AMP stubs, and 429 rate-limit bodies are never mistaken for real content. - Provenance discipline: Labels every result as a dated snapshot or a live re-render so citations never present stale archives as current pages. - Use Case: A news article returns a paywall interstitial. Run the script with the URL and receive the first genuine archived copy along with its snapshot timestamp and source URL, ready to cite as "as archived on <date>". ## Quick Start Ask the agent to recover the blocked article at a given URL using the blocked-page-recovery script and report its provenance.

Frequently Asked Questions about blocked-page-recovery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I recover a webpage blocked by a 403 or paywall?▼

Run recover_page.py with the blocked URL and it tries the Wayback Machine first, then archive.today domain rotation, then Jina Reader if JINA_API_KEY is set. It prints the first validated copy with its provenance and snapshot timestamp.

How to bypass Cloudflare "Just a moment" pages when fetching?▼

Instead of fighting the interstitial, fetch a third-party copy from web.archive.org or archive.today, which hold pre-rendered snapshots. For live content, Jina Reader re-renders the page server-side when an API key is configured.

Does the Wayback Machine work for JavaScript-only sites?▼

Wayback snapshots do not render JS-only SPAs, so archived copies may be incomplete. For those pages, use Jina Reader with JINA_API_KEY, which renders the live page in a real browser server-side and returns markdown.

Why does Google Cache no longer work for blocked pages?▼

Google Cache was retired in mid-2024; webcache.googleusercontent.com now returns a 200 response containing a Google Search interstitial with a JS redirect, not cached content. The script detects and rejects these fake successes automatically.

Can I cite an archived snapshot as the current page?▼

No. Snapshots from Wayback or archive.today may be stale and must be cited with their archive date. For current data like prices or breaking news, treat a snapshot as context only and state its age explicitly.