unblock

Retrieve validated page content from blocked URLs via adaptive fetch escalation.

37|7|Updated Mar 19, 2026
One-click install
npx skills add https://github.com/unclejobs-ai/second-claude-code --skill unblock-unclejobs-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: unblock
Source: https://github.com/unclejobs-ai/second-claude-code/tree/main/skills/unblock
Command: npx skills add https://github.com/unclejobs-ai/second-claude-code --skill unblock-unclejobs-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill restores readable page content when direct fetching fails due to 4xx blocks, WAF/captcha interstitials, or JavaScript-rendered pages that return empty shells.

Core Features & Use Cases

  • Adaptive fetch escalation: retries across public APIs, free renderers, curl header/TLS impersonation, headless browsers, and archive mirrors until validated content is found.
  • Validation-first stopping rule: treats HTTP 200 as failure unless the returned body passes a validator (length, stripping, challenge signatures, and content-type checks).
  • Use Case: When your research step gets a 403/blocked page or a JS SPA that returns a near-empty HTML body, you can automatically retrieve the best available text and preserve traceable evidence of which phase succeeded.

Quick Start

Use the unblock skill to fetch and validate the content of a single URL by running it in JSON mode so you can inspect which escalation phase succeeded.

Frequently Asked Questions about unblock

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I retrieve content from a URL that returns a 403 blocked page or WAF interstitial?

To retrieve content from a blocked URL, the system applies an adaptive fetch escalation chain across public APIs, curl header impersonation, headless browsers, and archive mirrors until validated page content is recovered.

Why does my web scraping return an empty HTML shell and how can I get the actual text?

Empty HTML shells occur when fetching JavaScript SPA pages without rendering; the system resolves this by retrying through free renderers and headless browsers to extract and validate the actual page text.

How does body validation work when recovering content from hostile pages?

Body validation treats an HTTP 200 response as a failure unless the returned content passes strict checks for body length, challenge signatures, stripping, and content-type, ensuring only usable text is accepted.

Can I use headless browsing to bypass captcha challenges for research automation?

Headless browsing is utilized as one phase of an adaptive escalation chain to fetch usable content, but it stops if the response contains challenge signatures, subsequently falling back to archive mirrors for rescue.

What is the best way to fetch single-URL research data when earlier fetch attempts fail?

The best way to fetch single-URL research data after failures is a zero-key-first adaptive escalation process that probes public APIs, renderers, and archives while applying strict SSRF prevention via public URL guarding.

What are the limitations of using archive fallback for content recovery?

Archive fallback for content recovery is a terminal limitation that triggers when all engine validation phases fail, ultimately reporting a partial archive rescue rather than a fully validated live page response.