BrightData

Name: BrightData
Availability: InStock
Author: Steffen

Retrieve URL content via four-tier scraping with automatic fallback.

186|24|Updated Jan 1, 2026

Search Tags:#data extraction #MCP #Playwright #web scraping #URL content #tiered-scrape #BrightData

Ready to run

npx skills add https://github.com/Steffen025/pai-opencode --skill brightdata-steffen025

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: BrightData
Source: https://github.com/Steffen025/pai-opencode/tree/main/.opencode/skills/BrightData
Command: npx skills add https://github.com/Steffen025/pai-opencode --skill brightdata-steffen025

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

BrightData enables reliable URL content retrieval from websites that may block or minimize scraping attempts, offering a four-tier fallback strategy to ensure content extraction.

Core Features & Use Cases

Progressive scraping: WebFetch, Curl with Chrome-like headers, Browser Automation, and Bright Data MCP, with automatic fallback.
Markdown-ready output: Converts retrieved content into markdown-friendly format for downstream processing.
Use Cases: gather data from dynamic sites, circumvent bot protection, fetch long-form content for research, or extract data for audits.

Quick Start

Use BrightData to fetch content for a target URL by triggering the FourTierScrape workflow with a URL like https://example.com and let the skill select Tier 1 through Tier 4 as needed.

Frequently Asked Questions about BrightData

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract web content from sites with bot protection and CAPTCHAs?▼

Web scraping with bot protection is handled through a four-tier fallback strategy spanning WebFetch, curl, browser automation, and Bright Data MCP. It automatically attempts each tier to ensure reliable content extraction from sites blocking standard requests.

What is the best way to scrape dynamic websites that require JavaScript rendering?▼

Scraping dynamic websites is achieved by escalating through fallback tiers including browser automation via Playwright and Bright Data MCP. This ensures content is fully rendered before extraction, converting the output into markdown for downstream processing.

How does the four-tier fallback mechanism work for URL content retrieval?▼

The four-tier fallback mechanism for URL content retrieval works by sequentially attempting WebFetch, curl with Chrome-like headers, browser automation, and Bright Data MCP. If a tier fails, it automatically falls back to the next, ensuring predictable results and error handling.

Do I need a Bright Data MCP setup to use this web scraping skill?▼

A Bright Data MCP setup is not strictly required initially. The skill starts with WebFetch and curl, only escalating to Bright Data MCP as a final tier fallback for URLs with severe bot protection or CAPTCHA requirements.

Why does my standard web scraping return empty results on protected sites?▼

Standard web scraping returns empty results on protected sites because they block basic requests. This skill circumvents bot protection by providing a tiered fallback that eventually utilizes browser automation and Bright Data MCP for extraction.