skills.rest
Steffen025
Steffen025COMMUNITY
Explore all skills by this author →
WebsiteGitHub

BrightData

Retrieve URL content via four-tier scraping with automatic fallback.

186|24|Updated Jan 1, 2026
Search Tags:#data extraction#MCP#Playwright#web scraping#URL content#tiered-scrape#BrightData
One-click install
npx skills add https://github.com/Steffen025/pai-opencode --skill brightdata-steffen025
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: BrightData
Source: https://github.com/Steffen025/pai-opencode/tree/main/.opencode/skills/BrightData
Command: npx skills add https://github.com/Steffen025/pai-opencode --skill brightdata-steffen025

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

BrightData enables reliable URL content retrieval from websites that may block or minimize scraping attempts, offering a four-tier fallback strategy to ensure content extraction.

Core Features & Use Cases

  • Progressive scraping: WebFetch, Curl with Chrome-like headers, Browser Automation, and Bright Data MCP, with automatic fallback.
  • Markdown-ready output: Converts retrieved content into markdown-friendly format for downstream processing.
  • Use Cases: gather data from dynamic sites, circumvent bot protection, fetch long-form content for research, or extract data for audits.

Quick Start

Use BrightData to fetch content for a target URL by triggering the FourTierScrape workflow with a URL like https://example.com and let the skill select Tier 1 through Tier 4 as needed.

Frequently Asked Questions about BrightData

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract web content from sites with bot protection and CAPTCHAs?▼

Web scraping with bot protection is handled through a four-tier fallback strategy spanning WebFetch, curl, browser automation, and Bright Data MCP. It automatically attempts each tier to ensure reliable content extraction from sites blocking standard requests.

What is the best way to scrape dynamic websites that require JavaScript rendering?▼

Scraping dynamic websites is achieved by escalating through fallback tiers including browser automation via Playwright and Bright Data MCP. This ensures content is fully rendered before extraction, converting the output into markdown for downstream processing.

How does the four-tier fallback mechanism work for URL content retrieval?▼

The four-tier fallback mechanism for URL content retrieval works by sequentially attempting WebFetch, curl with Chrome-like headers, browser automation, and Bright Data MCP. If a tier fails, it automatically falls back to the next, ensuring predictable results and error handling.

Do I need a Bright Data MCP setup to use this web scraping skill?▼

A Bright Data MCP setup is not strictly required initially. The skill starts with WebFetch and curl, only escalating to Bright Data MCP as a final tier fallback for URLs with severe bot protection or CAPTCHA requirements.

Why does my standard web scraping return empty results on protected sites?▼

Standard web scraping returns empty results on protected sites because they block basic requests. This skill circumvents bot protection by providing a tiered fallback that eventually utilizes browser automation and Bright Data MCP for extraction.

Related Skills

Explore More Data & Analytics Skills→
parcadeiparcadei
3.9k

firecrawl-scrape

Scrape web pages and extract content via Firecrawl MCP into Markdown, HTML, or plain text.

Community
Intermediate
PancrePal-xiaoyibaoPancrePal-xiaoyibao
6

pdf-reader

Extract text from local PDF files into structured Markdown format.

Official
Intermediate
ProyectoG007ProyectoG007

Playwright (Automation + MCP + Scraper)

Automate browser interactions and extract data from JavaScript-rendered pages using Playwright.

Community
Advanced
phatblatphatblat
12

BrightData

Scrape URLs via four escalating tiers from WebFetch to Bright Data MCP.

Community
Advanced