brightdata

Scrape web content by escalating through four retrieval methods.

17.4k|2.3k|Updated Sep 8, 2025

Search Tags:#automation #web scraping #content extraction #markdown conversion #bot detection #URL fetching

One-click install

npx skills add https://github.com/danielmiessler/Personal_AI_Infrastructure --skill brightdata

Or copy as Structured Prompt for Agent▼

Please help me install this Agent Skill.
Skill: brightdata
Source: https://github.com/danielmiessler/Personal_AI_Infrastructure/tree/main/.claude/Skills/BrightData
Command: npx skills add https://github.com/danielmiessler/Personal_AI_Infrastructure --skill brightdata

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright.

What problem does it solve?

This Skill eliminates the frustration of blocked websites and bot detection by automatically escalating through four scraping methods until it succeeds, ensuring you always get the content you need.

Core Features & Use Cases

Progressive Escalation: Automatically tries WebFetch, cURL, browser automation, and professional scraping in sequence.
Universal Access: Handles everything from simple sites to heavily protected pages with CAPTCHA.
Use Case: Imagine you're researching competitors and need content from a site that blocks standard tools. This Skill will systematically try all methods and deliver the content in markdown format.

Quick Start

Simply ask "Scrape this URL" or "Get content from https://example.com" and the system will automatically use the most efficient method to retrieve the content.