brightdata
CommunityAutomate web scraping with smart fallback, you rest.
Data & Analytics#automation#web scraping#content extraction#markdown conversion#bot detection#URL fetching
Authordanielmiessler
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill eliminates the frustration of blocked websites and bot detection by automatically escalating through four scraping methods until it succeeds, ensuring you always get the content you need.
Core Features & Use Cases
- Progressive Escalation: Automatically tries WebFetch, cURL, browser automation, and professional scraping in sequence.
- Universal Access: Handles everything from simple sites to heavily protected pages with CAPTCHA.
- Use Case: Imagine you're researching competitors and need content from a site that blocks standard tools. This Skill will systematically try all methods and deliver the content in markdown format.
Quick Start
Simply ask "Scrape this URL" or "Get content from https://example.com" and the system will automatically use the most efficient method to retrieve the content.
Dependency Matrix
Required Modules
playwright
Components
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: brightdata Download link: https://github.com/danielmiessler/Personal_AI_Infrastructure/archive/main.zip#brightdata Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.