playwright-scraper-skill

Scraping dynamic websites with Cloudflare anti-bot protection requires a stealth mode approach using Playwright to automate browser actions and mask your user agent. This Skill provides a dedicated stealth script that applies anti-detection tactics to bypass these measures reliably.

Extracting JavaScript-rendered content without blocks is best handled by using a headless browser framework like Playwright to execute dynamic scripts. The simple scraping mode in this Skill navigates JavaScript-rendered pages to capture dynamically loaded HTML and screenshots.

Playwright works for scraping specialized targets like YouTube and Reddit when paired with dedicated scraping guidance. This Skill includes specific site guidance and scripts designed to handle the unique dynamic loading and anti-bot structures of these platforms.

To set up Playwright for local web scraping, you need to install Node.js dependencies via npm and configure the Chromium browser environment. This Skill offers a straightforward installation process and a quick start command to launch your scraping script.

You can customize user agents and capture screenshots during a Playwright scraping session through environment-variable configuration. The scripts support headless or headful modes, optional HTML outputs, and screenshot generation for comprehensive data extraction.

Limitations of using Playwright for anti-bot scraping include potential detection by advanced security systems despite stealth tactics and the resource overhead of running full browser instances. It is most effective for controlled, reproducible extraction rather than high-volume crawling.