skills.rest
adelpro
adelproCOMMUNITY
Explore all skills by this author →
Website𝕏@adelproGitHub

playwright-scraper-skill

Automates dynamic web scraping with Playwright and anti-bot protections.

2|Updated Mar 21, 2026
Search Tags:#automation#javascript#playwright#web-scraping#headless-browser#anti-bot#dynamic-sites
One-click install
npx skills add https://github.com/adelpro/openclaw-arsenals --skill playwright-scraper-skill-adelpro
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: playwright-scraper-skill
Source: https://github.com/adelpro/openclaw-arsenals/tree/main/02-skills/playwright-scraper-skill
Command: npx skills add https://github.com/adelpro/openclaw-arsenals --skill playwright-scraper-skill-adelpro

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) components.

What problem does it solve?

Dynamic websites with anti-bot protections require automated, resilient scraping workflows that can render JavaScript and counteract bot-detection.

Core Features & Use Cases

  • Playwright-based scraping for dynamic sites with optional stealth mode to bypass basic anti-bot checks.
  • Handles Cloudflare-style protections and other anti-bot measures with a production-ready script set.
  • Use cases include data extraction, content harvesting from pages like Reddit or YouTube transcripts, and archiving site content for analysis.

Quick Start

Install dependencies and run the target script with your URL to begin scraping.

Frequently Asked Questions about playwright-scraper-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape dynamic websites protected by Cloudflare anti-bot checks?▼

Scraping Cloudflare-protected dynamic sites requires a headless browser to render JavaScript and apply stealth techniques. This Skill uses Playwright scripts to deterministically fetch and extract data while bypassing basic anti-bot protections.

Can I use Playwright to extract YouTube transcripts and Reddit content?▼

Yes, Playwright can extract YouTube transcripts and Reddit content. The Skill provides scripts like playwright-simple.js and playwright-stealth.js to automate JavaScript rendering and harvest data from these targeted sources where standard fetchers fail.

Do I need Node.js installed to run Playwright scraping scripts?▼

Yes, Node.js is required to run Playwright scraping scripts. The Skill depends on the Playwright npm package and executes JavaScript scripts to manage headless browser automation, page rendering, and data extraction.

What is the best way to handle bot detection when web scraping with a headless browser?▼

Handling bot detection involves using stealth plugins and modified browser fingerprints. The Skill includes a playwright-stealth.js script designed to counteract anti-bot measures and manage resilient scraping workflows for dynamic pages.

Why does standard HTTP fetching fail on dynamic web pages and when do I need Playwright?▼

Standard fetching fails on dynamic pages because it cannot execute JavaScript or wait for content to render. You need Playwright when scraping JavaScript-heavy sites, Cloudflare-protected pages, or sources like YouTube that require a full browser environment to load data.

Related Skills

Explore More Software Engineering Skills→
wangzhongyuan11wangzhongyuan11
1

playwright

Automate browser workflows from the terminal using Playwright CLI.

Community
Intermediate
nq-rdlnq-rdl

convert-file

Convert data files between formats using DuckDB COPY statements.

Official
Intermediate
otrebuotrebu
4

web-to-markdown

Batch-convert JavaScript-rendered web pages to a timestamped Markdown file.

Community
Advanced
kevinnftkevinnft
13

cloud-browser-automation

Automate cloud-browser web scraping to bypass Cloudflare and render JavaScript-driven pages.

Community
Advanced