skills.rest
marcoamu
marcoamuCOMMUNITY
Explore all skills by this author →
GitHub

playwright-scraper-skill

Scrape dynamic and anti-bot protected web pages with Playwright.

1|Updated Mar 14, 2026
Search Tags:#automation#playwright#cloudflare#scraping#web data#anti-bot#dynamic-sites
One-click install
npx skills add https://github.com/marcoamu/openclaw-workspace --skill playwright-scraper-skill-marcoamu
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: playwright-scraper-skill
Source: https://github.com/marcoamu/openclaw-workspace/tree/main/skills/playwright-scraper-skill
Command: npx skills add https://github.com/marcoamu/openclaw-workspace --skill playwright-scraper-skill-marcoamu

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) components.

What problem does it solve?

The Playwright Scraper Skill automates resilient web data collection on dynamic sites, including those protected by anti-bot defenses, saving time and reducing manual effort.

Core Features & Use Cases

  • Handles dynamic pages using Playwright to extract titles, URLs, content and metadata.
  • Provides two modes (Simple and Stealth) to adapt to anti-bot defenses and a range of target sites.
  • Use case: scrape data from Cloudflare-protected sites like Discuss.com.hk and gather structured outputs for analytics.

Quick Start

Install dependencies with npm install, then run node scripts/playwright-stealth.js <URL> to start scraping a target site.

Frequently Asked Questions about playwright-scraper-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape data from Cloudflare-protected websites using Playwright?▼

You can scrape Cloudflare-protected websites by running the stealth mode script, which uses Playwright to bypass anti-bot defenses and extract structured data like titles, URLs, and content.

What is the best way to extract dynamic web content from anti-bot protected sites?▼

The best way to extract dynamic web content is using a stealth scraping mode that automates Playwright to navigate anti-bot defenses, yielding structured outputs for analytics without manual intervention.

Does Playwright work for scraping dynamic pages protected by anti-bot mechanisms?▼

Yes, Playwright works for scraping dynamic pages by offering a stealth mode specifically designed to handle anti-bot mechanisms, ensuring reliable data extraction from protected sites.

How do I get structured output from a web scraping script?▼

You get structured output by running the scraper script with a target URL, which returns organized data fields including the page title, URL, content, and optional artifacts.

Do I need Node.js to run the Playwright scraping script?▼

Yes, you need Node.js to install Playwright dependencies via npm and execute the JavaScript scraping script, which automates browser interactions and data extraction.

What are the limitations of using Playwright for web scraping?▼

While Playwright handles dynamic pages and anti-bot defenses, scraping effectiveness depends on the target site's protection level, and complex anti-bot systems may still block automated browsers.

Related Skills

Explore More Software Engineering Skills→
TianqiYeTianqiYe
2

playwright

Automate interactive browser tasks with Playwright for login, forms, and data extraction.

Community
Intermediate
aws-samplesaws-samples
90

file-processing

Process and analyze CSV, JSON, and text data files with automated cleaning and transformation.

Official
Advanced
xberg-ioxberg-io
26

extracting-metadata

Extract titles, descriptions, language, and Open Graph tags from HTML documents.

Official
Intermediate
phanijappsphanijapps
1

light-panda-browser

Automate web scraping and data extraction with the Lightpanda headless browser.

Community
Intermediate