skills.rest
xianmingyao
xianmingyaoCOMMUNITY
Explore all skills by this author →
GitHub

playwright-scraper-skill

Scrape dynamic and Cloudflare-protected sites with Playwright stealth scripts.

1|1|Updated Mar 18, 2026
Search Tags:#automation#playwright#cloudflare#browser#web-scraping#stealth#anti-bot
One-click install
npx skills add https://github.com/xianmingyao/openclaw-CaySon --skill playwright-scraper-skill-xianmingyao
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: playwright-scraper-skill
Source: https://github.com/xianmingyao/openclaw-CaySon/tree/main/skills/playwright-scraper-skill
Command: npx skills add https://github.com/xianmingyao/openclaw-CaySon --skill playwright-scraper-skill-xianmingyao

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) components.

What problem does it solve?

The Playwright Scraper Skill simplifies and stabilizes automated web scraping for sites with anti-bot protections, turning complex page renders into reliable data outputs.

Core Features & Use Cases

  • Anti-bot protection: hides automation markers and uses realistic UA.
  • Dual modes: simple and stealth scrapers for various websites.
  • Quick integration: easy to run in OpenClaw workflows and scripts with environment-variable customization.

Quick Start

Run the stealth scraper against a Cloudflare-protected site using node scripts/playwright-stealth.js <URL>.

Frequently Asked Questions about playwright-scraper-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape websites protected by Cloudflare anti-bot measures?▼

You can scrape Cloudflare-protected sites using Playwright stealth techniques that hide automation markers and apply realistic user agents. Running the stealth scraper script bypasses anti-bot blocks and returns structured JSON output with page content.

Do I need Node.js and Playwright to run automated browser scraping scripts?▼

Yes, Node.js and Playwright are required dependencies to execute the scraping scripts. You must have this environment configured to run the automation commands and capture structured JSON data from dynamic web pages.

What is the difference between simple and stealth modes for web scraping?▼

Simple mode handles basic dynamic sites, while stealth mode targets pages with anti-bot protections by hiding automation markers. Both modes return structured JSON containing the title, URL, and content, but stealth adds realistic browser behavior.

Can I save screenshots and HTML when scraping dynamic web pages with Playwright?▼

Yes, the scraping scripts can generate optional artifacts like screenshots and saved HTML files alongside the structured JSON output. You can configure these outputs using environment variables for browser behavior and timing.

How do I customize browser behavior and output timing for automated scraping?▼

You can configure browser behavior, output formats, and timing by passing environment variables to the Playwright scripts. This customization allows you to adjust the scraping process for different dynamic sites and anti-bot protection levels.

Related Skills

Explore More Software Engineering Skills→
grojedagrojeda
25

playwright-cli

Automate browser interactions and run Playwright tests from the command line.

Community
Intermediate
nathanvalenathanvale
2

firecrawl

Fetch web content and extract structured data via the Firecrawl API.

Community
Advanced
moogieonmoogieon

scrape

Extract data from web pages using scripting and HTML parsing.

Community
Intermediate
luis2404123luis2404123

proxy-rotation

Rotate IP addresses per request or sticky session for web scraping.

Community
Intermediate