skills.rest
sky770825
sky770825COMMUNITY
Explore all skills by this author →
GitHub

playwright-scraper-skill

Automate web scraping of dynamic websites with Playwright and anti-bot bypass.

Updated Feb 3, 2026
Search Tags:#data extraction#web scraping#playwright#cloudflare#dynamic content#anti-bot
One-click install
npx skills add https://github.com/sky770825/openclaw-console-hub --skill playwright-scraper-skill
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: playwright-scraper-skill
Source: https://github.com/sky770825/openclaw-console-hub/tree/main/skills/playwright-scraper-skill
Command: npx skills add https://github.com/sky770825/openclaw-console-hub --skill playwright-scraper-skill

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) and examples (resource) and references (resource) components.

What problem does it solve?

This Skill automates web scraping for dynamic websites, including those protected by anti-bot measures like Cloudflare, ensuring reliable data extraction where simpler methods fail.

Core Features & Use Cases

  • Dynamic Content Scraping: Renders JavaScript to capture up-to-date website content.
  • Anti-Bot Bypass: Employs techniques to hide automation and mimic human users, successfully accessing sites like Discuss.com.hk.
  • Use Case: Automatically gather product details, pricing, and reviews from an e-commerce site that uses Cloudflare to block bots.

Quick Start

Use the playwright-scraper-skill to scrape the content from the URL "https://m.discuss.com.hk/#hot".

Frequently Asked Questions about playwright-scraper-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape dynamic website content that requires JavaScript rendering?▼

To scrape dynamic website content, this skill uses Playwright to render JavaScript, capturing fully loaded HTML and up-to-date data where simpler scraping methods fail. It automates browser interactions to extract dynamic content reliably.

Can I use Playwright to bypass Cloudflare anti-bot protection?▼

Yes, you can bypass Cloudflare anti-bot protection using this skill's stealth scraping mode. It employs techniques to hide automation and mimic human users, allowing access to sites like Discuss.com.hk that actively block bots.

What's the best way to extract data from websites that block automated scraping?▼

The best way to extract data from anti-bot protected websites is using stealth scraping techniques. This skill hides browser automation indicators, mimics human behavior, and handles JavaScript rendering to bypass anti-bot mechanisms successfully.

Does this web scraping approach support capturing screenshots and HTML content?▼

Yes, this web scraping approach supports capturing both screenshots and HTML content. Beyond extracting data, it leverages Playwright's rendering capabilities to save visual snapshots and full page HTML for dynamic content analysis.

Do I need to install Playwright separately to scrape dynamic web pages?▼

Playwright is a required dependency for this skill to scrape dynamic web pages. You need the Playwright environment installed, as the skill relies on its browser automation API to render JavaScript and execute stealth scraping.

Related Skills

Explore More Software Engineering Skills→
ryankoleanryankolean
3

cli-playwright

Automate browser interactions and end-to-end tests across Chromium, Firefox, and WebKit.

Community
Advanced
Pans0020Pans0020

markdown-exporter

Convert Markdown content into DOCX, PPTX, XLSX, PDF, HTML, IPYNB, MD, CSV, JSON/JSONL, XML, and extracted code files.

Community
Advanced
luis2404123luis2404123

proxy-rotation

Rotate IP addresses per request or sticky session for web scraping.

Community
Intermediate
gyuhagyuha
2

scrapling-official

Scrape and crawl websites with HTTP requests, browser automation, and anti-bot bypass.

Community
Advanced