skills.rest
studiogadget
studiogadgetOFFICIAL
Explore all skills by this author →
WebsiteGitHub

playwright-scraper

Automate authenticated, paginated web scraping and file downloads with Python Playwright.

3|Updated Jan 29, 2026
Search Tags:#automation#playwright#download#login#pagination#web-scraping#selectors
One-click install
npx skills add https://github.com/studiogadget/skills --skill playwright-scraper-studiogadget
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: playwright-scraper
Source: https://github.com/studiogadget/skills/tree/main/.github/skills/playwright-scraper
Command: npx skills add https://github.com/studiogadget/skills --skill playwright-scraper-studiogadget

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, python-dotenv, beautifulsoup4, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables automated extraction of data from dynamic websites that require authentication, multi-page navigation, and file downloads, eliminating repetitive manual steps.

Core Features & Use Cases

  • Authentication-driven scraping: login, session maintenance, and restricted-page access to fetch protected data.
  • Pagination and data extraction: iterate through pages and collect structured results with robust error handling.
  • Reliable downloads and logging: manage file downloads (e.g., ZIPs) with deterministic completion and structured logs for auditing.
  • Guided setup with selector detection: includes a helper to detect common selectors from HTML sources to speed up integration.

Quick Start

Install dependencies with pip, set up environment variables for credentials, and run the basic scraper script with configured target URL and selectors.

Frequently Asked Questions about playwright-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use Playwright to scrape a website that requires a login?▼

To automate login-required web scraping with Playwright, you configure environment variables for credentials and run a modular workflow script that handles authentication, session maintenance, and restricted-page access deterministically.

How do I automate multi-file downloads with Playwright behind a login wall?▼

Automating multi-file downloads involves using a Python Playwright script to manage browser sessions and trigger downloads, ensuring deterministic completion of files like ZIP archives alongside structured logging for auditing.

What is the best way to handle pagination when web scraping dynamic pages?▼

Handling pagination during web scraping is achieved by iterating through paginated results with a Python Playwright script, which collects structured data and applies robust error handling across multiple pages.

Do I need BeautifulSoup4 alongside Playwright for web scraping?▼

BeautifulSoup4 is included as a dependency to support HTML parsing and structural extraction, complementing Playwright's browser automation capabilities for dynamic web scraping tasks.

How do I find the right CSS selectors for dynamic web scraping automation?▼

Finding the right selectors for web scraping is streamlined by using the included helper tool, which detects common selectors directly from HTML sources to speed up integration and script configuration.

Related Skills

Explore More Software Engineering Skills→
woohyun212woohyun212
21

dependency-audit

Scan project dependencies for known vulnerabilities using npm audit, pip-audit, and trivy.

Community
Intermediate
ericwang915ericwang915
38

web_scraper

Extract text, links, and headings from web pages into JSON.

Community
Intermediate
lycfyilycfyi
5

telegram-init

Validate Telegram API credentials, create sessions, and discover accessible groups.

Community
Intermediate
icyzhicyzh
1

scrapling

Scrape static and JavaScript-rendered web pages using stealth browser automation.

Community
Advanced