skills.rest
jackandking
jackandkingCOMMUNITY
Explore all skills by this author →
GitHub

web-scraper-playwright

Scrape websites with Playwright using session persistence, stealth mode, and error recovery.

Updated Sep 27, 2025
Search Tags:#automation#data extraction#session management#web scraping#playwright#stealth mode
One-click install
npx skills add https://github.com/jackandking/LetMeTryAI --skill web-scraper-playwright
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraper-playwright
Source: https://github.com/jackandking/LetMeTryAI/tree/main/.agents/skills/web-scraper-playwright
Command: npx skills add https://github.com/jackandking/LetMeTryAI --skill web-scraper-playwright

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a robust foundation for web scraping by handling complex scenarios like login persistence, anti-detection measures, and automatic error recovery, making browser automation reliable.

Core Features & Use Cases

  • Session Persistence: Maintains login states across scraping sessions using stored authentication data.
  • Stealth Mode: Employs techniques to evade detection by websites, ensuring smoother scraping.
  • Error Recovery: Implements retry mechanisms and JavaScript injection for handling unstable elements or timeouts.
  • Use Case: Automate the extraction of product details from an e-commerce site that requires user login and employs anti-bot measures.

Quick Start

Use the web-scraper-playwright skill to scrape the provided URL, automatically handling logins and retrying on errors.

Frequently Asked Questions about web-scraper-playwright

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I maintain login state across multiple web scraping sessions with Playwright?▼

To maintain login state during web scraping, you can use session persistence to store authentication data. This allows the browser to reuse saved login credentials across subsequent scraping sessions without re-authenticating.

How do I scrape a website that uses anti-bot detection measures?▼

You can scrape websites with anti-bot detection by using stealth mode. This technique helps your Playwright automation evade detection mechanisms, ensuring smoother and more reliable data extraction.

How do I handle unstable elements and timeouts when automating browser data extraction?▼

To handle unstable elements during data extraction, use error recovery mechanisms like automatic retries and JavaScript injection. These features help manage timeouts and ensure resilient browser automation.

Can I configure headless operation and timeouts via environment variables for web scraping?▼

Yes, you can configure headless operation and timeout settings using environment variables. This allows you to customize the web scraping behavior without modifying the core automation scripts.

What is the best way to scrape product details from e-commerce sites requiring login and anti-bot bypass?▼

The best way to scrape such e-commerce sites is using a resilient web scraping foundation that combines session persistence for logins, stealth mode for anti-bot evasion, and error recovery for reliable data extraction.

Related Skills

Explore More Software Engineering Skills→
jusjinukjusjinuk
1

onboard

Configure Slack tokens, environment files, and repository hooks for internbot deployment.

Community
Intermediate
Sonder4Sonder4
27

bfd-fault-logger

Record and classify STM32 hardware faults into structured reports.

Community
Advanced
abdullah1854abdullah1854
1

chrome-data-extract

Generate JavaScript snippets to extract structured data from HTML tables, forms, and lists.

Community
Intermediate
gyuhagyuha
2

scrapling-official

Scrape and crawl websites with HTTP requests, browser automation, and anti-bot bypass.

Community
Advanced