skills.rest
DaBugg
DaBuggCOMMUNITY
Explore all skills by this author →
GitHub

web-scraping

Extract structured data from dynamic websites into JSON or CSV.

1|Updated Jan 26, 2026
Search Tags:#automation#data#extraction#web#scrape#selectors
One-click install
npx skills add https://github.com/DaBugg/Claude-Agents-Orchestration --skill web-scraping-dabugg
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraping
Source: https://github.com/DaBugg/Claude-Agents-Orchestration/tree/main/skills-builder/skills/web-scraping
Command: npx skills add https://github.com/DaBugg/Claude-Agents-Orchestration --skill web-scraping-dabugg

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Extracts structured data from dynamic websites and pages, turning unstructured HTML into usable data without manual copying.

Core Features & Use Cases

  • Browser-based data extraction from live pages, including handling JS-rendered content and pagination.
  • Define data points with selectors to collect titles, prices, links, and other fields across multiple pages.
  • Auto-activation on requests to scrape, crawl, or extract data from URLs for research, monitoring, or competitive analysis.
  • Returns clean JSON or CSV ready data for downstream analytics.

Quick Start

Tell me the target URL and the fields to extract, and I will perform a browser-based scrape to return structured results.

Frequently Asked Questions about web-scraping

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract data from a dynamic website that requires JavaScript rendering?▼

To extract data from a dynamic website, this Skill uses browser automation to render JavaScript content and apply robust selector strategies, returning structured data from live pages without manual copying.

What is the best way to scrape product listings across multiple pages?▼

The best way to scrape multi-page product listings is through automated pagination handling, which iterates through results using defined selectors to extract titles, prices, and links into structured JSON output.

How do I turn unstructured HTML into clean JSON or CSV data?▼

To turn unstructured HTML into clean JSON or CSV data, define specific data points using selectors and the extraction process will automatically parse the targeted fields for downstream analytics.

Can I extract data from directories and news pages without manual copying?▼

Yes, you can extract data from directories and news pages by providing the target URL and desired fields, which triggers an automated browser-based scrape to collect the structured information.

Do I need to define selectors to scrape specific fields like titles and prices?▼

Yes, you need to define selectors to scrape specific fields like titles and prices, which guides the extraction logic to accurately collect the exact data points you need from the HTML structure.

Related Skills

Explore More Data & Analytics Skills→
robit-manrobit-man

doc-scraper

Scrape documentation websites into categorized Markdown reference files.

Community
Advanced
apifyapify
2.3k

apify-ultimate-scraper

Select the best Apify Actor and extract web data as JSON or CSV.

Official
Intermediate
overviewlabsoverviewlabs

scrapling

Extract data from static and JS-rendered web pages via Scrapling.

Community
Advanced
devMoezdevMoez
1

scrapling

Extract HTML and rendered content from static and JavaScript-driven pages.

Community
Intermediate