skills.rest
manushi4
manushi4COMMUNITY
Explore all skills by this author →
GitHub

scrape-web

Navigate websites and extract structured data into JSON.

11|2|Updated Mar 5, 2026
Search Tags:#structured data#data extraction#browser automation#web scraping#pagination#infinite scroll#login walls
One-click install
npx skills add https://github.com/manushi4/Screenhand --skill scrape-web
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-web
Source: https://github.com/manushi4/Screenhand/tree/main/.claude/plugins/screenhand/skills/scrape-web
Command: npx skills add https://github.com/manushi4/Screenhand --skill scrape-web

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates extracting structured data from websites, turning manual browsing into fast, repeatable data collection.

Core Features & Use Cases

  • Structured data extraction: pull tables, lists, product cards, articles, and search results into JSON.
  • Robust navigation: handle pagination, infinite scroll, and login walls to reach all data.
  • Context-aware guidance: use pre-flight checks and memory of past runs to optimize scraping strategies.

Quick Start

Instruct the AI to scrape a target site and return structured data in JSON.

Frequently Asked Questions about scrape-web

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from websites into JSON?▼

You extract structured data by automating browser navigation to collect items like tables, product grids, and articles into clean JSON outputs.

Can web scraping handle infinite scroll and login walls?▼

Yes, browser automation handles infinite scroll and login walls by navigating dynamic content and authentication barriers to reach target data.

What is the best way to scrape product grids across multiple pages?▼

Using browser automation with pagination support navigates sequential pages and collects product items into structured JSON while respecting site rate limits.

Does automated web scraping respect rate limits and anti-scraping defenses?▼

Automated scraping respects rate limits and anti-scraping defenses by applying pre-flight checks and leveraging past run memory to optimize extraction strategies without triggering blocks.

Why does my web scraper fail to collect items from dynamic content?▼

Scrapers fail on dynamic content when lacking browser automation to render JavaScript or handle pagination, solved here via pre-flight checks and dynamic-content navigation.

Related Skills

Explore More Data & Analytics Skills→
framerslabframerslab

web-scraper

Automate web scraping by navigating URLs and extracting structured data.

Official
Advanced
DavidROliverBADavidROliverBA
49

csv-to-sql

Convert CSV files into indexed SQLite databases for SQL querying.

Community
Intermediate
jiyangnanjiyangnan
2

web-access

Automate web navigation and data extraction via Chrome DevTools Protocol.

Community
Advanced
FutureAtomsFutureAtoms
1

vercel-browser-scraping

Extract structured data from websites with pagination and anti-detection handling.

Community
Advanced