web-scraper

Name: web-scraper
Availability: InStock
Author: programadorbrasil

Extract structured data from web pages into Markdown, JSON, or CSV.

Updated Aug 23, 2026

Search Tags:#automation #pagination #data-extraction #web-scraping #open-graph #transform #json-ld

Ready to run

npx skills add https://github.com/ProgramadorBrasil/antigravity-skills --skill web-scraper-programadorbrasil

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: web-scraper
Source: https://github.com/ProgramadorBrasil/antigravity-skills/tree/main/skills/web-scraper
Command: npx skills add https://github.com/ProgramadorBrasil/antigravity-skills --skill web-scraper-programadorbrasil

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Web data is scattered across multiple pages and formats; this Skill provides a robust, multi-strategy framework to fetch, parse, and normalize web data into structured outputs.

Core Features & Use Cases

Multi-strategy extraction combines static WebFetch, browser automation for JS-heavy pages, and API-like endpoints to extract data from diverse sites.
Pagination and multi-URL support to follow pages and compare data across sources.
Structured outputs with transforms including JSON-LD extraction, URL resolution, and data normalization for downstream analytics.
Use Case: Gather product listings from several retailer sites and export a unified catalog.

Quick Start

Provide a target URL and data targets, and I will fetch, extract, transform, and format the results.

Frequently Asked Questions about web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract structured data from web pages that require JavaScript rendering?▼

To extract data from JavaScript-rendered web pages, this scraping framework applies browser automation alongside static page analysis and API-like endpoints, ensuring dynamic content is captured into structured outputs. It handles JS-heavy pages through its multi-strategy extraction workflow.

Can I scrape multiple web pages and follow pagination automatically?▼

Yes, web scraping with pagination is fully supported. You can target multiple URLs and the framework will automatically follow pagination links across pages, normalizing the extracted data into a unified Markdown table, JSON, or CSV format.

What is the best way to extract JSON-LD and Open Graph data from websites?▼

The best way to extract JSON-LD and Open Graph data is using a targeted scraping workflow that checks for these specific structured data formats during the extraction phase. It automatically parses and normalizes this metadata into clean JSON or CSV outputs.

How do I turn web page content into clean JSON or CSV files?▼

To turn web pages into clean JSON or CSV files, provide a target URL and data targets. The framework fetches, extracts, and transforms the raw web data through a structured validation phase, outputting normalized tables ready for downstream analytics.

Does web scraping handle rate limiting and errors when fetching multiple URLs?▼

Yes, automated web scraping includes built-in error handling and rate limiting. When fetching data across multiple URLs or pages, the framework manages request pacing and error recovery to prevent blocks and ensure continuous data extraction.