web-extract

Extract structured JSON data from web pages and sites via six endpoints.

61|9|Updated Mar 13, 2026
One-click install
npx skills add https://github.com/SerendipityOneInc/ZooData-Skills --skill web-extract-serendipityoneinc
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-extract
Source: https://github.com/SerendipityOneInc/ZooData-Skills/tree/main/web-extract
Command: npx skills add https://github.com/SerendipityOneInc/ZooData-Skills --skill web-extract-serendipityoneinc

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Extracting structured, usable data from web pages, search engines, and full websites typically requires multiple separate tools, manual HTML/markdown parsing, and extra LLM passes to turn raw content into organized fields. JavaScript-rendered pages, filtered site crawls, and search results with full content are especially time-consuming to gather and structure manually.

Core Features & Use Cases

This skill provides six endpoints to cover all common web data extraction needs: scrape single URLs (static or JS-rendered with interactive actions), run Google searches with optional deep-scraping of results, map all URLs on a domain, and run asynchronous recursive crawls of entire sites. All calls return structured JSON by default with fields like title, summary, sections, key metrics, outgoing links, author, date, and page type, eliminating the need for post-scrape parsing. It is ideal for tasks like gathering product specs and pricing, extracting article metadata, building link graphs, scraping JS-heavy SPAs, researching competitor pages, and pulling full text from documentation sites.

Quick Start

Use the web-extract skill to pull structured JSON data from https://example.com including its title, summary, key sections, and outgoing links.

Frequently Asked Questions about web-extract

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from web pages without parsing raw HTML?

Structured data extraction from web pages without parsing raw HTML is done via a single API call that returns ready-to-consume JSON fields like title, summary, sections, key metrics, and outgoing links. This eliminates the need for a second LLM pass to parse markdown or raw HTML.

Can I scrape JavaScript-rendered pages and interact with SPAs?

Yes, you can scrape JavaScript-rendered pages and interact with SPAs. The extraction process supports interactive actions via click, scroll, and write operations to fully render and capture dynamic content before returning the structured JSON output.

What is the best way to crawl an entire website and filter URLs by path depth?

The best way to crawl an entire website with path depth filters is using asynchronous recursive crawling. This method discovers domain URLs and systematically extracts structured JSON data across the site while applying depth and path filters to control the scope of the crawl.

Do I need an API key to perform Google SERP searches with deep scraping?

Yes, you need a valid ZOODATA_API_KEY credential to perform Google SERP searches with deep scraping. This key is required to authenticate all API calls, including single URL scraping, domain URL discovery, and asynchronous recursive site crawling.

Does web scraping with this method return article metadata like author and date?

Web scraping with this method returns article metadata including author, date, and page type by default. The structured JSON output automatically extracts these specific fields alongside the page title, summary, key sections, and outgoing links.

Why does my structured data extraction require a second LLM pass to clean markdown?

Structured data extraction requiring a second LLM pass happens when using basic scrapers that return raw markdown or HTML. Using a dedicated extraction API returns default structured JSON fields directly, eliminating the need for post-scrape parsing and extra LLM passes.