skills.rest
clombion
clombionCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

webscraper-sitemap

Generate WebScraper.io sitemap JSON files for structured data extraction.

Updated Feb 25, 2026
Search Tags:#automation#workflow#validation#web scraping#sitemap#data-extraction#webscraper
One-click install
npx skills add https://github.com/clombion/ijba-datalab-2026 --skill webscraper-sitemap
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: webscraper-sitemap
Source: https://github.com/clombion/ijba-datalab-2026/tree/main/content/handouts/webscraper-sitemap
Command: npx skills add https://github.com/clombion/ijba-datalab-2026 --skill webscraper-sitemap

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires typer, rich, jsonschema, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill helps users generate valid WebScraper.io sitemap JSON files by inspecting target websites, identifying the data to extract, and producing a ready-to-import sitemap that guides automated web scraping tasks.

Core Features & Use Cases

  • Sitemap generation: translate site structure and extraction goals into WebScraper.io selectors and pages.
  • Validation: verify sitemap against the WebScraper.io schema using the included tooling (references/sitemap.schema.json and scripts/validate_schema.py) to ensure correctness before export.
  • End-to-end workflow: define goal, inspect site, plan scraping, generate sitemap, and deliver a ready-to-use JSON file.

Quick Start

Describe your target URL and data to extract, and I will generate a valid WebScraper.io sitemap JSON you can import.

Frequently Asked Questions about webscraper-sitemap

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a WebScraper.io sitemap JSON for structured data extraction?▼

You generate a WebScraper.io sitemap JSON by describing your target URL and the data to extract. The skill inspects the site structure and produces a ready-to-import sitemap JSON file with the appropriate selectors.

Can I validate my WebScraper.io sitemap JSON before importing it?▼

Yes, you can validate your WebScraper.io sitemap JSON using the included validation script and schema. The skill provides scripts/validate_schema.py and references/sitemap.schema.json to verify correctness against the expected structure.

Does this sitemap generator support paginated lists and detail pages?▼

Yes, the sitemap generator supports paginated lists and detail pages. It translates site structures and extraction goals into WebScraper.io selectors and pages for comprehensive web data collection.

How do I handle URL ranges in startUrl for web scraping sitemaps?▼

You handle URL ranges in startUrl by specifying them in your target URL description. The generated WebScraper.io sitemap JSON supports URL ranges within the startUrl field for broader data collection.

What do I need to provide to create a ready-to-use web scraping sitemap?▼

You need to provide a target URL and a description of the data you want to extract. The skill then inspects the target website, identifies the extraction data, and generates a valid WebScraper.io sitemap JSON.

Related Skills

Explore More Data & Analytics Skills→
rjit1rjit1
1

seo-sitemap

Validate XML sitemaps and generate corrected sitemap structures.

Community
Intermediate
Magnatrix-LabMagnatrix-Lab
1

competitive-ads-extractor

Extract competitor ad insights via web scraping and structured data processing.

Community
Advanced
AMGrobelnikAMGrobelnik
1

json

Validate JSON files against predefined schemas and generate full, mini, and preview outputs.

Community
Intermediate
MinhDuyDEVMinhDuyDEV

webclaw

Extract structured web content from protected or complex sites via the webclaw MCP server.

Community
Advanced