skills.rest
LeeJuOh
LeeJuOhCOMMUNITY
Explore all skills by this author →
GitHub

fetch-sitemap

Extract URLs from XML sitemaps with regex filtering and automatic discovery.

51|5|Updated Jan 25, 2026
Search Tags:#web scraping#sitemap#extraction#seo#robots.txt#urls
One-click install
npx skills add https://github.com/LeeJuOh/claude-code-zero --skill fetch-sitemap
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: fetch-sitemap
Source: https://github.com/LeeJuOh/claude-code-zero/tree/main/plugins/toolbox/skills/fetch-sitemap
Command: npx skills add https://github.com/LeeJuOh/claude-code-zero --skill fetch-sitemap

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the process of extracting URLs from XML sitemaps, saving users from manually parsing these files or writing custom scripts.

Core Features & Use Cases

  • Sitemap URL Extraction: Directly fetches and parses sitemap XML files to list all contained URLs.
  • Automatic Discovery: Intelligently finds the sitemap URL even if not directly provided, by probing common locations and robots.txt.
  • Pattern Filtering: Allows users to filter the extracted URLs using a regular expression pattern.
  • Use Case: Quickly get a list of all pages on a website for SEO analysis or content inventory by providing the website's base URL.

Quick Start

Use the fetch-sitemap skill to extract all URLs from the sitemap located at https://example.com/sitemap.xml.

Frequently Asked Questions about fetch-sitemap

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract URLs from an XML sitemap for SEO analysis?▼

You can extract URLs from XML sitemaps by providing the sitemap URL to an automated parsing tool, which fetches the file and lists all contained website pages for SEO analysis or content inventory.

Can I automatically discover a sitemap URL from robots.txt if I only have the website base URL?▼

Automatic sitemap discovery intelligently probes common site-root locations and parses robots.txt to find the sitemap URL, even when you only provide the website's base URL.

How do I filter extracted sitemap URLs using a regex pattern?▼

Filtering extracted sitemap URLs by a provided regular expression pattern ensures the returned list only includes website pages matching your specific regex filtering criteria.

What is the best way to get a complete list of website pages without writing a custom XML parsing script?▼

Using an automated extraction tool that handles direct sitemap URLs, path-specific sitemaps, and sitemaps listed in robots.txt is the best way to get a complete list of website pages without writing custom scripts.

Does sitemap URL extraction work with path-specific sitemaps or only site-root sitemaps?▼

Sitemap URL extraction works with both site-root sitemaps and path-specific sitemaps, automatically handling direct sitemap URLs and sitemaps listed in robots.txt to extract all contained URLs.

Related Skills

Explore More Software Engineering Skills→
rjit1rjit1
1

seo-sitemap

Validate XML sitemaps and generate corrected sitemap structures.

Community
Intermediate
while-basicwhile-basic

enact/firecrawl

Extract web page content as Markdown or structured data via the Firecrawl API.

Community
Advanced
deomiarndeomiarn
5

website-builder

Generate a Markdown sitemap with page structure and pnpm commands.

Community
Advanced
LongTermSupportLongTermSupport

phpunit-fixer

Parse PHPUnit JUnit XML logs to identify and fix failing tests.

Official
Intermediate