skills.rest
xberg-io
xberg-ioOFFICIAL
Explore all skills by this author →
Website𝕏@kreuzberg_devGitHub

mapping-urls

Parse sitemaps and extract links from HTML with custom filters and output formats.

26|2|Updated Jun 8, 2026
Search Tags:#web crawling#link extraction#url mapping#sitemap analysis#url filtering
One-click install
npx skills add https://github.com/xberg-io/plugins --skill mapping-urls
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: mapping-urls
Source: https://github.com/xberg-io/plugins/tree/main/plugins/crawlberg/.cursor-plugin/skills/mapping-urls
Command: npx skills add https://github.com/xberg-io/plugins --skill mapping-urls

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill allows users to quickly and efficiently map URLs from a site, providing an ideal solution for sitemap analysis, link planning, and seeding other tools.

Core Features & Use Cases

  • Sitemap Analysis: Automatically parse sitemap.xml for site structure and link discovery.
  • Link Extraction: Extract links from the seed page for additional coverage.
  • Custom Filtering: Filter URLs by substring using the --search flag.
  • Output Options: Output in either json or markdown format.
  • Use Case: Need to find all URLs related to 'docs' on a website for further crawling or scraping. Use this Skill to generate a list of URLs in markdown format.

Quick Start

Map the URLs of a website with the crawlberg map command followed by the desired URL and options.

Frequently Asked Questions about mapping-urls

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract all URLs from a sitemap for site auditing?▼

You can extract URLs from a sitemap by automatically parsing `sitemap.xml` to discover site structure and links. This provides an ideal list of URLs for link planning, site auditing, and seeding other crawling tools.

What is the best way to filter URLs by substring during link extraction?▼

The best way to filter URLs by substring during link extraction is to use a custom search filter flag. This allows you to specify a substring, ensuring the output only contains relevant URLs for your crawling or scraping needs.

How do I map website URLs and output the results in markdown format?▼

You map website URLs and output the results in markdown format by executing a URL mapping command with a markdown output flag. This parses sitemaps and extracts links, generating a formatted list for documentation or link planning.

Does this URL mapping approach work for seeding other web crawling tools?▼

Yes, this URL mapping approach works for seeding other web crawling tools by extracting links from seed pages and parsing sitemaps. It generates a comprehensive list of target URLs that can be directly passed to downstream scraping utilities.

Can I extract links directly from HTML pages instead of just parsing sitemaps?▼

Yes, you can extract links directly from HTML pages instead of just parsing sitemaps. The tool extracts links from the seed page to provide additional URL coverage beyond what is listed in the standard `sitemap.xml` file.

Related Skills

Explore More Software Engineering Skills→
olostepolostep

map

Discover and list all URLs on a website with keyword and pattern filtering.

Community
Intermediate
while-basicwhile-basic

enact/firecrawl

Extract web page content as Markdown or structured data via the Firecrawl API.

Community
Advanced
darblexdarblex

web-scraping

Fetch and extract web page data using Node.js fetch and regex parsing.

Community
Intermediate
vadirnvadirn
2

firecrawl-map

Map websites to retrieve all URLs or filter for specific pages.

Community
Basic