skills.rest
r1cA18
r1cA18COMMUNITY
Explore all skills by this author →
GitHub

firecrawl-map

Discover and list all URLs on a website with keyword filters and JSON output.

4|Updated Nov 22, 2025
Search Tags:#content discovery#web scraping#site structure#url discovery#website mapping
One-click install
npx skills add https://github.com/r1cA18/dotfiles --skill firecrawl-map-r1ca18
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-map
Source: https://github.com/r1cA18/dotfiles/tree/main/skills/firecrawl-map
Command: npx skills add https://github.com/r1cA18/dotfiles --skill firecrawl-map-r1ca18

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps you discover and list all URLs on a given website, making it easier to understand a site's structure or find specific pages.

Core Features & Use Cases

  • URL Discovery: List all accessible URLs on a website.
  • Targeted Search: Filter URLs based on specific keywords.
  • Site Mapping: Understand the layout and content of a website before deeper analysis.
  • Use Case: When a user asks "What pages are on example.com?" or "Find the URL for the pricing page on example.com", this skill is essential.

Quick Start

Use the firecrawl map skill to find all URLs on example.com and save them to a file.

Frequently Asked Questions about firecrawl-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Does website mapping support JSON output for saving discovered site links?▼

Yes, website mapping supports JSON output for saving discovered site links. You can redirect the processed URL data to a file, making it easy to store the site structure for later analysis or scraping preparation.

How do I discover all URLs on a website to understand its site structure?▼

Website mapping discovers and lists all accessible URLs on a target site to reveal its structure. This process helps you understand the layout and find specific pages before deeper analysis or bulk scraping operations.

Can I filter discovered URLs by specific keywords during website mapping?▼

Yes, website mapping supports targeted search to filter discovered URLs based on specific keywords. This allows you to isolate relevant pages, such as locating a pricing page, without manually reviewing the entire site structure.

What is the best way to prepare for bulk web scraping operations?▼

The best way to prepare for bulk web scraping is using site mapping to discover all target URLs first. This identifies accessible pages and outputs the processed data as JSON, ready for file redirection and downstream scraping operations.

How does URL discovery handle sitemaps when listing website pages?▼

URL discovery handles sitemaps by processing them to extract and list all accessible URLs on a website. This handles the site's structural layout efficiently, ensuring comprehensive page discovery for subsequent crawling tasks.

Does website mapping support JSON output for saving discovered site links?▼

Yes, website mapping supports JSON output for saving discovered site links. You can redirect the processed URL data to a file, making it easy to store the site structure for later analysis or scraping preparation.

Related Skills

Explore More Software Engineering Skills→
daanteijema-beepdaanteijema-beep

firecrawl-map

Discover and list website URLs with optional search filtering.

Community
Basic
while-basicwhile-basic

enact/firecrawl

Extract web page content as Markdown or structured data via the Firecrawl API.

Community
Advanced
xberg-ioxberg-io
26

extracting-tables

Extract HTML tables and convert them to Markdown and structured JSON.

Official
Intermediate
fabricioctellesfabricioctelles
47

agent-ready-sitemap

Implement and validate a standards-compliant XML sitemap with robots.txt reference.

Community
Basic