skills.rest
daanteijema-beep
daanteijema-beepCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-map

Discover and list website URLs with optional search filtering.

Updated Apr 6, 2026
Search Tags:#automation#documentation#firecrawl#web scraping#sitemap#site mapping#url discovery
One-click install
npx skills add https://github.com/daanteijema-beep/ai-gids-platform --skill firecrawl-map-daanteijema-beep
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-map
Source: https://github.com/daanteijema-beep/ai-gids-platform/tree/main/.agents/skills/firecrawl-map
Command: npx skills add https://github.com/daanteijema-beep/ai-gids-platform --skill firecrawl-map-daanteijema-beep

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

You need a reliable way to discover the exact URL(s) for a specific page on a large website without manually clicking through menus or guessing paths.

Core Features & Use Cases

  • Website URL discovery: Produces a list of pages found under a target site so you can identify the correct endpoint before scraping.
  • Search filtering: Narrows results using a query to quickly locate a relevant subpage (for example, pages related to authentication, billing, or pricing).
  • Flexible outputs: Supports JSON output and sitemap handling strategies so the results fit downstream workflows.
  • Use case example: You are preparing to scrape a documentation site but only know the topic, such as “authentication”; you first map the site with search filtering, then scrape the returned matching URLs.

Quick Start

Map the site starting from https://example.com, filter results for the term authentication, and write the matched URLs to .firecrawl/filtered.txt.

Frequently Asked Questions about firecrawl-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find all URLs on a website without manually clicking through menus?▼

Website URL discovery works by mapping a target site to produce a complete list of page URLs. This process enumerates all accessible pages, allowing you to identify exact endpoints for documentation discovery or pre-scrape workflows without guessing paths.

Can I filter discovered URLs by a specific search term like authentication?▼

Yes, search filtering narrows mapped URL results using a specific query. You can locate relevant subpages related to topics like authentication or billing by applying a search parameter, which returns only the matching URLs for your site mapping workflow.

What is the best way to prepare for scraping a large documentation site?▼

The best way to prepare for scraping documentation is to map the site first with search filtering. This pre-scrape URL enumeration discovers exact endpoints matching your topic, ensuring you scrape only the correct matching URLs instead of manually browsing the site.

Does Firecrawl site mapping support JSON output and sitemap strategies?▼

Yes, Firecrawl site mapping supports flexible JSON output and configurable sitemap handling strategies. These options ensure the discovered URL list integrates smoothly into downstream automation workflows, allowing you to write matched URLs to files for further processing.

Can I include subdomains when discovering URLs during site mapping?▼

Yes, you can include subdomains when discovering URLs during site mapping. By enabling the include-subdomains parameter, the mapping process extends beyond the primary target domain to enumerate pages across related subdomains for comprehensive URL discovery.

Related Skills

Explore More Software Engineering Skills→
while-basicwhile-basic

enact/firecrawl

Extract web page content as Markdown or structured data via the Firecrawl API.

Community
Advanced
abdullah1854abdullah1854
1

crawl-cli

Crawl websites and extract content into Markdown, JSON, or text.

Community
Basic
darblexdarblex

web-scraping

Fetch and extract web page data using Node.js fetch and regex parsing.

Community
Intermediate
vadirnvadirn
2

firecrawl-map

Map websites to retrieve all URLs or filter for specific pages.

Community
Basic