firecrawl-map

Discover and list all URLs on a website using the Firecrawl CLI.

Updated Jul 16, 2026
One-click install
npx skills add https://github.com/The-Focus-AI/walking-thoughts --skill firecrawl-map-the-focus-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: firecrawl-map
Source: https://github.com/The-Focus-AI/walking-thoughts/tree/main/.agents/skills/firecrawl-map
Command: npx skills add https://github.com/The-Focus-AI/walking-thoughts --skill firecrawl-map-the-focus-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When you know which website contains the information you need but not which exact page, manually browsing a large site is slow and unreliable. This Skill maps an entire domain to enumerate its URLs, optionally filtering them with a search query, so you can locate the right page before scraping or crawling. ## Core Features & Use Cases - Full URL Discovery: List all URLs on a site with configurable limits, sitemap handling, and subdomain inclusion. - Search Filtering: Use the --search option to find a specific page (e.g., an authentication docs page) within a large site. - Structured Output: Export results as JSON or plain text to a file for downstream scraping or crawling workflows. - Use Case: Run firecrawl map https://docs.example.com --search "auth" to find /docs/api/authentication, then scrape that exact URL instead of crawling the whole site. ## Quick Start Ask the AI to map a website and find the URL for a specific topic, for example: map https://docs.example.com and find the page about authentication.

Frequently Asked Questions about firecrawl-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find a specific page on a large website?

Use firecrawl map with the --search option to filter a site's URLs by a query, for example: firecrawl map "<url>" --search "authentication". This returns only matching pages so you can scrape the exact URL you need.

How to list all URLs on a website with Firecrawl?

Run firecrawl map "<url>" --limit 500 --json -o urls.json to enumerate the site's URLs and save them as JSON. Adjust --limit to control the maximum number of URLs returned.

What is the difference between firecrawl map, scrape, and crawl?

Map discovers URLs on a site without extracting content, scrape extracts content from a single known URL, and crawl bulk-extracts content across many pages. A common pattern is map to find the URL, then scrape it.

Can firecrawl map include subdomains in results?

Yes, pass the --include-subdomains flag to include subdomain URLs in the map output. Without it, results are limited to the primary domain of the target URL.

When should I use crawl instead of map?

Use crawl when you need the actual page content from many URLs in bulk rather than just a list of links. Map only discovers URLs; combine it with scrape when you need content from a few specific pages.