skills.rest
aryaniyaps
aryaniyapsCOMMUNITY
Explore all skills by this author →
Website𝕏@aryaniyapsGitHub

firecrawl-map

Discover all website URLs and structure using firecrawl CLI tools.

26|2|Updated Apr 23, 2026
Search Tags:#firecrawl#website#mapping#site analysis#URL#crawling
One-click install
npx skills add https://github.com/aryaniyaps/ultimate-pi --skill firecrawl-map-aryaniyaps
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-map
Source: https://github.com/aryaniyaps/ultimate-pi/tree/main/.agents/skills/firecrawl-map
Command: npx skills add https://github.com/aryaniyaps/ultimate-pi --skill firecrawl-map-aryaniyaps

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps users locate and compile all URLs on a website, facilitating site mapping, content analysis, and targeted crawling.

Core Features & Use Cases

  • Website URL Discovery: Identify all linked pages within a domain or subdomain, including filtering by search terms.
  • Site Structure Visualization: Generate comprehensive lists of site pages to aid in planning web scraping or SEO audits.
  • Use Case: When needing to map a large website to identify key pages for SEO optimization or content updates, simply use this Skill to retrieve all URLs or locate specific pages matching keywords.

Quick Start

Find all URLs on a website by running firecrawl map "<website_url>" --limit 1000 --json -o output.json.

Frequently Asked Questions about firecrawl-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I discover all URLs on a website for an SEO audit?▼

Website URL discovery identifies all linked pages within a domain or subdomain to facilitate site mapping and SEO audits. It compiles a comprehensive list of site pages, allowing you to filter by search terms and locate specific content for targeted optimization.

What is the best way to map site structure for targeted crawling?▼

Mapping site structure for targeted crawling involves scanning the domain to generate a comprehensive list of all site pages. Outputting the resulting data in JSON format allows for easy analysis and precise planning of subsequent web scraping tasks.

Can I filter website URLs by search terms during site mapping?▼

Yes, you can filter website URLs by search terms during site mapping to locate specific pages matching your keywords. This targets key pages on large websites for content updates or SEO optimization without retrieving irrelevant data.

How do I output crawled website URLs in JSON format?▼

You can output crawled website URLs in JSON format by running the firecrawl map command with the --json flag. Specifying an output file exports the discovered site structure data into an easily parsable JSON format for analysis.

Does firecrawl-map support URL discovery for large websites?▼

Yes, firecrawl-map supports URL discovery for large websites by allowing you to set a high limit on the number of pages scanned. This facilitates comprehensive site mapping to identify key pages across extensive domains during SEO audits.

Related Skills

Explore More Software Engineering Skills→
REVREBELREVREBEL

seo-firecrawl

Crawl, scrape, and map full websites for SEO analysis via Firecrawl MCP.

Official
Advanced
refly-airefly-ai
199

jina

Extract content from URLs and perform site-specific searches with Jina.

Official
Intermediate
mofa-orgmofa-org
11

mofa-firecrawl

Crawl websites with Firecrawl CLI and generate analysis reports.

Official
Advanced
silva2kandsilva2kand

site-mapper

Crawl websites and generate hierarchical site maps with page summaries.

Community
Intermediate