skills.rest
ZJU-REAL
ZJU-REALOFFICIAL
Explore all skills by this author →
GitHub

firecrawl-map

Discover and filter website URLs using the Firecrawl command-line interface.

195|12|Updated Jul 19, 2026
Search Tags:#web search#firecrawl#site structure#documentation discovery#url discovery#website mapping
One-click install
npx skills add https://github.com/ZJU-REAL/HugAgentOS --skill firecrawl-map-zju-real
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-map
Source: https://github.com/ZJU-REAL/HugAgentOS/tree/main/src/backend/plugin_bundles/marketplace/firecrawl/skills/map
Command: npx skills add https://github.com/ZJU-REAL/HugAgentOS --skill firecrawl-map-zju-real

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps users locate specific pages and understand the URL structure of large websites without manually navigating every page.

Core Features & Use Cases

  • Website URL Discovery: List URLs found across a website for site structure analysis.
  • Filtered Page Search: Search discovered URLs for a specific topic, feature, or document.
  • Use Case: Find the authentication documentation on a large company website, then use the resulting URL for further research or scraping.

Quick Start

Use the firecrawl map skill to find all pages related to authentication on the specified website.

Frequently Asked Questions about firecrawl-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I discover all URLs across a large website for site structure analysis?▼

Website URL discovery maps all pages across a target domain to reveal its structure. You can use the Firecrawl command-line interface to list discovered URLs and export the results as JSON or a file for analysis.

What is the best way to find specific documentation pages on a large company website?▼

Filtered page search locates specific documents by scanning discovered URLs for a target topic. Using Firecrawl, you can search and filter website maps to pinpoint exact pages like authentication documentation without manual navigation.

Does the Firecrawl URL mapping tool support subdomain inclusion and sitemap handling?▼

Firecrawl URL mapping supports subdomain inclusion and sitemap handling for comprehensive domain navigation. It requires the Firecrawl command-line interface to map URLs, filter search results, and export the output to JSON or a file.

Can I export discovered website URLs to a JSON file for pre-scraping research?▼

Yes, you can export discovered URLs to JSON or a file during website mapping. This allows you to save the site structure and target specific pages for further research or scraping workflows.

How do I filter discovered URLs by a specific topic or feature?▼

You can filter discovered URLs by providing a search term to the Firecrawl mapping tool. It scans the website's mapped pages and returns only the URLs relevant to your specified topic, feature, or document.

When should I use a website mapping tool instead of manually navigating a site?▼

Website mapping is necessary for large-domain navigation and pre-scraping research where manual browsing is inefficient. It quickly discovers and filters URLs to locate relevant pages, overcoming the limitation of navigating complex site structures manually.

Related Skills

Explore More Software Engineering Skills→
daanteijema-beepdaanteijema-beep

firecrawl-map

Discover and list website URLs with optional search filtering.

Community
Basic
farzanmrzfarzanmrz

search

Retrieve SERP results and intent-ranked discovery results for keyword queries.

Community
Intermediate
saschadudkin-sketchsaschadudkin-sketch

seo

Optimize website SEO using Lighthouse audits and Google Search guidelines.

Community
Advanced
vadirnvadirn
2

firecrawl-map

Map websites to retrieve all URLs or filter for specific pages.

Community
Basic