skills.rest
HuynhSang2005
HuynhSang2005COMMUNITY
Explore all skills by this author →
GitHub

tavily-map

List all URLs on a website using the Tavily CLI.

Updated Aug 23, 2026
Search Tags:#cli#tavily#json-output#url-mapping#site-discovery#web-structure
One-click install
npx skills add https://github.com/HuynhSang2005/delivery-app --skill tavily-map
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: tavily-map
Source: https://github.com/HuynhSang2005/delivery-app/tree/main/.agents/skills/tavily-map
Command: npx skills add https://github.com/HuynhSang2005/delivery-app --skill tavily-map

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Discover and list all URLs on a website without extracting page content, enabling faster site understanding and planning for extraction or crawling tasks.

Core Features & Use Cases

  • Quickly enumerate all pages to map site structure.
  • Locate specific pages or understand where content lives on a domain.
  • Use as a planning step before targeted extraction or crawling.

Quick Start

Run tvly map on a site to obtain a JSON list of URLs.

Frequently Asked Questions about tavily-map

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I list all URLs on a website without extracting page content?▼

You can discover and list all URLs on a website without extracting page content by running a site mapping command that quickly enumerates pages and outputs a JSON list of the site structure.

What is the best way to map site structure for large websites before crawling?▼

Mapping site structure for large websites is best done by discovering URL locations without fetching content, enabling a quick view of pages to plan subsequent extraction or crawling steps.

Do I need the Tavily CLI installed to output a JSON list of site URLs?▼

Yes, you need the Tavily CLI installed to discover site URLs and generate a JSON output, as this site mapping process relies on the CLI to enumerate pages and map the web structure.

Can I exclude specific paths or limit depth when discovering URLs on a domain?▼

You can limit depth or exclude specific paths during URL discovery by using supported options like --max-depth and --exclude-paths, ensuring you only map the targeted site structure you need.

How does URL mapping without content extraction speed up site analysis?▼

URL mapping without content extraction speeds up site analysis by skipping heavy page payloads, allowing you to quickly locate specific pages and understand where content lives on a domain.

When should I not use a URL mapping tool for web discovery?▼

You should not use a URL mapping tool without content extraction when your goal is to scrape page text or analyze HTML elements, as it only returns URLs and does not fetch page content.

Related Skills

Explore More Software Engineering Skills→
robomotioniorobomotionio
2

tavily

Automate web search, content extraction, and site mapping with Tavily.

Official
Advanced
BEIRUXBEIRUX

tavily-cli

Perform LLM-optimized web search and content extraction with JSON output.

Official
Intermediate
pedronauckpedronauck
567

firecrawl

Scrape URLs, search the web, and automate browsers via the Firecrawl CLI.

Community
Advanced
olostepolostep

batch

Scrape up to 10,000 URLs in parallel with configurable output formats.

Community
Intermediate