skills.rest
daanteijema-beep
daanteijema-beepCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-download

Download entire websites into local .firecrawl directories using firecrawl map and scrape.

Updated Apr 6, 2026
Search Tags:#screenshots#firecrawl#web scraping#website download#offline documentation#site mirroring
One-click install
npx skills add https://github.com/daanteijema-beep/ai-gids-platform --skill firecrawl-download-daanteijema-beep
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-download
Source: https://github.com/daanteijema-beep/ai-gids-platform/tree/main/.agents/skills/firecrawl-download
Command: npx skills add https://github.com/daanteijema-beep/ai-gids-platform --skill firecrawl-download-daanteijema-beep

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It solves the problem of manually copying pages from a website by automatically downloading a whole site into organized local files for offline reference.

Core Features & Use Cases

  • Site mapping to discover URLs before downloading, so you capture all relevant pages in one run.
  • Bulk scraping into local directories with options like markdown output and screenshots, suitable for documentation and research workflows.
  • Filtering and control for targeted downloads, including include/exclude path filters, language exclusions, and limits to cap how much content you collect.

Quick Start

Tell the assistant to run a bulk offline download with screenshots and a limit, for example: firecrawl download https://docs.example.com --screenshot --limit 20 -y.

Frequently Asked Questions about firecrawl-download

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download an entire website for offline documentation?▼

To download an entire website for offline documentation, you combine site mapping to discover URLs and page scraping to save the content locally. This process organizes the downloaded site files into structured .firecrawl directories for offline reference.

Can I capture screenshots while scraping a website for offline use?▼

Yes, you can capture screenshots during website scraping by applying the --screenshot flag. This allows you to save visual page states alongside markdown output within your local site mirroring directories.

How do I filter URLs when bulk scraping website content?▼

You filter URLs during bulk scraping by applying include-paths and exclude-paths flags. These configurable filters let you target specific site sections and cap how much content you collect with limits.

Does firecrawl support saving downloaded web pages as markdown?▼

Yes, firecrawl supports saving downloaded web pages as markdown output. When you run a bulk offline download, you can configure the format options to extract content into markdown files for research workflows.

What is the best way to mirror a complete website section locally?▼

The best way to mirror a complete website section locally is to run a site mapping operation followed by bulk scraping. This captures all relevant pages in one run and stores the results in structured local directories.

What are the limitations of using firecrawl for site mirroring?▼

Limitations of using firecrawl for site mirroring include the need to execute map and scrape commands together and manage storage in .firecrawl directories. You must also configure limits and filters to avoid collecting excessive content during bulk extraction.

Related Skills

Explore More Software Engineering Skills→
lugondevlugondev

seo-firecrawl

Crawl websites and extract page content, metadata, and links for SEO audits.

Community
Intermediate
XSpoonAiXSpoonAi
17

vector-notes-indexer

Index local notes with vector embeddings for offline semantic search.

Official
Advanced
Markson22Markson22

reversa-docs

Generate a self-contained HTML mini-site from extracted project knowledge.

Community
Advanced
danielscholldanielscholl

web

Fetch web pages and convert HTML to clean Markdown.

Community
Intermediate