skills.rest
iAziz786
iAziz786COMMUNITY
Explore all skills by this author →
Website𝕏@iAziz786GitHub

firecrawl-download

Download entire websites as local files via a self-hosted Firecrawl instance.

3|Updated Jul 5, 2021
Search Tags:#automation#markdown#screenshots#firecrawl#web-scraping#site-mapping#offline-access
One-click install
npx skills add https://github.com/iAziz786/dotfiles --skill firecrawl-download-iaziz786
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-download
Source: https://github.com/iAziz786/dotfiles/tree/main/.agents/skills/firecrawl-download
Command: npx skills add https://github.com/iAziz786/dotfiles --skill firecrawl-download-iaziz786

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Download entire websites as local files by orchestrating a map-and-scrape workflow against a self-hosted Firecrawl instance, enabling offline access and archival.

Core Features & Use Cases

  • Map sites to discover pages, then scrape each page into organized local directories under .firecrawl/.
  • Save content in multiple formats per page and optionally include screenshots for richer offline copies.
  • Use cases include offline documentation backups, research site archiving, and portable local copies for reference.

Quick Start

Run firecrawl download https://example.com to save the entire site locally under .firecrawl with optional formats and screenshots.

Frequently Asked Questions about firecrawl-download

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download an entire website for offline access?▼

You can download an entire website for offline access by mapping the site to discover pages, then scraping each page into organized local directories under .firecrawl using a self-hosted Firecrawl instance.

Can I save web-scraping output as markdown and screenshots?▼

Yes, you can save web-scraping output as markdown and screenshots. The tool supports saving content in multiple formats per page and optionally including screenshots for richer offline copies.

Do I need a self-hosted Firecrawl instance to archive entire sites locally?▼

Yes, you need a self-hosted Firecrawl instance. The Skill orchestrates a map-and-scrape workflow against your self-hosted Firecrawl instance to download entire websites as local files for archival.

What is the best way to backup offline documentation from a website?▼

The best way to backup offline documentation is running a map-and-scrape workflow that saves every page of a site into nested local directories under .firecrawl, enabling portable local copies for reference.

How do I skip confirmations when bulk saving website content?▼

You can skip confirmations when bulk saving website content by passing the -y flag. This automates the download process when scraping entire sites into local directories.

Are there limitations when using site-mapping to scrape large websites?▼

The Skill requires a self-hosted Firecrawl instance to handle the site-mapping and scraping process. Large sites will generate many nested directories under .firecrawl, requiring sufficient local storage for the offline copies.

Related Skills

Explore More Software Engineering Skills→
iAziz786iAziz786
3

firecrawl

Searches, scrapes, and interacts with web pages via a local Firecrawl API.

Community
Advanced
aryaniyapsaryaniyaps
26

firecrawl-download

Download websites to local storage with filters, formats, and screenshots.

Community
Intermediate
r1cA18r1cA18
4

firecrawl-download

Download entire websites into local Markdown and screenshot files.

Community
Intermediate
ironkid90ironkid90

firecrawl-download

Downloads an entire website as local files using Firecrawl mapping and scraping.

Community
Intermediate