skills.rest
ZJU-REAL
ZJU-REALOFFICIAL
Explore all skills by this author →
GitHub

firecrawl

Search, scrape, and monitor web content using the Firecrawl CLI.

195|12|Updated Jul 19, 2026
Search Tags:#web search#web scraping#content extraction#online research#site crawling#page monitoring
One-click install
npx skills add https://github.com/ZJU-REAL/HugAgentOS --skill firecrawl-zju-real
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl
Source: https://github.com/ZJU-REAL/HugAgentOS/tree/main/src/backend/plugin_bundles/marketplace/firecrawl/skills/cli
Command: npx skills add https://github.com/ZJU-REAL/HugAgentOS --skill firecrawl-zju-real

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the friction of finding, extracting, and monitoring information across websites, especially when pages are dynamic, large, or require interaction.

Core Features & Use Cases

  • Web Search: Discover relevant pages and research sources by topic.
  • Content Extraction: Scrape pages, map sites, crawl documentation, and download web content in clean Markdown.
  • Interactive Workflows: Navigate pagination, forms, modals, and login-dependent pages when direct scraping is insufficient.
  • Use Case: Research a technical topic by finding authoritative sources, extracting their full content, and compiling the results for analysis.

Quick Start

Use the Firecrawl skill to search for authoritative articles about a specified topic and save the relevant results for analysis.

Frequently Asked Questions about firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract web content from dynamic pages that require interaction?▼

Web content extraction from dynamic pages uses interactive workflows to navigate pagination, modals, and forms. This approach scrapes interactive elements and returns clean Markdown for complex pages.

What is the best way to crawl documentation and download sites in Markdown format?▼

Crawling documentation and downloading sites is done by mapping site structures and extracting full page content. It converts web content into clean Markdown to support online research and information retrieval.

Do I need API credentials to perform web scraping and site crawling?▼

Yes, authenticated web operations require configured Firecrawl API credentials and the Firecrawl CLI. These prerequisites enable the tool to perform web search, site crawling, and page monitoring securely.

Can I monitor website changes and track page updates automatically?▼

Page monitoring tracks website changes by continuously checking specified URLs. It identifies content updates on targeted pages, which is essential for maintaining current online research sources and tracking site modifications.

Why does direct web scraping fail on login-dependent pages and how do I fix it?▼

Direct web scraping fails on login-dependent pages because it cannot bypass authentication walls. Interactive workflows resolve this by navigating forms and login sequences to extract the protected web content.

Related Skills

Explore More Education & Research Skills→
antgroupantgroup
16

firecrawl

Access Firecrawl API for web search, scraping, and site crawling.

Official
Intermediate
ffanglailiffanglaili
117

diagram-reports-generator

Extract diagram and MicroSim details from chapter markdown files into structured reports.

Community
Intermediate
kennyolofsson23-netizenkennyolofsson23-netizen

firecrawl

Orchestrate search, scrape, map, crawl, and browser-driven extraction for web research.

Community
Advanced
helloluishelloluis

kamai — Headless Browser API

Automate navigation, form interaction, and content extraction on JavaScript-heavy websites.

Community
Intermediate