skills.rest
ovisan
ovisanCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl

Search, scrape, crawl, and monitor websites via the Firecrawl CLI.

2|Updated Mar 29, 2015
Search Tags:#cli#web search#firecrawl#web scraping#crawling#markdown extraction#change monitoring
One-click install
npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-ovisan
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl
Source: https://github.com/ovisan/dotfiles/tree/main/.grok/skills/firecrawl
Command: npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-ovisan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires firecrawl-cli.

What problem does it solve? Getting usable web content into an AI workflow is hard: pages are JavaScript-rendered, sites require interaction, and raw HTML is noisy. This Skill uses the Firecrawl CLI to search the web, scrape pages into clean markdown, crawl entire site sections, and monitor pages for changes. ## Core Features & Use Cases - Web Search & Scraping: Find pages on any topic and extract their content as clean markdown optimized for LLM context windows. - Crawling, Mapping & Interaction: Map site URLs, bulk-crawl documentation sections, and interact with pages requiring clicks, forms, logins, or pagination. - Change Monitoring: Schedule recurring checks on pages (pricing, jobs, changelogs) with goal-based alerts via webhook or email, including structured JSON field diffs. - Use Case: A user asks to track a competitor's pricing page. The Skill creates a monitor with a goal like "Alert when pricing information changes" and notifies them by email whenever plans or prices change. ## Quick Start Ask the assistant to scrape a specific URL or search the web for a topic, for example: "Scrape https://example.com/pricing and summarize the plans."

Frequently Asked Questions about firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a webpage into markdown from the command line?▼

Run firecrawl scrape with the target URL and an output flag, for example firecrawl scrape "https://example.com" -o .firecrawl/page.md. The CLI handles static and JavaScript-rendered pages and returns clean markdown.

How do I monitor a website for changes like pricing updates?▼

Use firecrawl monitor create with a --page URL, a --schedule such as "every 5 minutes", and a --goal describing what changes matter. Notifications can be sent via email or webhook, and each check labels pages as same, new, changed, removed, or error.

Does Firecrawl work without an API key?▼

Yes, search, scrape, and interact work on a keyless free tier that is rate-limited. For best results, authenticate with firecrawl login --browser or provide a FIRECRAWL_API_KEY from firecrawl.dev.

When should I use scrape versus interact for a webpage?▼

Use scrape first since it handles static pages and JS-rendered SPAs. Add interact only when the content requires clicks, form fills, pagination, infinite scroll, or login, or when scrape fails to capture everything.

Why is the firecrawl command not found after installation?▼

The npm global bin directory may not be in your PATH. Verify with npx [email protected] --version, and reinstall globally with npm install -g [email protected] if needed.

Related Skills

Explore More Software Engineering Skills→
firecrawlfirecrawl
616

firecrawl

Search, scrape, crawl, and interact with websites via the Firecrawl CLI.

Official
Intermediate
CliffValeCliffVale
1

firecrawl-workflows

Orchestrates Firecrawl workflows that produce research reports, audits, and structured web-data deliverables.

Community
Intermediate
firstsun-devfirstsun-dev
3

firecrawl-search

Searches the web and scrapes full page content into JSON files via the Firecrawl CLI.

Official
Intermediate
polymerdaopolymerdao
1

polymer-pay-stableenrich-firecrawl

Scrape URLs into markdown and search web queries via StableEnrich.

Official
Intermediate