skills.rest
LvcidPsyche
LvcidPsycheCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl

Search, scrape, and crawl web pages through the Firecrawl API.

7|1|Updated Feb 1, 2026
Search Tags:#automation#firecrawl#web-search#data-extraction#web-scraping#crawling
One-click install
npx skills add https://github.com/LvcidPsyche/polymarket-arbitrage-bot --skill firecrawl-lvcidpsyche
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl
Source: https://github.com/LvcidPsyche/polymarket-arbitrage-bot/tree/main/skills/firecrawl-search
Command: npx skills add https://github.com/LvcidPsyche/polymarket-arbitrage-bot --skill firecrawl-lvcidpsyche

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Web teams need to discover and extract data from the web quickly, including JavaScript-heavy sites, without manually building scrapers.

Core Features & Use Cases

  • Web search and data extraction via the Firecrawl API to surface relevant results.
  • Scrape individual pages or crawl entire sites with configurable limits and formats.
  • Use Case: gather product details, articles, or market signals from multiple sources for analysis.

Quick Start

Start by running a search with firecrawl_search, then fetch a page with firecrawl_scrape, or begin a site crawl with firecrawl_crawl.

Frequently Asked Questions about firecrawl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape JavaScript-heavy web pages for data extraction?▼

To scrape JavaScript-heavy web pages for data extraction, you can use the Firecrawl API. It handles dynamic content rendering and returns structured data from individual pages without requiring you to manually build or maintain custom scrapers.

What is the best way to crawl an entire website for competitive analysis?▼

The best way to crawl an entire website for competitive analysis is using a web scraping API like Firecrawl. It supports site-wide crawls with configurable limits and formats to systematically gather product details and market signals from multiple sources.

Do I need an API key to extract web data using Firecrawl?▼

Yes, you need a Firecrawl API key to extract web data. You must configure the FIRECRAWL_API_KEY in your environment before executing the provided search, scrape, or crawl scripts to successfully authenticate and fetch internet data.

Can I search the web and then scrape specific pages in one workflow?▼

Yes, you can search the web and scrape specific pages in one workflow. Start by running a search to surface relevant results, then fetch targeted page content using the scrape function to gather articles or product details for research.

Does web scraping with Firecrawl support configurable output formats?▼

Yes, web scraping with Firecrawl supports configurable output formats. When you scrape individual pages or crawl entire sites, you can set specific limits and formats to ensure the extracted data matches your content gathering requirements.

Why use an automated web scraper instead of manually building crawlers?▼

You use an automated web scraper instead of manually building crawlers to discover and extract web data quickly. It eliminates the overhead of handling JavaScript rendering and site-specific logic, streamlining research and competitive analysis.

Related Skills

Explore More Software Engineering Skills→
antgroupantgroup
16

firecrawl

Access Firecrawl API for web search, scraping, and site crawling.

Official
Intermediate
polymerdaopolymerdao
1

polymer-pay-firecrawl-search

Search the web and retrieve scraped markdown content via the Polymer Pay proxy.

Official
Intermediate
GeneralReasoningGeneralReasoning
4

FFmpeg Video Filters

Apply and compose FFmpeg video filters for resizing, cropping, overlays, and effects.

Official
Intermediate
xberg-ioxberg-io
26

headless-fallback

Scrape JavaScript-heavy web pages using headless-Chrome as a fallback.

Official
Intermediate