skills.rest
s-hiraoku
s-hiraokuCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-api

Extract web content via Firecrawl API using curl requests.

21|11|Updated Jul 4, 2025
Search Tags:#API#search#firecrawl#data collection#web scraping#content extraction#web crawl
One-click install
npx skills add https://github.com/s-hiraoku/vscode-sidebar-terminal --skill firecrawl-api
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-api
Source: https://github.com/s-hiraoku/vscode-sidebar-terminal/tree/main/.claude/skills/firecrawl-api
Command: npx skills add https://github.com/s-hiraoku/vscode-sidebar-terminal --skill firecrawl-api

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill simplifies complex web scraping, content extraction, and site mapping tasks that typically require specialized tools and coding. It allows direct API interaction to gather structured data and information from the web, saving development time and effort.

Core Features & Use Cases

  • Single Page Scraping: Extract content (e.g., Markdown, HTML, links) from any URL.
  • Website Mapping: Discover all URLs on a given website for comprehensive site analysis.
  • Web Search with Scraping: Perform web searches and optionally scrape content from the results.
  • Use Case: Extract the markdown content from the xterm.js documentation page to quickly understand its features, then map all API endpoints on a corporate documentation site.

Quick Start

Use the firecrawl-api skill to scrape the main content in markdown format from 'https://www.example.com/blog/latest-post'.

Frequently Asked Questions about firecrawl-api

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape content from a website using an API?▼

Web scraping via API extracts structured content from URLs by sending authenticated requests to endpoints like /scrape. The Firecrawl API returns content in multiple formats—markdown, HTML, or links—making it faster than building custom parsers and eliminating browser automation overhead.

Can I extract markdown from a web page and get only the main content?▼

Yes, the Firecrawl API supports extracting markdown with the onlyMainContent option to filter out navigation, ads, and sidebars. This produces clean, focused content suitable for documentation analysis or content republishing.

What's the best way to map all URLs on a website?▼

Website mapping via the Firecrawl /map endpoint discovers and returns all URLs on a given domain in a single call. This is faster than crawling page-by-page and provides a complete site structure for analysis or indexing.

How do I search the web and scrape results in one operation?▼

The Firecrawl /search endpoint performs web searches and optionally scrapes content from each result page. This combines search discovery with content extraction, reducing multiple API calls to a single structured operation.

Do I need to handle dynamic content when scraping with this API?▼

The Firecrawl API includes a waitFor option to handle dynamically-loaded content by waiting for JavaScript execution before extraction. Without it, only initially-rendered HTML is captured, potentially missing lazy-loaded data.

What authentication is required to use the Firecrawl API?▼

Authentication uses an API key stored in the FIRECRAWL_API_KEY environment variable, passed with POST requests to Firecrawl endpoints. This key-based approach is simpler than OAuth and works across all scraping, mapping, and search operations.

Related Skills

Explore More Data & Analytics Skills→
evolution-foundationevolution-foundation
520

int-evolution-api

Manage Evolution API WhatsApp instances, messages, chats, contacts, groups, and webhooks.

Official
Intermediate
xberg-ioxberg-io
26

extracting-tables

Extract HTML tables and convert them to Markdown and structured JSON.

Official
Intermediate
nimadorostkarnimadorostkar
25

document-conversion

Convert HTML documents into structured Markdown or PDF files.

Community
Intermediate
abdullah1854abdullah1854
1

crawl-cli

Crawl websites and extract content into Markdown, JSON, or text.

Community
Basic