skills.rest
leonardoacosta
leonardoacostaCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-build-scrape

Integrate Firecrawl /scrape into product code for single-page content extraction.

Updated Aug 2, 2026
Search Tags:#caching#firecrawl#web scraping#api integration#content extraction#markdown extraction#single page
One-click install
npx skills add https://github.com/leonardoacosta/agents --skill firecrawl-build-scrape-leonardoacosta
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-build-scrape
Source: https://github.com/leonardoacosta/agents/tree/main/skills/firecrawl-build-scrape
Command: npx skills add https://github.com/leonardoacosta/agents --skill firecrawl-build-scrape-leonardoacosta

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? When an application already has a URL and needs that page's content, developers must wire up the Firecrawl /scrape endpoint correctly, choosing formats, freshness controls, and rendering options without over-engineering the integration. ## Core Features & Use Cases - Single-Page Extraction: Retrieve markdown, HTML, links, screenshots, metadata, or structured output from one known URL via the Firecrawl /scrape endpoint. - Freshness Control: Use maxAge to bound how old a reused indexed copy may be, and read cacheState and cachedAt metadata to verify what was returned. - Escalation Guidance: Directs you to firecrawl-build-search when no URL exists yet, or firecrawl-build-interact when pages require clicks, typing, or multi-step navigation. - Use Case: A knowledge-ingestion feature receives a documentation URL from a user; this skill guides the integration to scrape the page as markdown with onlyMainContent enabled and feed it into an LLM indexing pipeline. ## Quick Start Ask the agent to integrate Firecrawl /scrape into your app so a given URL is extracted as markdown for your ingestion pipeline.

Frequently Asked Questions about firecrawl-build-scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a single page with Firecrawl in my app?▼

Call the Firecrawl /scrape endpoint with the known URL and request markdown as the default format. Enable onlyMainContent for article-like pages, and add waits or rendering options only when the page requires them.

When should I use Firecrawl scrape instead of crawl or interact?▼

Use /scrape when your feature already has a specific URL and needs page-level content. If you do not have the URL yet, start with search; if the page requires clicks, typing, or multi-step navigation, escalate to the interact endpoint.

How do I control content freshness with Firecrawl maxAge?▼

Set maxAge in milliseconds to bound how old a reused indexed copy may be, or use maxAge: 0 to skip index reuse and force a live scrape. Check the cacheState and cachedAt response metadata to confirm what was returned.

Does a successful Firecrawl scrape mean the page item is still active?▼

No. A 200 status with non-empty content only means the fetch succeeded; many sites serve full pages for removed records. Your application must judge liveness from the page's own signals or a source-specific API.

What API credentials does Firecrawl scrape integration require?▼

It requires a FIRECRAWL_API_KEY environment variable for hosted Firecrawl requests. A FIRECRAWL_API_URL variable is optional and only needed when targeting a self-hosted Firecrawl deployment.

Related Skills

Explore More Software Engineering Skills→
daanteijema-beepdaanteijema-beep

firecrawl-map

Discover and list website URLs with optional search filtering.

Community
Basic
kreuzberg-devkreuzberg-dev
9.2k

chunking

Split extracted text into sized chunks for LLM context windows and RAG ingestion.

Official
Intermediate
shakhovskiya-createshakhovskiya-create

cache-investigation

Persist one-shot investigations to a durable cache under docs/cache/<topic>.

Community
Intermediate
firecrawlfirecrawl
72

firecrawl-build-interact

Interact with dynamic web pages via clicks and form submissions.

Official
Advanced