skills.rest
ovisan
ovisanCOMMUNITY
Explore all skills by this author →
GitHub

firecrawl-scrape

Extract clean markdown from URLs including JavaScript-rendered single-page applications.

2|Updated Mar 29, 2015
Search Tags:#firecrawl#web scraping#content extraction#spa#javascript rendering#url scraping#markdown extraction
One-click install
npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-scrape-ovisan
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: firecrawl-scrape
Source: https://github.com/ovisan/dotfiles/tree/main/.grok/skills/firecrawl-scrape
Command: npx skills add https://github.com/ovisan/dotfiles --skill firecrawl-scrape-ovisan

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Getting usable content from webpages is hard when pages rely on JavaScript rendering, cluttered navigation, or inconsistent HTML. This Skill converts any URL into clean, LLM-optimized markdown without manual copy-pasting or browser automation. ## Core Features & Use Cases - URL to Markdown Extraction: Scrape one or multiple URLs concurrently and save clean markdown output to local files. - JavaScript Rendering Support: Handle SPAs and dynamic pages with configurable wait times before scraping. - Content Filtering: Strip nav, footer, and sidebar with --only-main-content, include or exclude specific HTML tags, and redact PII. - Use Case: You need the pricing details from a competitor's JavaScript-heavy site. Scrape the URL with --only-main-content, save it to .firecrawl/pricing.md, then grep or read the markdown directly. ## Quick Start Scrape the content of this URL into clean markdown and save it to a local file so I can read it.

Frequently Asked Questions about firecrawl-scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a webpage to markdown from the command line?▼

Run firecrawl scrape followed by the quoted URL and an output path, for example firecrawl scrape "<url>" -o .firecrawl/page.md. The result is clean markdown saved to the specified file.

How to scrape JavaScript-rendered pages or SPAs?▼

Use the --wait-for option to delay scraping until JavaScript finishes rendering, for example firecrawl scrape "<url>" --wait-for 3000. This handles single-page applications that load content dynamically.

Can I scrape multiple URLs at once with firecrawl?▼

Yes, pass multiple URLs in a single command and they are scraped concurrently, with each saved to the .firecrawl directory. Check firecrawl --status to see your concurrency limit.

When should I use scrape instead of interact or crawl?▼

Use scrape when you have a specific URL and only need its content, whether static or JS-rendered. Escalate to interact only when you need clicks, form fills, or pagination, and to crawl for whole-site traversal.

Why does my scraped output include navigation and footers?▼

By default the full page is returned. Add --only-main-content to strip nav, footer, and sidebar, or use --include-tags and --exclude-tags to control exactly which HTML elements appear in the output.

Related Skills

Explore More Software Engineering Skills→
a2ajinkyaa2ajinkya
1

tavily-cli

Search the web, extract URL content, crawl sites, and discover URLs with citations.

Community
Advanced
kreuzberg-devkreuzberg-dev
9.2k

chunking

Split extracted text into sized chunks for LLM context windows and RAG ingestion.

Official
Intermediate
aryaniyapsaryaniyaps
26

firecrawl-build-scrape

Extract HTML, markdown, links, and screenshots from known URLs.

Community
Intermediate
Yjj0333Yjj0333

firecrawl-build-interact

Integrate Firecrawl /interact for browser actions on dynamic pages after scraping.

Community
Basic