scrape

Scrape URL content into markdown, HTML, JSON, or text formats.

Updated Feb 19, 2026

Search Tags:#web scraping #content extraction #spa #data retrieval #javascript rendering

Ready to run

npx skills add https://github.com/olostep/olostep-cursor-plugin --skill scrape-olostep

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrape
Source: https://github.com/olostep/olostep-cursor-plugin/tree/main/skills/scrape
Command: npx skills add https://github.com/olostep/olostep-cursor-plugin --skill scrape-olostep

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill allows you to extract content from any webpage, including those with dynamic JavaScript rendering or bot protection, overcoming the limitations of standard web scraping.

Core Features & Use Cases

Content Extraction: Retrieve clean markdown, HTML, JSON, or text from any URL.
Dynamic Content Handling: Automatically renders JavaScript-heavy Single Page Applications (SPAs).
Bot Bypass: Handles anti-bot measures and geo-restrictions using residential proxies.
Use Case: Extract product details (price, description, reviews) from an e-commerce site, or pull technical documentation from a developer portal to use as context for coding.

Quick Start

Use the scrape skill to get the markdown content from the URL https://example.com/page.

Frequently Asked Questions about scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract content from a JavaScript-rendered single page application?▼

You can extract content from JavaScript-rendered SPAs by using a scraping tool that automatically renders dynamic elements. This skill handles JavaScript rendering natively, returning fully loaded content from any specified URL.

Can I get markdown output instead of HTML when scraping a webpage?▼

Yes, you can get markdown output instead of HTML when scraping a webpage. This skill supports multiple output formats including markdown, HTML, JSON, and plain text, selectable via parameters during invocation.

Does web scraping work on sites with anti-bot protection and geo-restrictions?▼

Web scraping works on sites with anti-bot protection and geo-restrictions by routing requests through residential proxies. This skill bypasses bot detection and allows optional country targeting to access region-locked content.

What is the best way to scrape product details from an e-commerce site?▼

The best way to scrape product details like prices and reviews from an e-commerce site is using a scraper that handles dynamic content and anti-bot measures. This skill retrieves clean structured data formats like JSON or markdown.

How do I handle wait times for dynamic content extraction?▼

To handle wait times for dynamic content extraction, you specify optional rendering wait times as parameters. This ensures the scraper captures all asynchronously loaded elements before returning the final page content.