skills.rest
orthogonal-sh
orthogonal-shOFFICIAL
Explore all skills by this author →
WebsiteGitHub

scrape

Extracts structured data from web pages and URLs via modular scraping workflows.

12|4|Updated Feb 12, 2026
Search Tags:#web#data-extraction#scrape#browser-automation#structured-data#crawl
One-click install
npx skills add https://github.com/orthogonal-sh/skills --skill scrape-orthogonal-sh
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape
Source: https://github.com/orthogonal-sh/skills/tree/main/skills/orthogonal-scrape
Command: npx skills add https://github.com/orthogonal-sh/skills --skill scrape-orthogonal-sh

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Web scraping often involves repetitive manual copying, inconsistent data structures, and brittle workflows when data lives across multiple pages and formats. This Skill automates the end-to-end process of scraping websites, converting pages to structured data, and driving browser actions to reach the data you need.

Core Features & Use Cases

  • AI-assisted extraction via Scrapegraph to translate natural-language prompts into structured outputs.
  • Batch crawling & large-scale scraping with Olostep for scalable URL discovery and content retrieval.
  • Schema-driven extraction with Riveter to enforce consistent output formats across multiple sites.
  • Browser-driven interactions with Notte for dynamic pages requiring automation, login flows, or CAPTCHAs.
  • Versatile outputs including markdown conversion and sitemap generation for easy downstream use.

Quick Start

Tell me what websites to scrape and what data to extract, and I will start an automated scraping workflow.

Frequently Asked Questions about scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from web pages using AI-assisted scraping?▼

Web scraping handles dynamic pages requiring browser automation, login flows, and CAPTCHAs by using browser-driven interactions to navigate and extract data that static scraping cannot reach.

Can I perform large-scale batch crawling across multiple URLs?▼

Batch crawling supports scalable URL discovery and content retrieval across multiple sources, enabling large-scale web scraping operations to gather and structure data efficiently from numerous pages.

How does schema-driven extraction ensure consistent output across different sites?▼

Schema-driven extraction enforces consistent output formats across multiple sites by defining structured data schemas, ensuring retrieved web scraping results match exact specifications regardless of source layout.

What is the best way to automate browser interactions for data extraction?▼

Web scraping converts extracted page content into markdown and generates sitemaps, providing versatile structured outputs that are immediately ready for downstream data processing and analysis workflows.

Related Skills

Explore More Data & Analytics Skills→
orthogonal-shorthogonal-sh
12

olostep

Scrape and crawl web pages into structured data via configurable endpoints.

Official
Advanced
aws-samplesaws-samples
90

file-processing

Process and analyze CSV, JSON, and text data files with automated cleaning and transformation.

Official
Advanced
slamb2kslamb2k
5

play-tight

Automate Playwright browser interactions and extract data as compact JSON.

Community
Advanced
MonichreMonichre

open-researcher

Gather credible open-source research sources with ranked summaries and citations.

Community
Basic