skills.rest
orthogonal-sh
orthogonal-shOFFICIAL
Explore all skills by this author →
WebsiteGitHub

scrapegraph

Extract structured data from web pages using AI prompts and a target URL.

12|4|Updated Feb 12, 2026
Search Tags:#automation#markdown#ai#crawler#web#data-extraction#scrape
One-click install
npx skills add https://github.com/orthogonal-sh/skills --skill scrapegraph
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapegraph
Source: https://github.com/orthogonal-sh/skills/tree/main/skills/orthogonal-scrapegraph
Command: npx skills add https://github.com/orthogonal-sh/skills --skill scrapegraph

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

AI-powered web scraping enables extracting data from websites using natural language prompts, reducing manual coding and speeding up data collection.

Core Features & Use Cases

  • AI-driven extraction from pages via natural language prompts
  • Supports tasks like crawling, sitemap extraction, markdown conversion, and structured data retrieval
  • Use cases: research, price monitoring, content aggregation, competitive analysis

Quick Start

Provide a URL and a natural language data request to start extracting data from the page.

Frequently Asked Questions about scrapegraph

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from a web page without writing code?▼

You can extract structured data from a web page by providing a target URL and a natural language prompt. The AI processes your request and returns the specific information you asked for without manual coding.

Can I use natural language prompts to crawl an entire website?▼

Yes, natural language prompts can be used for website crawling. By supplying a URL and your data request to the crawl or sitemap endpoints, you can extract structured data across multiple pages rapidly.

Does AI web scraping support custom headers and cookies for authenticated pages?▼

AI web scraping supports custom headers and cookies. You can include these optional inputs alongside your user prompt and website URL to extract data from pages requiring authentication or specific session states.

What is the best way to convert web pages to markdown for content aggregation?▼

The best way to convert web pages to markdown is using a dedicated markdownify endpoint. You provide the target URL, and the tool processes the page content to output clean markdown text for aggregation.

How does AI web scraping handle price monitoring across different sites?▼

AI web scraping handles price monitoring by using natural language prompts to target specific data points on a URL. You can automate rapid data extraction across multiple e-commerce sites to track pricing changes.

Can I define an output schema for structured data extraction?▼

Yes, you can define an optional output schema to structure the extracted data. Providing a schema alongside your user prompt and website URL ensures the returned data matches your required format for research or analysis.

Related Skills

Explore More Data & Analytics Skills→
eskoNBGeskoNBG
1

web-reader

Retrieve structured web page content and metadata from a URL.

Community
Advanced
shynlee04shynlee04

web-search

Search the web and extract content via Tavily and Exa using the inference.sh CLI.

Community
Intermediate
jg-chalk-iojg-chalk-io

moai-cc-claude-md

Automates Markdown documentation generation and publication workflows for Claude Code.

Community
Advanced
HouseofmvpsHouseofmvps
115

seo-audit

Run SEO, GEO, and AEO audits with auto-fixes and sitemap submission.

Community
Advanced