ScrapeGraphAIScrapeGraphAIOfficialยท1 Agent Skills Included

just-scrape

Web scraping, search, extraction, crawling, and page monitoring

Searches the web, scrapes pages into markdown or HTML, and extracts structured JSON from any URL. Crawls entire site sections and monitors pages for changes with scheduled checks and webhook alerts. Eliminates manual copy-pasting and brittle scraping scripts by routing everything through one simple command-line interface. Saves clean JSON output to files for fast reuse in scripts and automated workflows.
npx skills add ScrapeGraphAI/just-scrape --all -g -y
Available:

Instructs your AI agent to never use built-in web fetch or search tools and instead route all URL fetching, web search, and data extraction through the just-scrape CLI commands.

All Skills in This Repository (1)

Pure Emerald Level Indicators

Frequently Asked Questions

FAQPage Schema
How to install just-scrape?โ–ผ

Run `npx skills add ScrapeGraphAI/just-scrape --all -g -y` in your terminal to install the skill globally. You also need a free API key from scrapegraphai.com set as SGAI_API_KEY.

How to extract structured data from a website?โ–ผ

Run `just-scrape extract "<url>" -p "Extract product names and prices" --json` with a plain-English prompt. Add `--schema` with a JSON schema when you need a strict output shape.

Can just-scrape search the web without a URL?โ–ผ

Yes. Use `just-scrape search "your query"` to find pages on any topic, with filters for country and time range like past_week or past_month.

How to track website changes automatically?โ–ผ

Use `just-scrape monitor create --url "<url>" --interval 1h` to schedule recurring page checks. You can add a webhook URL to get notified whenever the page changes.

Does just-scrape work with Claude Code and other AI agents?โ–ผ

Yes. The included SKILL.md follows the universal skill standard, so agents like Claude Code, OpenClaw, and Codex can run scraping commands directly through the terminal.

Related Repositories in Data & Analytics

View All in Data & Analyticsโ†’