just-scrape

Automate web data tasks via the just-scrape CLI with an SGAI API key.

45|7|Updated Feb 3, 2026
One-click install
npx skills add https://github.com/ScrapeGraphAI/just-scrape --skill just-scrape-scrapegraphai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: just-scrape
Source: https://github.com/ScrapeGraphAI/just-scrape/tree/main/skills/just-scrape
Command: npx skills add https://github.com/ScrapeGraphAI/just-scrape --skill just-scrape-scrapegraphai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The just-scrape CLI unifies discovery, scraping, extraction, crawling, and monitoring of web content by orchestrating ScrapeGraph AI workflows from the terminal.

Core Features & Use Cases

  • Search the web to locate sources and answer questions without leaving the terminal.
  • Scrape pages to collect multiple formats including markdown, HTML, screenshots, links, images, summaries, and branding.
  • Extract & Crawl structured JSON from known URLs and bulk content from sections of a site.
  • Monitor pages for changes with optional webhooks, history inspection, credits checks, and API validation.

Quick Start

Install the CLI, authenticate with your API key, then run a small test like just-scrape search "example" to verify setup.

Frequently Asked Questions about just-scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape web pages and extract structured data from the terminal?

You can crawl websites to extract bulk content and structured JSON by running commands in the just-scrape CLI, which orchestrates ScrapeGraph AI workflows across known URLs and site sections.

Do I need an API key to use the AI-powered web scraping CLI?

Yes, a valid SGAI API key is required to authorize requests. You must authenticate the just-scrape CLI with this key before running web scraping, crawling, or monitoring tasks.

Can I monitor web pages for changes and send webhook notifications?

Yes, the just-scrape CLI monitors pages for changes with optional webhook notifications. You can also inspect history, check credits, and validate API setup for your monitoring workflows.

What is the best way to search the web and locate sources without leaving the terminal?

The just-scrape CLI provides an AI-powered search feature to locate sources and answer questions directly in the terminal, eliminating the need to switch contexts to a browser during web discovery.

What formats can I collect when scraping web pages with AI?

When scraping pages with the just-scrape CLI, you can collect multiple formats including markdown, HTML, screenshots, links, images, summaries, and branding assets for comprehensive data extraction.

How do I validate my API setup and check credits before crawling a website?

The just-scrape CLI includes built-in commands for API validation, credits checks, and history inspection, allowing you to verify your SGAI API key and available balance before executing crawl workflows.