scrape

Name: scrape
Availability: InStock
Author: Roxabi

Extract structured content and metadata from URLs as JSON.

9|1|Updated Feb 28, 2026

Search Tags:#data extraction #information retrieval #web scraping #url #content analysis #scrape

Ready to run

npx skills add https://github.com/Roxabi/roxabi-plugins --skill scrape

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrape
Source: https://github.com/Roxabi/roxabi-plugins/tree/main/plugins/web-intel/skills/scrape
Command: npx skills add https://github.com/Roxabi/roxabi-plugins --skill scrape

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of extracting valuable information from various online sources, saving you the time and effort of manual data collection and summarization.

Core Features & Use Cases

Versatile Scraping: Extracts content from platforms like Twitter/X, GitHub, YouTube, Reddit, and general webpages.
Structured Output: Returns data in a clean JSON format, including content, metadata, and platform-specific fields.
Use Case: Quickly get the main points and key metadata from a lengthy news article or a GitHub repository's README without reading the whole page.

Quick Start

Scrape the content from the provided URL https://example.com.

Frequently Asked Questions about scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract structured content and metadata from a webpage URL?▼

To extract structured content from a webpage URL, this Skill scrapes the target page and returns the data as clean JSON, including main content and metadata fields. It automates information retrieval to save manual effort.

Can I scrape Twitter, GitHub, YouTube, and Reddit using Python?▼

Yes, you can scrape Twitter/X, GitHub, YouTube, and Reddit. This Skill uses Python scripts to perform platform-specific scraping and extracts platform-specific fields, returning the results in a structured JSON format.

Does web scraping with Python handle SSL certificate verification for secure connections?▼

Yes, web scraping with Python handles SSL certificate verification for secure connections. This ensures that data extraction from HTTPS URLs proceeds smoothly without security certificate interruptions.

What is the best way to get a JSON summary of a GitHub repository README?▼

The best way to get a JSON summary of a GitHub repository README is using this web scraping Skill. It retrieves the URL content, extracts the main points and key metadata, and outputs structured JSON without reading the whole page.

Do I need Python installed to extract information from general webpages?▼

Yes, you need Python installed because this Skill requires Python scripts for scraping. These scripts execute the underlying information retrieval and content analysis to extract data from general webpages.