skills.rest
Roxabi
RoxabiOFFICIAL
Explore all skills by this author →
Website𝕏@roxabi_GitHub

scrape

Extract structured content and metadata from URLs as JSON.

9|1|Updated Feb 28, 2026
Search Tags:#data extraction#information retrieval#web scraping#url#content analysis#scrape
One-click install
npx skills add https://github.com/Roxabi/roxabi-plugins --skill scrape
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape
Source: https://github.com/Roxabi/roxabi-plugins/tree/main/plugins/web-intel/skills/scrape
Command: npx skills add https://github.com/Roxabi/roxabi-plugins --skill scrape

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of extracting valuable information from various online sources, saving you the time and effort of manual data collection and summarization.

Core Features & Use Cases

  • Versatile Scraping: Extracts content from platforms like Twitter/X, GitHub, YouTube, Reddit, and general webpages.
  • Structured Output: Returns data in a clean JSON format, including content, metadata, and platform-specific fields.
  • Use Case: Quickly get the main points and key metadata from a lengthy news article or a GitHub repository's README without reading the whole page.

Quick Start

Scrape the content from the provided URL https://example.com.

Frequently Asked Questions about scrape

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured content and metadata from a webpage URL?▼

To extract structured content from a webpage URL, this Skill scrapes the target page and returns the data as clean JSON, including main content and metadata fields. It automates information retrieval to save manual effort.

Can I scrape Twitter, GitHub, YouTube, and Reddit using Python?▼

Yes, you can scrape Twitter/X, GitHub, YouTube, and Reddit. This Skill uses Python scripts to perform platform-specific scraping and extracts platform-specific fields, returning the results in a structured JSON format.

Does web scraping with Python handle SSL certificate verification for secure connections?▼

Yes, web scraping with Python handles SSL certificate verification for secure connections. This ensures that data extraction from HTTPS URLs proceeds smoothly without security certificate interruptions.

What is the best way to get a JSON summary of a GitHub repository README?▼

The best way to get a JSON summary of a GitHub repository README is using this web scraping Skill. It retrieves the URL content, extracts the main points and key metadata, and outputs structured JSON without reading the whole page.

Do I need Python installed to extract information from general webpages?▼

Yes, you need Python installed because this Skill requires Python scripts for scraping. These scripts execute the underlying information retrieval and content analysis to extract data from general webpages.

Related Skills

Explore More Data & Analytics Skills→
camoneartcamoneart
5

Searching Web

Perform web searches via Brave-Search with WebFetch fallback and return URLs, titles, and page content.

Community
Basic
alibabaalibaba
10.5k

pdf-extractor

Extract text, tables, and metadata from PDF documents into JSON.

Official
Intermediate
jackandkingjackandking

data-deduplication

Deduplicate datasets using exact, fuzzy, ID-based, and content similarity strategies.

Community
Intermediate
OpenSenseNovaOpenSenseNova
4.9k

sn-search-social-en

Search Reddit, Twitter, and YouTube for English social media content.

Official
Basic