skills.rest
sahiixx
sahiixxCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

web-scraper

Extract structured web content, metadata, and links from pages.

Updated Jan 31, 2026
Search Tags:#SEO#data-extraction#web-scraping#JSON-LD#OpenGraph#CSS-selectors
One-click install
npx skills add https://github.com/sahiixx/moltworker --skill web-scraper-sahiixx
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraper
Source: https://github.com/sahiixx/moltworker/tree/main/skills/web-scraper
Command: npx skills add https://github.com/sahiixx/moltworker --skill web-scraper-sahiixx

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Web teams often spend excessive time manually collecting data from diverse web pages. This skill automates the retrieval of page content, metadata, and links to streamline data gathering.

Core Features & Use Cases

  • Fetch pages and extract visible content using CSS selectors.
  • Parse and expose structured data from Open Graph, JSON-LD, and meta tags for analytics and indexing.
  • Analyze and export links and sitemaps to support SEO, research, and content auditing.

Quick Start

Run node fetch.js <url> to fetch a page, then node extract.js <url> --selector "<css-selectors>" to pull content, and node metadata.js <url> to retrieve structured metadata.

Frequently Asked Questions about web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured web content from pages using CSS selectors?▼

To extract structured web content from pages, you can run the provided Node.js scripts to fetch a URL and pull visible content by passing specific CSS selectors to the extraction script. This automates retrieving targeted page elements.

Can I parse Open Graph and JSON-LD metadata for SEO indexing?▼

Yes, you can parse Open Graph and JSON-LD metadata for SEO indexing. The skill retrieves and exposes structured data from meta tags, allowing you to capture page metadata for analytics and search optimization.

What's the best way to automate data extraction and link auditing for web pages?▼

The best way to automate data extraction and link auditing is running Node.js scripts that fetch page content, extract links, and export sitemaps. This streamlines gathering data for SEO research and content audits.

Do I need any external dependencies to run this web scraping script?▼

No external dependencies are required to run this web scraping script. The skill operates using standalone Node.js scripts, allowing you to fetch pages and extract data without installing additional packages.

How do I retrieve a website's sitemap and analyze links for content auditing?▼

To retrieve a website's sitemap and analyze links for content auditing, run the extraction scripts against a target URL. The skill analyzes and exports links to support SEO, research, and auditing tasks.

Related Skills

Explore More Data & Analytics Skills→
robomotioniorobomotionio
2

web-scraper

Extract structured data from HTML using CSS selectors or XPath queries.

Official
Intermediate
jovermierjovermier
2

nextjs-metadata

Implement Next.js metadata for SEO, OpenGraph, and structured data.

Community
Intermediate
fawzy0zfawzy0z
11

seo-optimizer-nextjs

Implement comprehensive SEO for Next.js App Router projects.

Community
Advanced
tedtv1007-ctrltedtv1007-ctrl

cloudflare-crawl

Fetch rendered HTML from dynamic websites via the Cloudflare Browser Rendering API.

Community
Intermediate