skills.rest
isiou
isiouCOMMUNITY
Explore all skills by this author →
GitHub

web-scraper

Extracts structured metadata and HTML content from a web page URL via the WebPageSnap API.

Updated Apr 6, 2026
Search Tags:#web scraping#html parsing#twitter cards#url extraction#og tags#page metadata
One-click install
npx skills add https://github.com/isiou/AI-Library-VLLM --skill web-scraper-isiou
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraper
Source: https://github.com/isiou/AI-Library-VLLM/tree/main/.gemini/skills/web-scraper
Command: npx skills add https://github.com/isiou/AI-Library-VLLM --skill web-scraper-isiou

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the manual effort of opening web pages, copying metadata, and collecting page content by turning any URL into structured, machine-readable output.

Core Features & Use Cases

  • Page Metadata Extraction: Capture titles, descriptions, keywords, author fields, Open Graph tags, and Twitter card metadata from a webpage.
  • HTML Content Retrieval: Pull the rendered body content for analysis, summarization, or downstream processing.
  • Use Case: When you need to inspect a product page, news article, or landing page, this Skill can quickly return the page’s metadata and full HTML for review.

Quick Start

Use the web-scraper skill to fetch the provided URL and return its metadata and HTML content in structured form.

Frequently Asked Questions about web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract Open Graph tags and Twitter card metadata from a URL?▼

To extract Open Graph tags and Twitter card metadata from a URL, you can use a web scraping tool that returns structured page metadata. This Skill fetches titles, descriptions, keywords, and social tags directly from the provided webpage link.

What is the best way to scrape HTML content from an article or product page?▼

The best way to scrape HTML content from an article or product page is using an automated extraction tool that retrieves rendered body content. This Skill pulls the full HTML and page metadata for downstream analysis or summarization.

Can I get structured JSON output from webpage scraping for crawl analysis?▼

Yes, you can get structured JSON output from webpage scraping for crawl analysis. This Skill requires JSON response parsing and returns machine-readable metadata including titles, descriptions, and body content from the target URL.

Does web scraping require URL encoding to fetch page metadata?▼

Web scraping requires URL encoding to properly fetch page metadata from target websites. This Skill uses URL encoding alongside the WebPageSnap API to successfully retrieve titles, descriptions, social tags, and HTML content.

How do I retrieve page titles and descriptions for multiple landing pages?▼

To retrieve page titles and descriptions for landing pages, you provide the encoded URL to a scraping service. This Skill automates the extraction of author fields, keywords, and Open Graph tags without manual copying.

Related Skills

Explore More Data & Analytics Skills→
matteotittamatteotitta
29

metadata-lint

Audit HTML head metadata for SEO and social media compliance.

Community
Intermediate
pynbj1001pynbj1001
2

Smart Browser

Extract JavaScript-rendered web page agendas and session data to Markdown and JSON.

Community
Intermediate
aryaniyapsaryaniyaps
26

firecrawl-build-scrape

Extract HTML, markdown, links, and screenshots from known URLs.

Community
Intermediate
AgentComputerAIAgentComputerAI
5

github

Fetch GitHub HTML pages and parse repository metadata with cheerio.

Official
Intermediate