skills.rest
Royincog
RoyincogCOMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Extract webpage content, metadata, and images into cleaned HTML and JSON artifacts.

Updated Apr 18, 2026
Search Tags:#automation#web-scraping#metadata-extraction#image-download#content-migration#html-cleanup
One-click install
npx skills add https://github.com/Royincog/cpedia --skill scrape-webpage-royincog
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/Royincog/cpedia/tree/main/.agents/skills/scrape-webpage
Command: npx skills add https://github.com/Royincog/cpedia --skill scrape-webpage-royincog

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Scrape webpages to extract content, metadata, and embedded images for migration or offline analysis, returning a structured artifact set that includes a metadata JSON, cleaned HTML, and local image assets.

Core Features & Use Cases

  • Webpage content extraction: pull main text, HTML structure, and assets for reuse in migration workflows.
  • Metadata capture: collect title, description, canonical URL, Open Graph/JSON-LD data for SEO preservation.
  • Image harvesting: download and localize images, with format normalization for reliable offline use.
  • Use Case: prepare a page for AEM Edge Delivery or content import by generating local HTML with image mappings and a ready-to-import metadata set.

Quick Start

Run the analyze-webpage script on a target URL to generate the artifacts in your chosen output directory.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape webpage content and download images for AEM Edge Delivery?▼

To scrape webpage content for AEM Edge Delivery, you automate the extraction of main text, cleaned HTML, metadata, and local image assets. This generates a structured JSON artifact and mapped HTML ready for content import.

What is the best way to extract Open Graph and JSON-LD metadata during web scraping?▼

The best way to extract Open Graph and JSON-LD metadata is to use an automated scraping script that captures title, description, canonical URL, and structured data. This preserves SEO metadata in a JSON artifact for offline analysis or migration.

Does Playwright support downloading and localizing images for content migration?▼

Yes, Playwright supports downloading and localizing images for content migration. The scraping process harvests embedded images, normalizes their formats, and downloads them locally to ensure reliable offline use alongside the extracted HTML.

Can I use a single script to clean HTML structure and generate a JSON metadata artifact?▼

Yes, you can use a single script to clean HTML structure and generate a JSON metadata artifact. The tool applies an end-to-end workflow that extracts content, pulls metadata, and packages the results into a ready-to-import set.

When do I need to convert webpage formats and normalize images for offline analysis?▼

You need to convert webpage formats and normalize images for offline analysis when preparing pages for content import. This handles diverse page structures and asset types, ensuring local images and cleaned HTML are reliably packaged for migration.

Related Skills

Explore More Software Engineering Skills→
qodex-aiqodex-ai
39

browser-automation-framework

Automate browser interactions and web testing with Playwright scripts.

Official
Advanced
Permit-JunctionPermit-Junction

scrape-webpage

Scrape webpage content, extract metadata, and download images for AEM Edge Delivery Services.

Official
Intermediate
treevestreeves

scrape-webpage

Extract content, metadata, and images from webpages for migration.

Community
Advanced
HouseGarofaloHouseGarofalo
3

web-automation

Automate browser interactions and web scraping with Playwright, Puppeteer, Selenium, and Scrapy.

Official
Intermediate