skills.rest
paul-hosking-cdw-com
paul-hosking-cdw-comCOMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Extract webpage content, metadata, and local images for migration.

Updated Dec 11, 2025
Search Tags:#migration#playwright#aem#web-scraping#metadata-extraction#image-capture#html-cleanup
One-click install
npx skills add https://github.com/paul-hosking-cdw-com/da-with-ue-demo --skill scrape-webpage-paul-hosking-cdw-com
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/paul-hosking-cdw-com/da-with-ue-demo/tree/main/.claude/skills/scrape-webpage
Command: npx skills add https://github.com/paul-hosking-cdw-com/da-with-ue-demo --skill scrape-webpage-paul-hosking-cdw-com

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Web page content scraping and preparation for migration, including metadata extraction and local image mapping.

Core Features & Use Cases

  • Extracts page content, metadata, and images
  • Generates cleaned HTML with local image references
  • Produces migration-ready artifacts (metadata.json, paths)

Quick Start

Run the analyze-webpage script with a URL to generate a local HTML file, metadata, and image mappings.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract webpage content and local images for AEM migration?▼

Webpage scraping for AEM migration extracts page content, metadata, and local images into migration-ready artifacts. It generates cleaned HTML with local image references, a metadata.json file, and an images folder to prepare your data for transfer.

What metadata formats are extracted during webpage scraping for migration?▼

Webpage scraping extracts Open Graph, JSON-LD, and canonical data into a metadata.json file. This ensures all critical SEO and page structure metadata is preserved and mapped correctly during your migration workflow.

Do I need Node.js and Playwright to scrape webpages and capture screenshots?▼

Yes, scraping webpages and capturing screenshots requires Node.js, npm, Playwright with Chromium, and Sharp. These dependencies provide the environment needed to execute the analysis script and process image capture locally.

How do I clean HTML and map local images using a web scraping script?▼

You run the analyze-webpage script with a target URL to generate cleaned HTML. The script automatically maps local image references, saving the webpage assets into an images folder for migration-ready data.

What's the best way to capture full page screenshots for content migration?▼

Using Playwright with Chromium provides a reliable way to capture full page screenshots for content migration. The scraping process outputs the screenshot locally alongside cleaned HTML and extracted metadata.

Related Skills

Explore More Content & Communication Skills→
arbory-digital-incarbory-digital-inc

scrape-webpage

Extract webpage content, metadata, and images into local assets.

Official
Intermediate
ak8458ak8458

scrape-webpage

Scrape webpages to extract content, metadata, and local images for migration.

Community
Advanced
adobeadobe
162

scrape-webpage

Extract webpage content, metadata, and images into a structured bundle.

Official
Advanced
valithedgevalithedge

scrape-webpage

Extract webpage content, metadata, and images into a migration bundle.

Community
Advanced