scrape-webpage

Scrape webpages to extract content, metadata, and local images for migration.

Updated Jan 13, 2026

Search Tags:#migration #metadata-extraction #web-scrape #image-download #html-cleanup #aem-edge

Ready to run

npx skills add https://github.com/ak8458/abc-boilerplate --skill scrape-webpage-ak8458

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/ak8458/abc-boilerplate/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/ak8458/abc-boilerplate --skill scrape-webpage-ak8458

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Scrape webpage content, extract metadata, download images, and prepare for import/migration to AEM Edge Delivery Services. Returns analysis JSON with paths, metadata, cleaned HTML, and local images.

Core Features & Use Cases

Web scraping of pages to extract content, metadata (Open Graph, JSON-LD), and images
Generates a complete migration-ready artifact set including metadata.json, cleaned HTML, screenshot, and image mappings
Supports integration with page-import workflows to streamline migration analyses

Quick Start

Run the page-analysis workflow on a target URL to obtain a ready-to-migrate package.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scrape webpage content and download images for AEM Edge migration?▼

Webpage scraping for migration extracts content, metadata, and local image assets using Playwright and Sharp. It generates a structured package containing metadata.json, cleaned HTML, a screenshot, and a local images directory ready for import.

What is included in a migration-ready asset package from a scraped webpage?▼

A migration-ready asset package includes a metadata.json file containing Open Graph and JSON-LD data, a cleaned HTML body, a full-page screenshot, and a local images directory with mapped image downloads for streamlined page-import workflows.

Does this web scraping tool require Node.js and Playwright to extract metadata?▼

Yes, this web scraping tool requires a Node.js environment because it relies on Playwright for browser automation and Sharp for image processing to extract metadata and download local image assets successfully.

How do I extract Open Graph and JSON-LD metadata from a webpage?▼

Extracting Open Graph and JSON-LD metadata from a webpage is handled automatically during the scraping process. The Skill analyzes the page structure and outputs all extracted metadata into a structured metadata.json file for migration.

Can I use this to clean HTML and download images for a page-import workflow?▼

Yes, you can use this to clean HTML and download images for a page-import workflow. It produces a cleaned HTML body and a local images directory, creating a complete artifact set that directly supports integration with migration analyses.

What's the best way to prepare web page assets for AEM Edge Delivery Services?▼

The best way to prepare web page assets for AEM Edge Delivery Services is to run a scraping workflow that extracts content, metadata, and images. This generates a structured analysis with cleaned HTML and image mappings for direct import.