scrape-webpage

Extract content, metadata, and images from webpages for migration.

Updated Jan 16, 2026

Search Tags:#migration #metadata #playwright #webpage #scrape #image-capture

Ready to run

npx skills add https://github.com/treeves/ak-test --skill scrape-webpage-treeves

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/treeves/ak-test/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/treeves/ak-test --skill scrape-webpage-treeves

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

This Skill turns the manual, error-prone process of migrating web content into an automated workflow by extracting page content, metadata, and assets for migration to AEM Edge Delivery Services or similar platforms.

Core Features & Use Cases

Extracts title, description, Open Graph, JSON-LD, and canonical metadata from a page.
Downloads images locally (converting to PNG when needed) and maps them to local paths for offline migration.
Produces a cleaned HTML payload with local image references and a complete metadata.json for downstream steps.
Use Case: You need to analyze a competitor's page and prepare a ready-to-migrate package with images and metadata.

Quick Start

Use the scrape-webpage skill to analyze a page: node .claude/skills/scrape-webpage/scripts/analyze-webpage.js "https://example.com/page" --output ./work

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract webpage content and images for migration?▼

Webpage migration extracts page content, metadata, and images using automated tools. Scrape Webpage downloads images locally, maps them to asset paths, cleans HTML references, and outputs a metadata.json payload ready for import into platforms like AEM Edge Delivery Services.

Can I use Playwright and Sharp to automate webpage scraping?▼

Yes. Playwright automates page analysis and asset discovery; Sharp handles image conversion and optimization. Together they extract Open Graph metadata, JSON-LD structured data, canonical tags, and convert images to PNG format while maintaining local asset mappings.

What metadata does webpage scraping capture?▼

Webpage scraping captures title, description, Open Graph tags, JSON-LD structured data, and canonical URLs. Scrape Webpage extracts these elements and outputs them in a structured metadata.json file alongside cleaned HTML and image reference mappings for downstream migration workflows.

How do I prepare downloaded images for offline migration?▼

Image preparation converts remote assets to local PNG files and updates HTML to reference local paths. Scrape Webpage handles this automatically: it downloads images, converts formats, maps original URLs to local asset locations, and produces a complete image-reference index.

What's the fastest way to migrate competitor pages to AEM?▼

Automated webpage scraping accelerates migration by extracting all assets, metadata, and cleaned markup in one pass. Scrape Webpage integrates with page-import orchestrators to analyze sources, prepare ready-to-import packages, and eliminate manual content re-entry and asset mapping.