skills.rest
ak8458
ak8458COMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Scrape webpages to extract content, metadata, and local images for migration.

Updated Jan 13, 2026
Search Tags:#migration#metadata-extraction#web-scrape#image-download#html-cleanup#aem-edge
One-click install
npx skills add https://github.com/ak8458/abc-boilerplate --skill scrape-webpage-ak8458
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/ak8458/abc-boilerplate/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/ak8458/abc-boilerplate --skill scrape-webpage-ak8458

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Scrape webpage content, extract metadata, download images, and prepare for import/migration to AEM Edge Delivery Services. Returns analysis JSON with paths, metadata, cleaned HTML, and local images.

Core Features & Use Cases

  • Web scraping of pages to extract content, metadata (Open Graph, JSON-LD), and images
  • Generates a complete migration-ready artifact set including metadata.json, cleaned HTML, screenshot, and image mappings
  • Supports integration with page-import workflows to streamline migration analyses

Quick Start

Run the page-analysis workflow on a target URL to obtain a ready-to-migrate package.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape webpage content and download images for AEM Edge migration?▼

Webpage scraping for migration extracts content, metadata, and local image assets using Playwright and Sharp. It generates a structured package containing metadata.json, cleaned HTML, a screenshot, and a local images directory ready for import.

What is included in a migration-ready asset package from a scraped webpage?▼

A migration-ready asset package includes a metadata.json file containing Open Graph and JSON-LD data, a cleaned HTML body, a full-page screenshot, and a local images directory with mapped image downloads for streamlined page-import workflows.

Does this web scraping tool require Node.js and Playwright to extract metadata?▼

Yes, this web scraping tool requires a Node.js environment because it relies on Playwright for browser automation and Sharp for image processing to extract metadata and download local image assets successfully.

How do I extract Open Graph and JSON-LD metadata from a webpage?▼

Extracting Open Graph and JSON-LD metadata from a webpage is handled automatically during the scraping process. The Skill analyzes the page structure and outputs all extracted metadata into a structured metadata.json file for migration.

Can I use this to clean HTML and download images for a page-import workflow?▼

Yes, you can use this to clean HTML and download images for a page-import workflow. It produces a cleaned HTML body and a local images directory, creating a complete artifact set that directly supports integration with migration analyses.

What's the best way to prepare web page assets for AEM Edge Delivery Services?▼

The best way to prepare web page assets for AEM Edge Delivery Services is to run a scraping workflow that extracts content, metadata, and images. This generates a structured analysis with cleaned HTML and image mappings for direct import.

Related Skills

Explore More Software Engineering Skills→
arbory-digital-incarbory-digital-inc

scrape-webpage

Extract webpage content, metadata, and images into local assets.

Official
Intermediate
juricamigac-from-hrjuricamigac-from-hr

preview-import

Preview and validate imported HTML content on a local AEM Edge Delivery Services dev server.

Official
Intermediate
paolomozpaolomoz

scrape-webpage

Scrapes webpages and extracts metadata, images, and cleaned HTML for migration.

Community
Advanced
usemanusaiusemanusai

web-reader

Extracts web page content, metadata, and HTML using the jaegis-sdk.

Community
Intermediate