skills.rest
salvamolaso
salvamolasoCOMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Extract webpage content, metadata, and images for AEM Edge Delivery migration.

Updated Nov 17, 2025
Search Tags:#migration#metadata#AEM#webpage#scrape#image-download
One-click install
npx skills add https://github.com/salvamolaso/movistar-poc-aem-eds --skill scrape-webpage-salvamolaso
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/salvamolaso/movistar-poc-aem-eds/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/salvamolaso/movistar-poc-aem-eds --skill scrape-webpage-salvamolaso

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

This skill analyzes a live webpage to extract content, metadata, and images for migration to AEM Edge Delivery Services, enabling SEO preservation and offline asset mapping.

Core Features & Use Cases

  • Scrape page HTML and text while preserving structure for migration
  • Download and map all images to local assets for offline migration
  • Extract metadata (title, description, Open Graph, JSON-LD) for SEO continuity
  • Produce artifacts (metadata.json, cleaned.html, and local images) for migration workflows
  • Use Case: migrate a set of pages to an AEM Edge Delivery environment with minimal manual intervention

Quick Start

Run the scrape-webpage skill on a target URL to generate metadata.json, cleaned.html, and a local images directory.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a webpage and extract metadata for AEM migration?▼

Scrape webpages to extract HTML content, metadata (title, description, Open Graph, JSON-LD), and images while preserving structure. The skill outputs metadata.json, cleaned.html, and a local images directory ready for AEM Edge Delivery Services migration workflows.

Can I download and map all images from a webpage locally?▼

Yes. The skill captures all images from a live page, maps them to local assets, and generates path references in cleaned HTML. This enables offline asset migration without broken image links in your destination environment.

What do I need to run webpage scraping with Playwright?▼

You need Node.js, Playwright for browser automation, and Sharp for image processing. The skill uses these dependencies to analyze live pages, extract DOM content, fix markup, and generate optimized local image artifacts.

How do I preserve SEO data when migrating pages?▼

The skill extracts and preserves SEO metadata including title, description, Open Graph tags, and JSON-LD structured data during page analysis. These are output in metadata.json to maintain search visibility and rich snippets after migration.

What output files does webpage scraping produce?▼

Webpage scraping produces three artifacts: metadata.json containing extracted SEO and page data, cleaned.html with corrected markup and local image paths, and an images/ folder with downloaded assets ready for migration.

Is this skill suitable for bulk page migration workflows?▼

Yes. The skill is designed for page-import workflows requiring content extraction and asset mapping across multiple pages to AEM Edge Delivery Services with minimal manual intervention.

Related Skills

Explore More Content & Communication Skills→
xdrshjrxdrshjr
1

google-image-crawler

Extract original image URLs from Google Image search results using Playwright.

Community
Advanced
treevestreeves

preview-import

Preview and validate imported HTML content in a local AEM Edge Delivery Services environment.

Community
Advanced
ComwrapUkReplyComwrapUkReply

scrape-webpage

Scrape webpages to extract content, metadata, and images for migration workflows.

Community
Advanced
okwindsokwinds
50

headless-web-viewer

Render JavaScript-heavy webpages and extract visible text with Playwright.

Community
Intermediate