skills.rest
valithedge
valithedgeCOMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Extract webpage content, metadata, and images into a migration bundle.

1|Updated Oct 7, 2024
Search Tags:#analysis#migration#images#metadata#webpage#aem#scrape
One-click install
npx skills add https://github.com/valithedge/etisalatedge --skill scrape-webpage-valithedge
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/valithedge/etisalatedge/tree/main/.agents/skills/scrape-webpage
Command: npx skills add https://github.com/valithedge/etisalatedge --skill scrape-webpage-valithedge

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Scrape webpage content, extract metadata, download images, and prepare data for migration to AEM Edge Delivery Services. Returns an analysis bundle including paths, metadata, cleaned HTML, and local images.

Core Features & Use Cases

  • Webpage analysis to produce a structured data bundle for migration
  • Image capture and local mapping for offline migration and asset management
  • Metadata extraction (title, description, Open Graph, JSON-LD) for SEO preservation

Quick Start

Run the analyze-webpage script with a target URL to generate metadata.json, cleaned HTML, and a local image map in your chosen output directory.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape webpage content and download images for AEM Edge Delivery Services migration?▼

To scrape webpage content for AEM migration, run the analyze-webpage script with a target URL. It uses Playwright to extract cleaned HTML, metadata, and local images into a structured data bundle ready for migration.

How does webpage metadata extraction preserve SEO during content migration?▼

Webpage metadata extraction preserves SEO by capturing title, description, Open Graph, and JSON-LD data. This ensures critical search ranking signals remain intact when moving content to AEM Edge Delivery Services.

What is the best way to audit webpage assets and structure before an AEM migration?▼

The best way to audit webpage assets is running the analyze-webpage script to generate metadata.json, cleaned HTML, and a local image map. This produces a structured bundle highlighting content paths and assets for migration analysis.

Do I need Playwright and Sharp installed to scrape webpage images locally?▼

Yes, Playwright and Sharp are required dependencies. Playwright drives browser automation to access and capture webpage content, while Sharp processes images locally for the offline migration asset pipeline.

Why does webpage scraping not working for dynamic JavaScript rendered content?▼

Webpage scraping handles dynamic content because Playwright provides full browser automation, executing JavaScript to render pages before extracting HTML, metadata, and images for the migration data bundle.

Related Skills

Explore More Content & Communication Skills→
namninhndnamninhnd

Playwright Browser Automation

Automate web browser interactions with Playwright via MCP server or Node.js API.

Community
Advanced
paolomozpaolomoz

scrape-webpage

Scrapes webpages and extracts metadata, images, and cleaned HTML for migration.

Community
Advanced
adobe-summit2026-l613adobe-summit2026-l613

scrape-webpage

Scrape webpage content, metadata, and images into migration-ready JSON, HTML, and local assets.

Official
Advanced
iArsalanshahiArsalanshah
7

ghostfetch

Extract webpage content from protected sites using a stealthy headless browser.

Community
Intermediate