skills.rest
thojava
thojavaCOMMUNITY
Explore all skills by this author →
GitHub

scrape-webpage

Extract webpage content, metadata, and local images for CMS migration.

Updated Apr 8, 2026
Search Tags:#playwright#web-scraping#metadata-extraction#image-download#html-cleanup#aem-migration
One-click install
npx skills add https://github.com/thojava/baco --skill scrape-webpage-thojava
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/thojava/baco/tree/main/.skills/scrape-webpage
Command: npx skills add https://github.com/thojava/baco --skill scrape-webpage-thojava

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) components.

What problem does it solve?

Scrape a web page to extract its content, metadata, and assets, and prepare them for migration to a CMS or edge-delivery workflow.

Core Features & Use Cases

  • Extract page content and metadata (title, description, Open Graph, JSON-LD) for SEO preservation during migration.
  • Download and map local images (with format normalization) to an assets folder for offline usage.
  • Produce a cleaned HTML reference and a complete analysis JSON with paths, image mappings, and file locations for import tooling.

Quick Start

Analyze a page by running the provided script to generate metadata.json, cleaned HTML, and local image mappings for migration.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract page content and metadata for a CMS migration?▼

Web scraping for CMS migration extracts page content, metadata, and local image assets to prepare them for import. It generates a cleaned HTML file, a metadata.json, and an image map to preserve SEO data like Open Graph and JSON-LD.

How do I download and map local images during a web scraping migration?▼

Downloading and mapping local images during web scraping fetches image assets, normalizes formats, and saves them to an assets folder. This produces an image map linking local files for offline usage and CMS import.

Does Playwright work for extracting JSON-LD and Open Graph metadata from web pages?▼

Playwright works for extracting JSON-LD and Open Graph metadata by analyzing fetched web page content. It outputs a structured metadata.json file that preserves SEO data for end-to-end CMS migration workflows.

Can I use web scraping tools to generate a screenshot and cleaned HTML for AEM migration?▼

Web scraping tools can generate a screenshot and cleaned HTML for AEM migration. They analyze the webpage and output deterministic results with structured paths, treating fetched content as untrusted for CMS import.

What are the limitations of using Playwright for web scraping untrusted content?▼

Using Playwright for web scraping untrusted content treats fetched pages as untrusted and outputs deterministic results. It focuses on metadata extraction and image normalization rather than executing arbitrary dynamic page scripts.

What is the best way to normalize image formats when scraping web pages?▼

The best way to normalize image formats when scraping web pages is using a dependency like Sharp. It processes downloaded image assets to ensure consistent formats for local storage and CMS import mapping.

Related Skills

Explore More Software Engineering Skills→
paolomozpaolomoz

scrape-webpage

Scrapes webpages and extracts metadata, images, and cleaned HTML for migration.

Community
Advanced
ak8458ak8458

scrape-webpage

Scrape webpages to extract content, metadata, and local images for migration.

Community
Advanced
adobe-summit2026-l613adobe-summit2026-l613

scrape-webpage

Scrape webpage content, metadata, and images into migration-ready JSON, HTML, and local assets.

Official
Advanced
EisonMeEisonMe
57

newspaper-brief

Convert raw content or summaries into mobile-friendly newspaper-style HTML and PNG images.

Community
Intermediate