scrape-webpage

To scrape webpage content for migration, run the analyze-webpage script against a target URL. It renders the page to capture metadata, downloads local images, and outputs a metadata.json file alongside cleaned HTML for downstream processing.

Yes, Playwright is required for webpage scraping to properly render JavaScript and capture the full page. It enables the extraction of dynamic content, metadata, and full-page screenshots before generating the cleaned HTML and image map.

Yes, this skill downloads webpage images locally and generates a mapping from original URLs to local paths. This image harvesting creates an offline image map and updates cleaned HTML references to ensure migration readiness.

Extracting Open Graph and JSON-LD metadata is best handled by an automated scraping script that renders the target page. It retrieves essential page metadata and outputs a structured metadata.json payload for downstream consumption.

During webpage scraping, sharp processes downloaded images to handle format conversion locally. It ensures harvested images are properly formatted and mapped before being referenced in the cleaned HTML output for migration workflows.

Limitations when scraping cleaned HTML include dependency on Playwright for rendering dynamic content and sharp for image processing. The output is structured for migration readiness, but complex JavaScript interactions may not fully execute during the static capture.