Scrape webpage content, extract SEO metadata, and download images for AEM Edge Delivery migration.
npx skills add https://github.com/aemsites/koassets --skill scrape-webpage
Please help me install this Agent Skill. Skill: scrape-webpage Source: https://github.com/aemsites/koassets/tree/main/.claude/skills/scrape-webpage Command: npx skills add https://github.com/aemsites/koassets --skill scrape-webpage
This skill automates the initial data extraction phase of content migration, reliably scraping webpage content, downloading images, and extracting critical metadata. It prepares everything for import into AEM Edge Delivery Services, saving significant manual effort.
metadata.json with all extracted data, a screenshot.png, cleaned.html with local image paths, and an images/ folder, ready for the next steps in your migration workflow.Use the scrape-webpage skill to extract content, images, and metadata from "https://www.example.com/about-us" and save it to the ./import-work directory.
High-intent search queries and answers about installing and using this skill.
Web scraping extracts cleaned HTML, downloads all images with local path references, and captures metadata from any URL. This skill loads pages in a headless browser, scrolls to trigger lazy loading, and outputs metadata.json, cleaned.html with local image paths, screenshot.png, and an images folder ready for AEM Edge Delivery Services import.
Yes. This skill downloads all images during scraping, converting formats like WebP and SVG to PNG, updating DOM references to local paths, and organizing them in an images folder. All image URLs in the cleaned HTML are replaced with local references for seamless migration.
You can extract SEO-critical metadata including page title, description, Open Graph tags, JSON-LD structured data, and canonical links. This metadata is captured during scraping and saved to metadata.json, preserving valuable page information for content migration workflows.
No manual preparation is required. Provide a URL and the skill handles everything: loading the page in a headless browser with Playwright, scrolling to load lazy-loaded content, extracting cleaned HTML by removing non-content elements, downloading images, and extracting metadata automatically.
You need Node.js, npm, Playwright for headless browsing, Chromium, and Sharp for image processing. The skill outputs a complete analysis package with all dependencies met, producing metadata.json, cleaned HTML, images, and screenshots for the next phase of your migration workflow.
Yes. Beyond AEM migration, you can use webpage scraping for content analysis with locally downloaded images, extracting SEO metadata, or preparing legacy content for import into other systems. The skill is applicable for any workflow requiring comprehensive content and image extraction from URLs.
pragyaP17Scrape webpage content, extract metadata, download images, and prepare for AEM Edge Delivery Services import.
jfoxxScrape webpage content, extract metadata, and download images for AEM Edge Delivery Services.
arbory-digital-incExtract webpage content, metadata, and images into local assets.
paolomozScrapes webpages and extracts metadata, images, and cleaned HTML for migration.