skills.rest
Permit-Junction
Permit-JunctionOFFICIAL
Explore all skills by this author →
GitHub

scrape-webpage

Scrape webpage content, extract metadata, and download images for AEM Edge Delivery Services.

Updated Feb 15, 2026
Search Tags:#web scraping#content extraction#metadata extraction#image processing#aem migration#webpage analysis
One-click install
npx skills add https://github.com/Permit-Junction/permitjunction-website --skill scrape-webpage-permit-junction
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrape-webpage
Source: https://github.com/Permit-Junction/permitjunction-website/tree/main/.claude/skills/scrape-webpage
Command: npx skills add https://github.com/Permit-Junction/permitjunction-website --skill scrape-webpage-permit-junction

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, sharp, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of extracting content, metadata, and images from webpages, preparing them for import or migration to AEM Edge Delivery Services.

Core Features & Use Cases

  • Webpage Content Extraction: Scrapes text, HTML structure, and metadata from any given URL.
  • Image Downloading & Preparation: Downloads all images, converts them to compatible formats (like PNG), and updates HTML to reference local image paths.
  • Metadata Extraction: Captures essential metadata such as title, description, Open Graph tags, and JSON-LD.
  • Use Case: When migrating a website, use this Skill to quickly pull content from hundreds of source pages, ensuring all text and images are captured and ready for the new platform.

Quick Start

Use the scrape-webpage skill to analyze the webpage at https://example.com/about.

Frequently Asked Questions about scrape-webpage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract webpage content and images for AEM migration?▼

Webpage content extraction for migration involves scraping text, HTML structure, and metadata from a URL. This Skill automates pulling content from source pages, downloading images, and preparing cleaned HTML for AEM Edge Delivery Services import.

How do I download webpage images and update HTML to reference local paths?▼

Downloading webpage images and updating HTML references requires converting images to compatible formats like PNG and modifying the HTML structure. The Skill downloads all images locally and automatically updates the cleaned HTML to reference these local image paths.

What metadata is extracted during webpage scraping for content migration?▼

Metadata extracted during webpage scraping includes the page title, description, Open Graph tags, and JSON-LD. The Skill captures this essential metadata and returns it within an analysis JSON alongside cleaned HTML and local image paths.

Do I need Node.js, Playwright, and Sharp to scrape webpage content?▼

Yes, you need Node.js, Playwright, and Sharp to execute this webpage scraping Skill. Playwright drives the browser automation for extraction, while Sharp handles image downloading and conversion to PNG format for local storage.

Can I use this webpage scraper to migrate hundreds of source pages at once?▼

You can use this webpage scraper to migrate hundreds of source pages by executing it across target URLs. It quickly pulls text, metadata, and images from multiple pages, ensuring all assets are captured and prepared for the new platform.

What is the best way to prepare scraped webpage content for AEM Edge Delivery Services?▼

The best way to prepare scraped webpage content for AEM Edge Delivery Services is to extract text, metadata, and images while cleaning the HTML. This Skill outputs an analysis JSON containing local image paths, metadata, and cleaned HTML ready for import.

Related Skills

Explore More Software Engineering Skills→
arbory-digital-incarbory-digital-inc

scrape-webpage

Extract webpage content, metadata, and images into local assets.

Official
Intermediate
jfoxxjfoxx

scrape-webpage

Scrape webpage content, extract metadata, and download images for AEM Edge Delivery Services.

Community
Intermediate
Zedit42Zedit42

web-scraping-pro

Extracts content from JavaScript-heavy and protected websites using multiple fallback methods.

Community
Advanced
treevestreeves

scrape-webpage

Extract content, metadata, and images from webpages for migration.

Community
Advanced