website-scan

Analyze websites to generate JSON and Markdown technical reports.

Updated Mar 9, 2026
One-click install
npx skills add https://github.com/hugogu/skills --skill website-scan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: website-scan
Source: https://github.com/hugogu/skills/tree/main/openclaw-skills/website-scan
Command: npx skills add https://github.com/hugogu/skills --skill website-scan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, lxml, reportlab, and includes scripts (resource) components.

What problem does it solve?

Website teams need a single tool to gather network, content, SEO, and compliance insights from domains and pages to produce actionable reports.

Core Features & Use Cases

  • Analyze IP addresses, DNS records, and WHOIS data to map domain infrastructure.
  • Scan homepage and pages (including JavaScript-rendered) to extract metadata, structured data, crawler footprints, and accessibility signals.
  • Generate comprehensive reports (JSON/Markdown/PDF) for audits, SEO reviews, and compliance checks.

Quick Start

Run the website scanner on a target domain to generate a comprehensive report.

Frequently Asked Questions about website-scan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze website SEO and compliance signals for a technical audit?

To analyze website SEO and compliance signals, you scan target domains and subpages to extract metadata, structured data, and accessibility signals, generating comprehensive JSON or Markdown audit reports.

What is included in a comprehensive website technical report?

A comprehensive website technical report maps domain infrastructure including IP addresses, DNS records, and WHOIS data, alongside extracted content metadata, SEO footprints, and compliance signals.

Does the website scanner work with JavaScript-rendered pages?

Yes, the website scanner supports JavaScript-rendered pages by applying optional deep scans with Playwright to extract metadata and content signals from client-side rendered DOMs.

Do I need Python dependencies to run a website scan for SEO insights?

Yes, running a website scan requires Python dependencies including requests and beautifulsoup4 for HTTP fetching and parsing, with optional Playwright for rendering JavaScript and robust error handling for clear outputs.

Can I generate PDF reports from domain infrastructure and content analysis?

Yes, you can generate PDF reports from domain infrastructure and content analysis by utilizing the reportlab dependency to format network, SEO, and compliance signals into a shareable document.

What are the limitations of using beautifulsoup4 for website content extraction?

BeautifulSoup4 is limited to parsing static HTML and cannot execute JavaScript, requiring a complementary deep scan with Playwright to extract metadata and structured data from client-side rendered pages.