site-content-catalog

Build a content inventory by crawling sitemap.xml, RSS feeds, and blog indexes to collect URLs, titles, dates, and content types. The skill classifies pages, assigns topic clusters, and outputs a structured JSON report plus a Markdown summary for SEO audits.

Crawling a sitemap and grouping pages into topic clusters is handled by discovering URLs, extracting titles and dates, classifying content types, and aggregating metrics. This process generates a publish cadence summary to support content planning and governance.

Yes, you can crawl RSS feeds and blog indexes alongside sitemap.xml to catalog a domain's content. The script uses the requests dependency to discover pages, extract metadata, and output structured JSON and Markdown summaries for content audits.

The content catalog process requires Python and the requests dependency to run. You execute the catalog_content.py script directly against your domain to discover pages, aggregate metrics by type, and generate a structured content inventory report.

The content classification works by categorizing discovered pages into content types and grouping related content into topic clusters. It then aggregates metrics by type and creates a publish cadence summary from extracted dates to support content strategy and governance.

Cataloging site content generates a structured JSON report and a Markdown summary. These outputs include URLs, titles, dates, content types, and topic clusters, formatted for direct integration into dashboards and content governance reports.