Fetches and parses XML sitemaps and RSS/Atom feeds to inventory UK Parliament web pages.
npx skills add https://github.com/danbri/forgetmenot --skill fetch-sitemap-danbri
Please help me install this Agent Skill. Skill: fetch-sitemap Source: https://github.com/danbri/forgetmenot/tree/main/skills/fetch-sitemap Command: npx skills add https://github.com/danbri/forgetmenot --skill fetch-sitemap-danbri
This Skill solves the visibility gap where large portions of the UK Parliament web presence, such as corporate, visiting, and library pages, lack structured API representations. It provides a comprehensive way to inventory and track updates across over one million public web pages.
Use the fetch-sitemap skill to enumerate all public URLs from the main parliament sitemap index with a delay of 300 milliseconds between requests.
High-intent search queries and answers about installing and using this skill.
To inventory web pages without a structured REST API, you can recursively fetch and parse XML sitemaps to map the entire public web estate, including hidden corporate and library pages.
You can track content updates by monitoring RSS and Atom feeds to detect content changes and liveness across thousands of public web pages within a large domain.
Discovering non-API web content involves recursively parsing XML sitemap indexes to enumerate all public-facing URLs, bridging the visibility gap left by official REST APIs.
Yes, you need Node.js fetch capabilities to navigate managed web challenges and process large-scale URL datasets when recursively parsing XML sitemaps.
You can enumerate large web estates by implementing a delay, such as 300 milliseconds between requests, to manage server load while recursively fetching XML sitemaps.
Use XML sitemaps when large portions of a web presence lack structured API representations, providing a comprehensive way to inventory and track updates across public pages.
guaderramaValidate and generate XML sitemaps for SEO optimization.
kreuzberg-devValidate and sanitize URLs from HTML against approved schemes.
systempromptioGenerate RSS 2.0 feeds and XML sitemaps for SEO.
jaechang-hitsQuery NCBI ClinVar via E-utilities REST API for variant classifications and disease associations.
