skills.rest
athina-ai
athina-aiOFFICIAL
Explore all skills by this author →
WebsiteGitHub

web-archive-scraper

Search the Wayback Machine CDX API for historical website snapshots and extract cached page content.

1.1k|200|Updated Mar 2, 2026
Search Tags:#monitoring#web scraping#historical data#internet archive#wayback machine#content recovery
One-click install
npx skills add https://github.com/athina-ai/goose-skills --skill web-archive-scraper
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-archive-scraper
Source: https://github.com/athina-ai/goose-skills/tree/main/skills/capabilities/web-archive-scraper
Command: npx skills add https://github.com/athina-ai/goose-skills --skill web-archive-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, and includes scripts (resource) components.

What problem does it solve?

This Skill helps you find and retrieve information from past versions of websites, even if they no longer exist or have been significantly altered.

Core Features & Use Cases

  • Historical Data Recovery: Access cached content from the Wayback Machine, useful for recovering testimonials, customer lists, or partner directories from defunct or updated sites.
  • Change Tracking: Monitor how website content and messaging have evolved over time.
  • Use Case: Recover a list of customers from a competitor's website that has recently gone offline by searching the Wayback Machine for archived versions of their customer page.

Quick Start

Search the Wayback Machine for all snapshots of the URL "https://botkeeper.com/customers" and fetch the content of the most recent one.

Frequently Asked Questions about web-archive-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I recover content from a website that has gone offline?▼

To recover content from a website that has gone offline, this Skill searches the Wayback Machine using the CDX API to retrieve historical snapshots and extract cached page content like customer lists or testimonials.

Can I track how website messaging has changed over time using the Wayback Machine?▼

Yes, you can track how website messaging has changed over time by retrieving and comparing historical snapshots from the Wayback Machine, allowing you to monitor content evolution from past versions of the target site.

Do I need an API key to retrieve historical snapshots from the Wayback Machine CDX API?▼

You do not need an API key to retrieve historical snapshots. The Skill utilizes the free Wayback Machine CDX API, which requires no authentication and operates within a rate limit of approximately 15 requests per minute.

What is the best way to extract a customer list from an archived version of a site?▼

The best way to extract a customer list from an archived site is to search the Wayback Machine CDX API for past snapshots of the specific URL, then fetch and parse the content of the most recent valid archived page.

What are the limitations of using the Wayback Machine CDX API for web scraping?▼

The main limitation of using the Wayback Machine CDX API for web scraping is the rate limit of approximately 15 requests per minute, which affects the speed of bulk data extraction and historical snapshot retrieval.

Does web-archive-scraper work with the requests library for content recovery?▼

Yes, web-archive-scraper works with the requests library to query the Wayback Machine CDX API and perform content recovery from historical snapshots without requiring additional scraping dependencies.

Related Skills

Explore More Content & Communication Skills→
ArianHobson333ArianHobson333
7

web-archive-analysis

Query the Wayback Machine CDX API to identify technology migrations from historical snapshots.

Community
Intermediate
maxvaegamaxvaega
146

json-parser

Parse and validate JSON data against schemas and JSONPath queries.

Community
Intermediate
Im5tuIm5tu
6

programmatic-seo

Generate SEO-driven pages at scale using templates and data.

Community
Advanced
irahardiantoirahardianto
150

browser-automation

Automate browser interactions with Playwright MCP for E2E testing and web data extraction.

Community
Advanced