Site Fetcher

Fetch website content and convert it to plain text using Mozilla Readability.

31|8|Updated Mar 15, 2026
One-click install
npx skills add https://github.com/citedy/adclaw --skill site-fetcher
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Site Fetcher
Source: https://github.com/citedy/adclaw/tree/main/src/adclaw/agents/skills/sitefetch
Command: npx skills add https://github.com/citedy/adclaw --skill site-fetcher

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Fetch entire websites or pages as clean, readable text for AI analysis, enabling better knowledge extraction, benchmarking, and content research.

Core Features & Use Cases

  • Full-site extraction: pull content from an entire domain or specific pages, stripping ads and navigation.
  • Selective targeting: apply glob patterns to fetch only relevant sections (e.g., blog, docs).
  • Output consolidation: produce a single text file with page URLs as separators for easy review.

Quick Start

Run sitefetch with a target URL to produce a single text file containing the site's readable content for analysis.

Frequently Asked Questions about Site Fetcher

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract clean text from website content for AI analysis?

To extract clean text from website content for AI analysis, you can fetch entire sites or specific pages to strip away ads and navigation clutter. The Skill uses Mozilla Readability-based extraction to produce consistent, analysis-ready plain text output, consolidating the results into a single file.

What is the best way to fetch an entire domain for a content audit?

The best way to fetch an entire domain for a content audit is to run a full-site extraction that pulls readable content while stripping boilerplate. It outputs a single text file with page URLs as separators, making the fetched website content easy to review and audit.

Can I selectively target specific sections like docs or blogs when fetching a site?

Yes, you can selectively target specific sections like docs or blogs when fetching a site by applying glob patterns. This allows you to fetch only relevant website content instead of the entire domain, producing focused plain text for your SEO research or analysis.

Does website text extraction remove navigation and ads automatically?

Yes, website text extraction removes navigation and ads automatically by using Mozilla Readability-based extraction. This mechanism strips clutter from the fetched pages, ensuring the final output is clean, readable text suitable for competitive analysis and knowledge extraction.

What format is the output saved in when fetching multiple web pages?

When fetching multiple web pages, the output format is a single text file containing the consolidated readable content. Page URLs are inserted as separators within this file, allowing you to easily identify the source of each extracted text block during your review.