trafilatura-web-reader

Name: trafilatura-web-reader
Availability: InStock
Author: mordechai30

Fetch web pages and extract main content and metadata as Markdown.

Updated Aug 27, 2026

Search Tags:#automation #markdown #trafilatura #extraction #web-scraping #content-processing

Ready to run

npx skills add https://github.com/mordechai30/.agents --skill trafilatura-web-reader

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: trafilatura-web-reader
Source: https://github.com/mordechai30/.agents/tree/main/skills/trafilatura-web-reader
Command: npx skills add https://github.com/mordechai30/.agents --skill trafilatura-web-reader

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires trafilatura, and includes scripts (resource) components.

What problem does it solve?

This skill solves the challenge of extracting clean, readable text and metadata from complex web pages while avoiding the overhead and instability of interactive browser automation.

Core Features & Use Cases

Content Extraction: Converts messy HTML into clean Markdown, JSON, or plain text by stripping away boilerplate, navigation, and ads.
Metadata Retrieval: Automatically captures page titles, authors, and publication dates.
Use Case: Use this to ingest documentation, blog posts, or articles into your context window while maintaining a low token count and high signal-to-noise ratio.

Quick Start

Use the trafilatura-web-reader skill to fetch and convert the content of a specific URL into clean Markdown.

Frequently Asked Questions about trafilatura-web-reader

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract clean text from web pages without using a browser?▼

To extract clean text from web pages without a browser, this skill uses the Trafilatura library to fetch URLs and convert HTML directly into Markdown or plain text. It strips away boilerplate and ads to provide high signal-to-noise content.

What is the best way to convert HTML to Markdown for AI context windows?▼

The best way to convert HTML to Markdown while minimizing token overhead is using precision-based extraction tools like Trafilatura. It automatically removes navigation and boilerplate, ensuring only the main article content enters your context window.

Can I extract metadata like authors and dates from articles automatically?▼

Yes, you can automatically extract metadata like authors, titles, and publication dates from articles. The content extraction process automatically captures this structured data alongside the main text during the HTML conversion.

Do I need the Trafilatura Python package to extract web content?▼

Yes, you need the Trafilatura Python package installed to perform precision-based HTML-to-Markdown conversion and fallback extraction. This dependency is required for the skill to fetch and process web pages.

Does web scraping with Trafilatura work for interactive JavaScript pages?▼

No, web scraping with Trafilatura does not work for interactive JavaScript pages. It is designed specifically for non-interactive web pages to avoid the overhead and instability of browser automation.