skills.rest
redhat-documentation
redhat-documentationOFFICIAL
Explore all skills by this author →
WebsiteGitHub

article-extractor

Download HTML from URLs and extract primary article content.

Updated Aug 23, 2026
Search Tags:#web scraping#content extraction#web content#markdown conversion#html parsing#article summarization
One-click install
npx skills add https://github.com/redhat-documentation/redhat-docs-agent-tools --skill article-extractor-redhat-documentation
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: article-extractor
Source: https://github.com/redhat-documentation/redhat-docs-agent-tools/tree/main/plugins/docs-tools/skills/article-extractor
Command: npx skills add https://github.com/redhat-documentation/redhat-docs-agent-tools --skill article-extractor-redhat-documentation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, html2text, and includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of downloading web pages and extracting only the main article content, stripping away distracting navigation, ads, and other non-essential HTML elements.

Core Features & Use Cases

  • Download HTML: Fetches content from any public URL.
  • Article Extraction: Intelligently identifies and extracts content from <article> tags, with flexible selector options.
  • Content Cleaning: Removes scripts, styles, and common UI bloat for a clean output.
  • Format Conversion: Outputs content as HTML, Markdown, or plain text.
  • Use Case: Quickly grab the core text from a long blog post or documentation page for offline reading or further processing.

Quick Start

Use the article-extractor skill to download and extract the main content from the URL "https://example.com/article".

Frequently Asked Questions about article-extractor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract article content from a web page and remove ads and navigation?▼

To extract article content and remove ads, this tool downloads HTML from a URL and isolates the primary content within <article> tags, stripping away scripts, styles, and UI elements for a clean reading experience.

Can I convert extracted HTML content to Markdown or plain text?▼

Yes, you can convert extracted HTML to Markdown or plain text. The tool processes the downloaded web page and outputs the cleaned article content in your chosen format for archival or migration.

How do I use a custom CSS selector to extract web content from specific HTML structures?▼

You can use custom CSS selectors to target specific HTML structures. This allows the content extraction process to adapt to unique page layouts when standard <article> tag identification fails.

What is the best way to strip links and clean HTML for offline article reading?▼

The best way to strip links and clean HTML for offline reading is using an automated extraction tool that removes non-essential elements and outputs the primary text as plain text or Markdown.

Do I need BeautifulSoup to parse HTML and extract web content?▼

Yes, BeautifulSoup is required to parse HTML and extract web content. The tool depends on this library alongside requests for fetching URLs and html2text for Markdown conversion.

What are the limitations of using automated web scraping for content extraction?▼

A limitation of automated web scraping for content extraction is that it relies on identifying <article> tags or custom selectors, meaning pages without clear article structures may yield incomplete results.

Related Skills

Explore More Content & Communication Skills→
zephyrwang6zephyrwang6
333

web-scraper

Fetch web page content and convert HTML to clean Markdown.

Community
Intermediate
i0switchi0switch

article-extractor

Extract clean article text from URLs and save it as a plain-text file.

Community
Intermediate
AbilityaiAbilityai
103

epub-chapter-extractor

Extract EPUB chapters into separate markdown documents.

Official
Intermediate
CrumbgrabberCrumbgrabber
3

webapp-testing

Automate local web application testing with Python Playwright scripts.

Community
Intermediate