Web Scraper

Extract text, links, and tables from public web pages.

Updated Apr 7, 2026

Search Tags:#html #links #text #tables #data-extraction #web-scraping

Ready to run

npx skills add https://github.com/lgili/skillex --skill web-scraper-lgili

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: Web Scraper
Source: https://github.com/lgili/skillex/tree/main/skills/web-scraper
Command: npx skills add https://github.com/lgili/skillex --skill web-scraper-lgili

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill enables you to fetch public web pages and extract clean text, links, headings, and tables without relying on external services or APIs.

Core Features & Use Cases

Text extraction: obtain readable body content by removing navigation, ads, and boilerplate.
Table and link extraction: convert HTML tables to CSV/Markdown and collect outbound links with anchor text.
Metadata and structure: capture the page title, metadata, and heading hierarchy for quick summaries and audits.
Use Case: gather data from multiple public pages for quick research notes or build lightweight content inventories.

Quick Start

Provide a public URL to scrape and specify the desired output (text, links, or tables).

Frequently Asked Questions about Web Scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract text and links from web pages without external services?▼

To extract text and links from web pages without external services, provide a public URL and specify the desired output. The skill parses HTML directly, removing navigation and boilerplate to deliver clean body content, outbound links, and tables.

Can I convert HTML tables to CSV or Markdown during web scraping?▼

Yes, you can convert HTML tables to CSV or Markdown during web scraping. The skill extracts structured table data directly from public web pages and outputs it in these formats alongside extracted text and links without requiring external APIs.

Do I need any dependencies or APIs to extract structured web content?▼

No dependencies or external APIs are needed to extract structured web content. The skill uses a robust HTML parsing workflow with zero dependencies to fetch public web pages and output text, links, and tables with optional JSON formatting.

What is the best way to gather data from multiple public pages for quick research?▼

The best way to gather data from multiple public pages for quick research is lightweight web scraping. The skill applies polite scraping rules to extract readable content, metadata, and heading hierarchies for quick summaries and content inventories.

Does this web scraper remove ads and navigation boilerplate from extracted content?▼

Yes, this web scraper removes ads and navigation boilerplate from extracted content. It applies a robust HTML parsing workflow to isolate readable body text, ensuring the output contains clean content rather than raw page elements.

When should I not use a lightweight web scraper for data extraction?▼

You should not use a lightweight web scraper for data extraction when targeting sites requiring authentication or JavaScript rendering. The skill focuses on public web pages using polite scraping rules and does not rely on external services for dynamic content.