skills.rest
lgili
lgiliCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

Web Scraper

Extract text, links, and tables from public web pages.

Updated Apr 7, 2026
Search Tags:#html#links#text#tables#data-extraction#web-scraping
One-click install
npx skills add https://github.com/lgili/skillex --skill web-scraper-lgili
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Web Scraper
Source: https://github.com/lgili/skillex/tree/main/skills/web-scraper
Command: npx skills add https://github.com/lgili/skillex --skill web-scraper-lgili

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill enables you to fetch public web pages and extract clean text, links, headings, and tables without relying on external services or APIs.

Core Features & Use Cases

  • Text extraction: obtain readable body content by removing navigation, ads, and boilerplate.
  • Table and link extraction: convert HTML tables to CSV/Markdown and collect outbound links with anchor text.
  • Metadata and structure: capture the page title, metadata, and heading hierarchy for quick summaries and audits.
  • Use Case: gather data from multiple public pages for quick research notes or build lightweight content inventories.

Quick Start

Provide a public URL to scrape and specify the desired output (text, links, or tables).

Frequently Asked Questions about Web Scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract text and links from web pages without external services?▼

To extract text and links from web pages without external services, provide a public URL and specify the desired output. The skill parses HTML directly, removing navigation and boilerplate to deliver clean body content, outbound links, and tables.

Can I convert HTML tables to CSV or Markdown during web scraping?▼

Yes, you can convert HTML tables to CSV or Markdown during web scraping. The skill extracts structured table data directly from public web pages and outputs it in these formats alongside extracted text and links without requiring external APIs.

Do I need any dependencies or APIs to extract structured web content?▼

No dependencies or external APIs are needed to extract structured web content. The skill uses a robust HTML parsing workflow with zero dependencies to fetch public web pages and output text, links, and tables with optional JSON formatting.

What is the best way to gather data from multiple public pages for quick research?▼

The best way to gather data from multiple public pages for quick research is lightweight web scraping. The skill applies polite scraping rules to extract readable content, metadata, and heading hierarchies for quick summaries and content inventories.

Does this web scraper remove ads and navigation boilerplate from extracted content?▼

Yes, this web scraper removes ads and navigation boilerplate from extracted content. It applies a robust HTML parsing workflow to isolate readable body text, ensuring the output contains clean content rather than raw page elements.

When should I not use a lightweight web scraper for data extraction?▼

You should not use a lightweight web scraper for data extraction when targeting sites requiring authentication or JavaScript rendering. The skill focuses on public web pages using polite scraping rules and does not rely on external services for dynamic content.

Related Skills

Explore More Data & Analytics Skills→
ttmousettmouse
35

twitter-cleaner

Fetch complete tweet content and images from Twitter links into JSON or preview HTML.

Community
Intermediate
alibabaalibaba
10.5k

pdf-extractor

Extract text, tables, and metadata from PDF documents into JSON.

Official
Intermediate
Pans0020Pans0020

markdown-exporter

Convert Markdown content into DOCX, PPTX, XLSX, PDF, HTML, IPYNB, MD, CSV, JSON/JSONL, XML, and extracted code files.

Community
Advanced
tharunramagiritharunramagiri

agent-browser

Automate web navigation, element interaction, and data extraction via a headless browser.

Community
Advanced