skills.rest
adoresever
adoreseverCOMMUNITY
Explore all skills by this author →
GitHub

web-scraping

Fetch, parse, and extract text and metadata from web pages.

202|36|Updated Jan 27, 2026
Search Tags:#data-extraction#web-scraping#multi-page#text-processing#html-parsing#link-discovery
One-click install
npx skills add https://github.com/adoresever/AGI_Ananas --skill web-scraping-adoresever
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-scraping
Source: https://github.com/adoresever/AGI_Ananas/tree/main/26.2.21openclaw-viking/.agents/skills/web-scraping
Command: npx skills add https://github.com/adoresever/AGI_Ananas --skill web-scraping-adoresever

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Fetch, parse, and extract data from web pages to reduce manual scraping effort.

Core Features & Use Cases

  • Single-page scraping: fetch content and extract text and metadata.
  • Link discovery: extract and classify links with texts and types.
  • Multi-page research: compare multiple URLs in parallel for consistency.
  • Use Case: Gather article summaries and references across a set of sources for a literature review.

Quick Start

Ask the AI to fetch a target webpage and return its cleaned text and a list of links.

Frequently Asked Questions about web-scraping

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract text and links from a webpage without external dependencies?▼

Web scraping with built-in Node.js fetch lets you extract text and links without external dependencies. It fetches pages, parses HTML, and returns structured outputs for downstream analytics.

Can I fetch and compare data from multiple web pages in parallel?▼

Web scraping supports multi-page research by fetching and comparing multiple URLs in parallel for consistency. You can gather article summaries and references across a set of sources for a literature review.

How does link discovery work when parsing HTML content?▼

Link discovery works by parsing HTML to extract and classify links with their associated texts and types. Web scraping applies this to single-page content and multi-page research tasks across diverse sites.

Do I need to install external libraries to extract data from web pages?▼

No, web scraping requires zero external dependencies because it uses Node.js built-in fetch. You can configure timeouts and extract structured data without installing additional libraries.

What is the best way to clean raw HTML text for downstream analytics?▼

Web scraping is the best way to clean raw HTML text for analytics because it fetches pages and returns cleaned text and a list of links. It offers configurable timeouts and structured outputs for downstream use.

Related Skills

Explore More Data & Analytics Skills→
darblexdarblex

web-scraping

Fetch and extract web page data using Node.js fetch and regex parsing.

Community
Intermediate
xingBaGanxingBaGan

pdf-forms-extractor

Extract data from fillable and non-fillable PDF forms using PyMuPDF.

Community
Intermediate
johnlindquistjohnlindquist
24

spider

Crawls websites with HTTP fetch, link extraction, and HTML parsing for JSON output.

Community
Intermediate
Quill-AgentQuill-Agent
3

scrapling

Automate web scraping with anti-bot bypass and JavaScript-rendered content.

Community
Advanced