skills.rest
ARCASSystems
ARCASSystemsCOMMUNITY
Explore all skills by this author →
GitHub

web-fetch-extract

Fetch and extract structured data from public web pages using Python scripts.

2|Updated Apr 20, 2026
Search Tags:#structured data#data extraction#data collection#web scraping#web page analysis
One-click install
npx skills add https://github.com/ARCASSystems/FounderOS --skill web-fetch-extract
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-fetch-extract
Source: https://github.com/ARCASSystems/FounderOS/tree/main/skills/web-fetch-extract
Command: npx skills add https://github.com/ARCASSystems/FounderOS --skill web-fetch-extract

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires httpx, selectolax, tenacity, playwright, and includes scripts (resource) components.

What problem does it solve?

This Skill simplifies the process of fetching and extracting data from web pages, eliminating the need for manual data entry and reducing time spent on data collection.

Core Features & Use Cases

  • Web Data Fetching: Retrieve data from any public web page.
  • Data Extraction: Extract structured data such as bios, leadership teams, prices, OpenGraph tags, page titles, recent posts, and more.
  • Use Case: Quickly obtain the title and meta description of a webpage or extract a list of recent blog posts.

Quick Start

Fetch the structured data from 'https://example.com' and extract the 'title' and 'meta description'.

Frequently Asked Questions about web-fetch-extract

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data like page titles and meta descriptions from a public web page?▼

This approach fetches and parses HTML content from public web pages to retrieve structured data like bios, prices, OpenGraph tags, page titles, and recent posts without manual entry.

Can I use Python with selectolax and httpx for web scraping public pages?▼

Yes, you can use Python with selectolax and httpx for web scraping, utilizing these libraries to fetch HTML and parse structured data efficiently from any public web page for data collection purposes.

What's the best way to collect OpenGraph tags and recent blog posts for marketing analysis?▼

The best way to collect OpenGraph tags and recent posts for marketing analysis is using Python scripts that fetch and parse HTML content, directly extracting the needed structured data from public web pages.

Does web scraping with Python require playwright to extract data from standard HTML pages?▼

Extracting data from standard public HTML pages primarily requires httpx and selectolax for fetching and parsing, while playwright is included as a dependency for scenarios requiring dynamic content rendering.

How does tenacity help with fetching data from web pages that fail to load?▼

Tenacity provides retry logic during the web page fetching process, ensuring that transient network failures do not interrupt data extraction and allowing scripts to reliably retrieve HTML content.

Are there limitations when using Python scripts to extract data from public web pages?▼

Limitations include being restricted to public web pages and potential blocking by target servers, meaning this method is suitable for accessible content but may not work behind logins or aggressive anti-scraping protections.

Related Skills

Explore More Data & Analytics Skills→
zhayujiezhayujie
46.4k

web-fetch

Fetch web page HTML and extract title and readable text.

Community
Basic
imehrimehr
1

Amplifier Learner Tools

Log AI executions and learn from feedback using JSONL logs and JSON recommendations.

Community
Intermediate
UncodierUncodier

frontend-blog-seo

Fetch public content and generate SEO-optimized blog pages with semantic HTML.

Community
Intermediate
appautomatonappautomaton
18

html-to-markdown

Converts HTML or live web pages into structured Markdown with metadata and link inventories.

Official
Intermediate