skills.rest
zeerd
zeerdCOMMUNITY
Explore all skills by this author →
Website𝕏@emneg_zeerdGitHub

zclaw-web-content-fetcher

Extract web page content into clean Markdown with headings, links, images, and lists.

1|Updated Mar 16, 2026
Search Tags:#markdown#playwright#scraping#web-content#weixin#scrapling#html2text
One-click install
npx skills add https://github.com/zeerd/zClaw-Skills --skill zclaw-web-content-fetcher
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: zclaw-web-content-fetcher
Source: https://github.com/zeerd/zClaw-Skills/tree/main/skills/zclaw-web-content-fetcher
Command: npx skills add https://github.com/zeerd/zClaw-Skills --skill zclaw-web-content-fetcher

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires scrapling[fetchers], html2text, playwright, and includes scripts (resource) components.

What problem does it solve?

Manually extracting and formatting web article content is tedious and error-prone. This skill automatically retrieves the main article content from URLs and converts it into clean Markdown, preserving headings, links, images, and lists, and supports sources like WeChat articles and Weibo posts.

Core Features & Use Cases

  • Extracts and converts web pages into Markdown with headings, links, images, and lists.
  • Uses a three-tier extraction strategy: Playwright for dynamic pages, Scrapling+html2text for broad coverage (including many blogs), and web_fetch as a static fallback.
  • Preserves titles, URLs, images, and list structures for easy reuse in notes, docs, or content pipelines.

Quick Start

Tell me a URL to fetch and I will return its clean Markdown content.

Frequently Asked Questions about zclaw-web-content-fetcher

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert web page content into Markdown format?▼

To convert web page content into Markdown, this skill extracts the main article text from URLs while preserving headings, links, images, and lists. It outputs structured Markdown suitable for notes and documentation.

Can I extract content from dynamic web pages using Playwright?▼

Yes, you can extract content from dynamic web pages using Playwright. It serves as the primary extraction tier for dynamic content, ensuring JavaScript-rendered pages are fully loaded before converting them to Markdown.

Does this tool support scraping WeChat articles and Weibo posts?▼

Yes, this tool supports scraping WeChat articles and Weibo posts. It applies a three-tier extraction strategy to successfully retrieve and convert social media posts into clean Markdown.

What is the best way to scrape static HTML and convert it to Markdown?▼

The best way to scrape static HTML is using the web_fetch fallback or Scrapling with html2text. These tiers provide broad coverage for static pages and convert them into clean Markdown.

Why does web scraping fail to preserve headings and images in Markdown?▼

Web scraping often fails to preserve headings and images due to simplistic extractors. This skill uses Scrapling and html2text to accurately retain titles, URLs, images, and list structures in the final Markdown output.

Related Skills

Explore More Content & Communication Skills→
darblexdarblex

web-scraping

Fetch and extract web page data using Node.js fetch and regex parsing.

Community
Intermediate
JongsixJongsix

moai-docs-generation

Generate technical documentation from source code and API definitions.

Community
Advanced
liumeixinliumeixin
4

html-screenshot-image-gen

Render HTML templates in a browser and capture screenshots as images.

Community
Advanced
amedinaamedina

Translator API

Translate text and detect languages on-device using Chrome's built-in AI APIs.

Community
Intermediate