skills.rest
XiaSanw
XiaSanwCOMMUNITY
Explore all skills by this author →
GitHub

baoyu-url-to-markdown

Render web pages via Chrome CDP and save them as Markdown with HTML snapshots.

2|Updated May 25, 2026
Search Tags:#markdown#web-scraping#url-to-markdown#defuddle#markdown-conversion#html-snapshot#chromium-cdp
One-click install
npx skills add https://github.com/XiaSanw/LLM-WIKI-Xiasanw --skill baoyu-url-to-markdown-xiasanw
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baoyu-url-to-markdown
Source: https://github.com/XiaSanw/LLM-WIKI-Xiasanw/tree/main/skill/deps/baoyu-url-to-markdown
Command: npx skills add https://github.com/XiaSanw/LLM-WIKI-Xiasanw --skill baoyu-url-to-markdown-xiasanw

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @mozilla/readability, baoyu-chrome-cdp, defuddle, jsdom, linkedom, turndown, turndown-plugin-gfm, and includes scripts (resource) components.

What problem does it solve?

The skill enables automated capture of any web page by rendering it with Chrome DevTools Protocol (CDP) and converting the resulting HTML into clean Markdown, while saving a rendered HTML snapshot for fidelity.

Core Features & Use Cases

  • Chrome CDP rendering for JavaScript-rich pages and shadow DOM content.
  • Defuddle-based Markdown conversion with a legacy extractor fallback, plus YouTube transcripts when available.
  • Optional local media localization to download remote images and videos and rewrite Markdown links to local files for offline use.
  • Use Case: Archive a weekly set of product pages into a single Markdown knowledge base with accompanying HTML snapshots.

Quick Start

Run the script with a URL to capture the page and save it as Markdown alongside a rendered HTML snapshot.

Frequently Asked Questions about baoyu-url-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a JavaScript-rendered web page to markdown?▼

To convert a JavaScript-rendered web page to markdown, this skill uses Chrome DevTools Protocol (CDP) to fully render the URL and extract content, ensuring dynamic scripts and shadow DOM are captured before conversion.

Can I save web page images locally when converting HTML to markdown?▼

You can save web page images locally when converting HTML to markdown using the media localization feature, which downloads remote images and videos and rewrites markdown links to local files for offline use.

What is the best way to archive web pages as markdown with HTML snapshots?▼

The best way to archive web pages as markdown with HTML snapshots is using an automated capture tool that renders pages via Chrome CDP, converts the result with Defuddle, and saves both formats for fidelity.

Does Defuddle work for extracting YouTube transcripts into markdown?▼

Defuddle works for extracting YouTube transcripts into markdown by utilizing its conversion engine, and it includes a legacy extractor fallback to ensure content capture if the primary extraction method fails.

How do I handle dynamic content capture when web scraping to markdown?▼

To handle dynamic content capture when web scraping to markdown, the skill supports auto and wait-for-user capture modes, allowing you to control the rendering timing via Chrome CDP before saving.

Related Skills

Explore More Software Engineering Skills→
GraffiohGraffioh

web-browser

Automate Chrome browser interactions via the Chrome DevTools Protocol.

Community
Advanced
zzafergokzzafergok
1

markdown-to-html-skill

Convert Markdown documents to HTML using marked.js, pandoc, gomarkdown, or static site generators.

Community
Intermediate
kunwl123456kunwl123456
26

Web Clipper

Extract readable content from URLs and save it as Markdown files.

Community
Basic
AissenLiuAissenLiu

scrapling

Parse and extract data from web sources using Scrapling fetchers and spider framework.

Community
Advanced