skills.rest
liangdabiao
liangdabiaoCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

baoyu-url-to-markdown

Fetch URLs via Chrome CDP and convert rendered HTML to Markdown.

133|19|Updated Apr 29, 2026
Search Tags:#automation#markdown#wiki#web-scraping#chrome-cdp#defuddle
One-click install
npx skills add https://github.com/liangdabiao/llm-wiki --skill baoyu-url-to-markdown-liangdabiao
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baoyu-url-to-markdown
Source: https://github.com/liangdabiao/llm-wiki/tree/main/.claude/skills/llm-wiki-skill/deps/baoyu-url-to-markdown
Command: npx skills add https://github.com/liangdabiao/llm-wiki --skill baoyu-url-to-markdown-liangdabiao

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @mozilla/readability, baoyu-chrome-cdp, defuddle, jsdom, linkedom, turndown, turndown-plugin-gfm, and includes scripts (resource) components.

What problem does it solve?

Automatically fetches a web page via Chrome DevTools Protocol, renders the page, and converts it into a clean, structured Markdown document with a paired HTML snapshot for offline use.

Core Features & Use Cases

  • Chrome CDP-powered rendering for JS-heavy websites, ensuring accurate content capture.
  • Generates Markdown with YAML front matter and saves a corresponding -captured.html snapshot.
  • Supports optional media localization and wait-for-user capture mode to handle authenticated or lazy-loading pages.
  • Ideal for building personal knowledge bases, wikis, or research notes from diverse sources (web articles, feeds, PDFs, and local files).

Quick Start

Run the tool against a URL to generate a Markdown document and its HTML snapshot for your wiki.

Frequently Asked Questions about baoyu-url-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a web page to Markdown with YAML front matter?▼

To convert web pages to Markdown with YAML front matter, this tool fetches URLs via Chrome CDP, renders the HTML, and uses Defuddle or legacy extractors to output clean structured documents.

Can I scrape JavaScript-heavy websites and save them as offline wiki content?▼

Yes, scraping JavaScript-heavy websites for offline wiki content uses Chrome DevTools Protocol to fully render pages before extracting text, ensuring accurate capture of dynamic elements into Markdown archives.

What is the best way to archive web articles into a personal knowledge base?▼

Archiving web articles into a personal knowledge base is best handled by capturing rendered HTML snapshots and converting them into Markdown files with optional local media localization for offline access.

Does converting URL to Markdown support wait-for-user capture for authenticated pages?▼

Yes, converting URLs to Markdown supports a wait-for-user capture mode, allowing you to manually log in or interact with authenticated and lazy-loading pages before the HTML snapshot is saved.

Why use Chrome CDP with Defuddle instead of standard web scraping for Markdown conversion?▼

Using Chrome CDP with Defuddle ensures JavaScript rendering executes properly before extraction, overcoming the limitations of standard web scraping tools that fail on dynamic content and complex layouts.

Do I need Chrome installed to generate Markdown from web pages?▼

Yes, you need Chrome or Chromium installed because the tool relies on Chrome DevTools Protocol to render pages, capture HTML snapshots, and subsequently convert the content into Markdown format.

Related Skills

Explore More Software Engineering Skills→
XiaSanwXiaSanw
2

baoyu-url-to-markdown

Render web pages via Chrome CDP and save them as Markdown with HTML snapshots.

Community
Advanced
anam-organam-org
118

docs-page-frontmatter

Generate YAML front matter with title and description fields for documentation pages.

Official
Basic
sdyckjq-labsdyckjq-lab
2.3k

baoyu-url-to-markdown

Convert web pages to markdown using the Chrome DevTools Protocol.

Community
Advanced
badlogicbadlogic
2.3k

browser-tools

Automate Chrome browser control and content extraction via the Chrome DevTools Protocol.

Community
Advanced