skills.rest
neo-unicorn
neo-unicornCOMMUNITY
Explore all skills by this author →
GitHub

baoyu-url-to-markdown

Convert web pages to Markdown with rendered HTML snapshots via Chrome CDP.

2|Updated Mar 23, 2026
Search Tags:#markdown#readability#chrome-cdp#defuddle#media-localization#url-capture#html-snapshot
One-click install
npx skills add https://github.com/neo-unicorn/neo-skills --skill baoyu-url-to-markdown-neo-unicorn
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baoyu-url-to-markdown
Source: https://github.com/neo-unicorn/neo-skills/tree/main/baoyu-url-to-markdown
Command: npx skills add https://github.com/neo-unicorn/neo-skills --skill baoyu-url-to-markdown-neo-unicorn

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @mozilla/readability, defuddle, jsdom, linkedom, turndown, turndown-plugin-gfm, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Many web pages are rendered client-side or require interaction and cannot be reliably converted to readable Markdown by simple HTML-to-text tools. This Skill captures a fully rendered DOM via Chrome CDP, preserves an HTML snapshot, and produces clean Markdown with metadata so users can archive, edit, or publish web content without losing structure or media context.

Core Features & Use Cases

  • Chrome CDP capture for JavaScript-rendered and login-protected pages, with auto or wait-for-user capture modes.
  • Saves a faithful rendered HTML snapshot alongside a Markdown document that includes YAML frontmatter (url, title, description, author, published, captured_at).
  • Defuddle-first conversion with an automatic legacy extractor fallback and quality scoring to choose the best result.
  • Optional media localization: downloads images and videos into imgs/ and videos/ directories and rewrites links.
  • Use Case: Archive an article behind a login, produce a markdown draft for editing, and keep the captured HTML for debugging or provenance.

Quick Start

Capture https://example.com/article and save a rendered HTML snapshot plus a clean markdown file in the default output directory.

Frequently Asked Questions about baoyu-url-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a JavaScript-rendered webpage to Markdown?▼

To convert a JavaScript-rendered webpage to Markdown, this tool captures the fully rendered DOM via Chrome CDP, preserving the complete client-side output before applying Defuddle or legacy extractors to produce clean text.

Can I save a Markdown snapshot of a login-protected page?▼

Yes, you can save a Markdown snapshot of a login-protected page by using Chrome CDP capture with a wait-for-user mode, allowing manual authentication before the DOM extraction and HTML archival processes begin.

Does the Markdown conversion include YAML frontmatter metadata?▼

Yes, the Markdown conversion includes YAML frontmatter metadata containing the url, title, description, author, published date, and captured_at timestamp for downstream automation and provenance tracking.

How do I localize images and videos when archiving web pages to Markdown?▼

To localize images and videos when archiving web pages, you can enable optional media localization to download media into dedicated directories and rewrite the links within the generated Markdown document.

What is the best way to capture lazy-loaded web content as clean Markdown?▼

The best way to capture lazy-loaded web content as clean Markdown is using Chrome CDP to capture the fully rendered DOM, which ensures all dynamically loaded elements are extracted before article conversion.

What happens if Defuddle fails to extract the article content?▼

If Defuddle fails to extract the article content, the system automatically falls back to a legacy extractor and uses quality scoring to choose the best result for the final Markdown document.

Related Skills

Explore More Content & Communication Skills→
eins78eins78
2

chrome-browser

Configure a dedicated Chrome for Testing environment with CDP on port 9222 for Playwright MCP.

Community
Intermediate
mkgs-databricks-demosmkgs-databricks-demos
1

databricks-mlflow-evaluation

Locate root SKILL.md files and extract YAML frontmatter metadata into YAML documents.

Official
Advanced
mbastakismbastakis
5

crawl4ai

Crawl web pages with Python and extract structured data as Markdown or JSON.

Community
Intermediate
OpenAEC-FoundationOpenAEC-Foundation
163

frappe-website-deploy

Deploy ERPNext/Frappe websites via REST API with Page Builder.

Official
Advanced