skills.rest
812lcl
812lclCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

baoyu-url-to-markdown

Fetch URLs via Chrome CDP and export Markdown with HTML snapshots.

Updated May 18, 2018
Search Tags:#markdown#transcripts#html-to-markdown#chrome-cdp#web-capture#defuddle
One-click install
npx skills add https://github.com/812lcl/dotfiles --skill baoyu-url-to-markdown-812lcl
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baoyu-url-to-markdown
Source: https://github.com/812lcl/dotfiles/tree/main/.agents/skills/baoyu-url-to-markdown
Command: npx skills add https://github.com/812lcl/dotfiles --skill baoyu-url-to-markdown-812lcl

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires defuddle, jsdom, linkedom, turndown, turndown-plugin-gfm, baoyu-chrome-cdp, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates turning arbitrary web pages into portable Markdown documents, capturing the rendered HTML snapshot and preserving page metadata for easy archiving and knowledge capture.

Core Features & Use Cases

  • Chrome CDP-based rendering for JavaScript-heavy pages, ensuring faithful content.
  • Two capture modes: auto on page load or wait-for-user, with optional YouTube transcript extraction and media handling.
  • Outputs two files per run: a Markdown document with YAML front matter and a corresponding -captured.html snapshot for fidelity.
  • Defuddle-based conversion with a fallback to the legacy extractor, and a hosted API fallback if local capture fails.
  • Optional download of remote media to local imgs/ and videos/ with rewritten links for offline use.

Quick Start

Provide a URL to fetch; the tool will output a Markdown document with an accompanying HTML snapshot.

Frequently Asked Questions about baoyu-url-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a JavaScript-heavy web page to Markdown?▼

To convert a JavaScript-heavy web page to Markdown, this Skill fetches the URL via Chrome CDP to fully render the page before extracting clean Markdown content. This ensures faithful content capture from dynamic single-page applications.

Can I extract YouTube transcripts and download media when converting HTML to Markdown?▼

Yes, you can extract YouTube transcripts and download media when converting HTML to Markdown. The tool optionally downloads remote media to local directories and rewrites links for offline use, supporting both auto-capture and user-signal modes.

Does this web page to Markdown converter preserve the original HTML snapshot?▼

Yes, this web page to Markdown converter saves a corresponding HTML snapshot alongside the Markdown document. It outputs two files per run, preserving page metadata and original fidelity for easy archiving and knowledge capture.

What is the best way to archive web pages with YAML front matter for knowledge capture?▼

The best way to archive web pages with YAML front matter is using a Chrome CDP-based capture tool that exports a portable Markdown document with embedded metadata. This approach preserves page structure and metadata for easy knowledge archiving.

Why does my HTML to Markdown conversion fail on dynamic content and is there a fallback?▼

HTML to Markdown conversion may fail on dynamic content due to rendering issues, but this tool includes a Defuddle-based converter with a legacy extractor fallback. If local capture fails entirely, a hosted API fallback processes the page.

Do I need Chrome or Chromium installed to capture web pages as Markdown?▼

Yes, you need Chrome or Chromium installed to capture web pages as Markdown because the tool relies on Chrome CDP for rendering JavaScript-heavy pages. This browser dependency ensures accurate content extraction from dynamic web applications.

Related Skills

Explore More Software Engineering Skills→
proffesor-for-testingproffesor-for-testing
436

compatibility-testing

Validate web application compatibility across browsers and devices with Playwright and BrowserStack.

Community
Advanced
anam-organam-org
118

docs-page-frontmatter

Generate YAML front matter with title and description fields for documentation pages.

Official
Basic
venhdevvenhdev

url-to-markdown

Convert public web page URLs into clean Markdown files.

Community
Intermediate
Wike-CHIWike-CHI
2

web-content-fetcher

Fetch blocked webpage content as markdown via r.jina.ai, markdown.new, or defuddle.md.

Community
Basic