skills.rest
cocyuhao
cocyuhaoCOMMUNITY
Explore all skills by this author →
GitHub

baoyu-url-to-markdown

Fetch webpages and convert them to Markdown with YAML front matter.

1|Updated May 12, 2026
Search Tags:#automation#markdown#webpage#chrome-cdp#markdown-output#web-extraction
One-click install
npx skills add https://github.com/cocyuhao/my-ai-skills-library --skill baoyu-url-to-markdown-cocyuhao
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baoyu-url-to-markdown
Source: https://github.com/cocyuhao/my-ai-skills-library/tree/main/baoyu-url-to-markdown
Command: npx skills add https://github.com/cocyuhao/my-ai-skills-library --skill baoyu-url-to-markdown-cocyuhao

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires linkedom, @mozilla/readability, turndown, turndown-plugin-gfm, and includes scripts (resource) components.

What problem does it solve?

This skill fetches a webpage and converts it into clean, structured Markdown, including metadata when available, so you can publish or archive pages with minimal effort.

Core Features & Use Cases

  • Auto-capture mode: capture content on page load for public pages.
  • Wait-for-user mode: wait for user signal for pages behind login or lazy loading.
  • Markdown output: YAML front matter with url, title, author, published, and captured_at, followed by the converted Markdown content.
  • Real-world use: save a research article, a blog post, or a product page as Markdown for note-taking or publishing.

Quick Start

Capture a page URL to generate a markdown document that preserves the page content and metadata.

Frequently Asked Questions about baoyu-url-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a webpage to Markdown with login-protected content?▼

To convert a webpage to Markdown behind a login, use the wait-for-user mode. This mode pauses Chrome DevTools Protocol rendering, letting you manually authenticate and trigger lazy loading before capturing the Markdown output.

What is the best way to extract webpage content as a structured Markdown file?▼

The best way to extract webpage content as Markdown is using Chrome CDP for full page rendering. This approach parses the DOM, strips clutter via Readability, and converts the HTML body into clean Markdown text using Turndown.

Does Chrome CDP web extraction preserve article metadata like author and published date?▼

Yes, Chrome CDP web extraction preserves article metadata by generating YAML frontmatter. It automatically extracts and prepends the URL, title, author, published date, and captured_at timestamp to the Markdown output.

Can I use this to capture lazy-loaded webpage content for archiving?▼

Yes, you can capture lazy-loaded webpage content for archiving using the wait-for-user mode. It allows you to fully scroll and render dynamic page elements via Chrome DevTools Protocol before triggering the Markdown conversion.

How does Turndown handle GitHub Flavored Markdown for web page conversion?▼

Turndown handles GitHub Flavored Markdown for web page conversion by utilizing the turndown-plugin-gfm dependency. This ensures tables, strikethroughs, and task lists from the rendered HTML are accurately translated into the Markdown output.

Why does my webpage to Markdown conversion capture incomplete content?▼

Webpage to Markdown conversion captures incomplete content when dynamic elements or lazy loading fail to finish. Switch to wait-for-user mode to manually ensure all DOM elements fully render before triggering the Markdown extraction.

Related Skills

Explore More Content & Communication Skills→
johnlindquistjohnlindquist
16

chrome-devtools

Automate browser control and debugging via the Chrome DevTools Protocol.

Community
Advanced
lbliiilbliii
41

bengal-content-migration

Migrates static site and Markdown content to Bengal format.

Community
Intermediate
0xBigBoss0xBigBoss
53

web-fetch

Fetches web pages and converts main content into clean markdown using CSS selectors.

Community
Intermediate
0xHoneyJar0xHoneyJar
5

cloudflare-browser

Control headless Chrome via CDP over WebSocket in Cloudflare Workers.

Official
Intermediate