web-to-markdown

Batch-convert JavaScript-rendered web pages to a timestamped Markdown file.

4|Updated Oct 6, 2025
One-click install
npx skills add https://github.com/otrebu/agents --skill web-to-markdown-otrebu
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-to-markdown
Source: https://github.com/otrebu/agents/tree/main/plugins/knowledge-work/skills/web-to-markdown
Command: npx skills add https://github.com/otrebu/agents --skill web-to-markdown-otrebu

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires turndown, playwright, chalk, ora, and includes scripts (resource) components.

What problem does it solve?

Batch-capture web pages with a headless browser, convert HTML to Markdown, and save a timestamped scratchpad file for documentation.

Core Features & Use Cases

  • Headless Rendering: Handles JavaScript-rendered pages via Playwright.
  • HTML to Markdown: Uses Turndown for readable output.
  • Batch Processing: All URLs saved to a single timestamped file.

Quick Start

cd skills/web-to-markdown pnpm tsx scripts/scrape-and-convert.ts <url1> [url2] ...

Frequently Asked Questions about web-to-markdown

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert web pages to Markdown automatically?

Web-to-markdown batch-processes multiple URLs with a headless browser, extracts content rendered by JavaScript, converts HTML to Markdown using Turndown, and saves all results to a single timestamped file. Run `pnpm tsx scripts/scrape-and-convert.ts <url1> [url2] ...` from the skill directory.

Can I capture JavaScript-rendered pages and convert them to Markdown?

Yes. Playwright handles JavaScript-rendered content by executing scripts before extraction, then Turndown converts the full DOM to clean Markdown. This handles dynamic pages that static HTML parsing cannot.

What's the best way to batch-process multiple URLs into a single Markdown file?

Pass all URLs as arguments to the scrape-and-convert script in one command. It processes them sequentially, consolidates output into a single timestamped Markdown file stored at `docs/web-captures/YYYYMMDD_HHMMSS.md` with deterministic formatting.

When should I use Turndown for HTML-to-Markdown conversion?

Turndown is ideal when you need readable, semantic Markdown output from HTML—useful for documentation capture, content archiving, and save-web-content workflows where preserving structure and links matters more than raw HTML.

Does this Skill handle error handling for failed URL captures?

The skill includes robust error handling with sequential processing, so failures on individual URLs do not halt the batch. Errors are logged, and successfully captured pages are still saved to the output file.