webpage-to-md

You can convert web pages to Markdown by running the CLI with a target URL. The tool extracts main article content, transforms HTML to Markdown, and automatically downloads images to a local assets directory for offline usage.

Yes, the web-to-markdown conversion specifically supports WeChat articles and wiki index pages. It uses SSR-aware parsing to handle their rendering and exports the content into clean Markdown files with localized images.

Yes, batch crawling of wiki index pages is supported. The tool fetches multiple pages, extracts their content, and merges the Markdown outputs together, which is ideal for assembling documentation or building a unified knowledge base.

SSR-aware parsing identifies server-side rendered HTML structures to accurately extract main content while removing noise. This ensures deterministic content extraction from complex pages before converting HTML to Markdown with proper headings, tables, and code blocks.

No, you only need a lightweight dependency footprint. The tool requires just the requests and markdown libraries to perform deterministic content extraction, SSR-aware parsing, and local image downloading without heavy framework overhead.

Using YAML frontmatter when saving web pages as Markdown embeds structured metadata like source URLs and titles at the top of the file. This ensures safe URL handling and provides contextual metadata for documentation systems and knowledge bases.