web-content-fetcher

To extract article content into Markdown, this tool fetches HTML from arbitrary URLs and converts it using a three-tier strategy: Jina Reader first, Scrapling with html2text second, and web_fetch fallback. It preserves headings, links, images, and lists for clean output.

Yes, you can extract WeChat public account articles as Markdown. The extraction strategy explicitly supports platforms like WeChat, preserving formatting structures such as headings, links, images, and lists during the HTML to Markdown conversion process.

Yes, you need to install the Python libraries scrapling and html2text. These dependencies are required to fetch web pages, render HTML, and convert the content into clean, readable Markdown output to stdout.

The best way to scrape web content while preserving headings and images is using a three-tier extraction strategy. It attempts Jina Reader first, falls back to Scrapling with html2text, and uses web_fetch to ensure robust content extraction with intact structural formatting.

Web content extraction may fail if the primary method encounters rendering issues. The fallback mechanism addresses this by moving from Jina Reader to Scrapling with html2text, and finally to a web_fetch fallback to ensure the HTML is fetched and converted to Markdown.