web-content-fetcher

You can extract web content into Markdown by providing a URL to this fetcher. It uses Scrapling to retrieve the page, preserving headings, links, images, and code blocks in the final Markdown output.

Yes, scraping works with JavaScript-heavy sites and WeChat Official Accounts. It uses Scrapling with an automatic stealth fallback to render dynamic content and extract the article into Markdown.

Converting web pages to Markdown preserves essential structural elements like headings, links, images, lists, and code blocks. This ensures the extracted Markdown accurately reflects the original web page layout.

When fast fetching fails, Scrapling handles content extraction by falling back to a stealth mode for dynamic rendering. A secondary Jina Reader option is also available to parse simpler web pages.

No configuration is needed to scrape blogs and documentation pages into Markdown. The tool works out of the box, automatically applying fast fetching or stealth fallback to extract the main article content.