webfetch-skill

To extract clean markdown from web pages for AI analysis, this skill uses trafilatura to isolate main article content and strip away navigation, ads, and boilerplate. This resilient fetching workflow ensures high-quality, readable text optimized for LLM summarization.

Yes, you can fetch and compare content from multiple URLs simultaneously. This skill supports multi-URL aggregation, allowing you to efficiently extract and compare clean markdown content from up to 5 URLs at once for comparative research tasks.

Web scraping with trafilatura handles blocked or dynamic content through resilient fetching mechanisms. The skill includes built-in caching and automatic escalation paths using requests and beautifulsoup4 to ensure robust HTML-to-markdown conversion.

The best way to isolate main article content from HTML is using trafilatura for intelligent extraction. It specifically targets and strips away boilerplate, ensuring the resulting markdown content is clean, readable, and ready for AI analysis.

Yes, you need beautifulsoup4 along with trafilatura and requests installed to convert HTML to markdown. These dependencies work together to perform robust link extraction and handle content escalation paths during the resilient web scraping workflow.