web-content-scraper

To extract web content as markdown with image attribution, provide a URL to scrape. The Skill uses a headless Playwright pipeline to isolate the main article, remove boilerplate like ads, and export the text alongside an image attribution manifest.

Yes, this web scraper works with documentation pages and care guides by targeting common content regions and removing boilerplate. It is robust to site variations, making it suitable for scraping blogs and documentation to build a local knowledge base.

Yes, you can use Playwright to scrape dynamic web pages for AI context. The Skill relies on a headless Playwright-based rendering pipeline to fully load page content, capture images with correct sources, and deliver clean markdown.

The best way to download images and preserve source URLs during content extraction is using a pipeline that captures image metadata directly from the rendered DOM. This Skill downloads relevant images with alt text and exports an attribution manifest.

Web scraping often captures ads and navigation elements because standard fetch methods pull the entire page HTML. This Skill solves that by targeting common content regions and filtering noise to deliver only the main article content.