salesforce-help-site-scraper

To convert Salesforce Help articles to Markdown, run the scraper script with a target URL and output path to handle consent banners and extract clean content. It uses Playwright for rendering and Readability for content sanitization.

Scraping dynamically rendered pages blocked by consent banners requires automated browser interaction and content cleanup. The scraper uses Playwright to render pages and handle consent prompts, then applies Readability and Turndown to extract clean Markdown.

Yes, this Salesforce help site scraper requires Node.js 18 or higher. It relies on Playwright, jsdom, Readability, and Turndown to handle dynamic rendering, content extraction, and Markdown conversion within a modern Node.js runtime.

Yes, you can batch convert multiple Salesforce Help articles by pointing the scraper at multiple target URLs. It supports single-article and batch workflows, applying configurable consent handling and content cleanup across the entire article set.

The best way to remove headers and footers when scraping web content to Markdown is using Mozilla Readability with jsdom for content sanitization. This strips non-essential chrome and preserves core article structure for clean Markdown output.

Web scrapers fail to extract content from dynamically rendered Salesforce pages because content loads via JavaScript or is hidden behind consent banners. Using a headless browser like Playwright renders the page fully and handles consent prompts before extraction.