salesforce-help-site-scraper

Convert Salesforce Help articles into clean Markdown snapshots.

27|9|Updated Aug 8, 2025

Search Tags:#markdown #research #help #salesforce #web-scraping #consent #content-cleanup

Ready to run

npx skills add https://github.com/taurgis/sfcc-dev-mcp --skill salesforce-help-site-scraper

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: salesforce-help-site-scraper
Source: https://github.com/taurgis/sfcc-dev-mcp/tree/main/.github/skills/salesforce-help-site-scraper
Command: npx skills add https://github.com/taurgis/sfcc-dev-mcp --skill salesforce-help-site-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, @mozilla/readability, jsdom, turndown, and includes scripts (resource) components.

What problem does it solve?

Salesforce Help articles often render behind dynamic content or consent banners, making them hard to snapshot for research or documentation. This skill converts those articles into clean, readable Markdown snapshots that preserve structure and essential details.

Core Features & Use Cases

Automated extraction of Salesforce Help articles into clean Markdown for offline research and offline documentation.
Built-in consent handling and content cleanup to remove headers, footers, and chrome while preserving article content.
Supports both single-article extractions and batch workflows by pointing at individual URLs or multiple targets.

Quick Start

Run the scraper using node skills/salesforce-help-site-scraper/scripts/scrape-help-to-markdown.js with a Help article URL and an output Markdown path.

Frequently Asked Questions about salesforce-help-site-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I convert Salesforce Help articles to Markdown for offline research?▼

To convert Salesforce Help articles to Markdown, run the scraper script with a target URL and output path to handle consent banners and extract clean content. It uses Playwright for rendering and Readability for content sanitization.

How do I web scrape dynamically rendered pages that are blocked by consent banners?▼

Scraping dynamically rendered pages blocked by consent banners requires automated browser interaction and content cleanup. The scraper uses Playwright to render pages and handle consent prompts, then applies Readability and Turndown to extract clean Markdown.

Does this Salesforce help site scraper require Node.js to run?▼

Yes, this Salesforce help site scraper requires Node.js 18 or higher. It relies on Playwright, jsdom, Readability, and Turndown to handle dynamic rendering, content extraction, and Markdown conversion within a modern Node.js runtime.

Can I batch convert multiple Salesforce Help articles to Markdown?▼

Yes, you can batch convert multiple Salesforce Help articles by pointing the scraper at multiple target URLs. It supports single-article and batch workflows, applying configurable consent handling and content cleanup across the entire article set.

What is the best way to remove headers and footers when scraping web content to Markdown?▼

The best way to remove headers and footers when scraping web content to Markdown is using Mozilla Readability with jsdom for content sanitization. This strips non-essential chrome and preserves core article structure for clean Markdown output.

Why does my web scraper fail to extract content from dynamically rendered Salesforce pages?▼

Web scrapers fail to extract content from dynamically rendered Salesforce pages because content loads via JavaScript or is hidden behind consent banners. Using a headless browser like Playwright renders the page fully and handles consent prompts before extraction.