substack-fetch

Download public Substack articles and convert them to Markdown with local assets.

4.7k|260|Updated Dec 29, 2021
One-click install
npx skills add https://github.com/beatai-org/beatai --skill substack-fetch
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: substack-fetch
Source: https://github.com/beatai-org/beatai/tree/main/.claude/skills/substack-fetch
Command: npx skills add https://github.com/beatai-org/beatai --skill substack-fetch

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @mozilla/readability, jsdom, turndown, yaml, and includes scripts (resource) components.

What problem does it solve?

This Skill lets you quickly grab a public Substack article by URL and convert it into clean, offline-friendly Markdown with locally stored images, so you can plug it into your pipeline without manual copying.

Core Features & Use Cases

  • Public Substack fetching: Downloads Substack article HTML via plain HTTP (no Chrome, no login) and extracts the main article body.
  • Readability + Turndown cleaning: Produces Readability-cleaned Markdown and normalizes structures like figures and captions.
  • Local image localization: Downloads remote images into RAW_DIR/<slug>/assets and rewrites image links to relative paths.
  • Metadata in YAML frontmatter: Writes title, author, url, fetched date, optional published date, optional tags, and optional excerpt into the Markdown header.

Quick Start

Ask for: fetch this Substack article from the given URL and save the cleaned Markdown plus local images under RAW_DIR (absolute path) using this skill.

Frequently Asked Questions about substack-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download a Substack article as Markdown with local images?

You can download a Substack article as Markdown by providing the public URL and an absolute RAW_DIR path. The Skill fetches the HTML via plain HTTP and outputs Readability-cleaned Markdown with images stored locally in an assets folder.

Can I use this to fetch paywalled Substack posts?

No, you cannot fetch paywalled Substack posts. The Skill uses plain HTTP fetching without login capabilities, meaning it only processes public articles that do not require a subscription to access.

Does this tool work with Substack custom domains or only *.substack.com URLs?

Yes, this tool works with both standard *.substack.com URLs and Substack custom domains. It uses plain HTTP fetching and DOM parsing to extract content from any public Substack article.

How does Readability and Turndown clean Substack HTML into Markdown?

Readability extracts the main article body from the raw HTML, and Turndown converts that DOM structure into Markdown. This combination normalizes elements like figures and captions to produce clean, offline-friendly text.

What metadata is included when converting a Substack post to Markdown?

When converting a Substack post, the tool writes YAML frontmatter containing the article title, author, URL, and fetched date. It also includes optional published date, tags, and excerpt if available in the source HTML.

Do I need a headless browser like Chrome to scrape Substack content?

No, you do not need a headless browser like Chrome to scrape Substack content. The Skill relies on plain HTTP fetch requests and DOM parsing to retrieve the article, avoiding the overhead of browser automation.