substack-sub

Convert a Substack article URL into standardized JSON for material pipelines.

4.7k|260|Updated Dec 29, 2021
One-click install
npx skills add https://github.com/beatai-org/beatai --skill substack-sub
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: substack-sub
Source: https://github.com/beatai-org/beatai/tree/main/.claude/skills/substack-sub
Command: npx skills add https://github.com/beatai-org/beatai --skill substack-sub

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill turns a single Substack article URL into a standardized JSON payload that downstream pipelines can deduplicate, merge, and pass to the correct fetcher without manually handling source-specific differences.

Core Features & Use Cases

  • URL-to-JSON ephemeral source passthrough: Wraps one Substack article URL into the same JSON schema as the sibling medium-sub skill.
  • Tracking-safe URL normalization: Strips common tracking query parameters and URL hash before emitting the result.
  • Orchestrator-friendly contract: Provides predictable stdout JSON with fixed generator/source/stats fields so Stage 2 can remain source-agnostic.

Quick Start

Run substack-sub in URL mode to emit the JSON for a given article link: node fetch-list.js --url https://your-substack-domain.com/p/your-article.

Frequently Asked Questions about substack-sub

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a Substack article URL into clean JSON for pipeline ingestion?

You convert a Substack article URL into clean JSON by running the script with the --url flag, which outputs a standardized JSON payload with fixed generator, source, and stats schema fields for reliable pipeline ingestion.

Can I fetch multiple Substack publications or feeds automatically?

No, you cannot fetch multiple Substack publications or feeds automatically. The script implements strict input handling and explicitly fails on unsupported discovery modes like --publications and --feeds, supporting only single URL passthrough.

Does the Substack URL to JSON script remove tracking parameters?

Yes, the Substack URL to JSON script removes tracking parameters. It performs tracking-safe URL normalization by stripping common tracking query parameters and URL hashes before emitting the final JSON result.

What is the best way to prepare Substack articles for deduplication in a Node.js pipeline?

The best way to prepare Substack articles for deduplication in a Node.js pipeline is to wrap individual article URLs into a stable JSON schema with manual tags, creating a predictable output structure for downstream per-tag limiting and dedup stages.

Why does my Substack JSON discovery script not fetch article content directly?

Your Substack JSON discovery script does not fetch article content directly because it is designed as an ephemeral source passthrough. It omits remote fetching and only generates discovery-ready JSON metadata for the actual fetcher stages downstream.