skills.rest
aaddrick
aaddrickCOMMUNITY
Explore all skills by this author →
GitHub

content-hydration

Fetches and joins linked Reddit content into enriched CSVs for downstream analysis.

13|2|Updated Feb 10, 2026
Search Tags:#rate limiting#data pipeline#web scraping#checkpointing#csv#data enrichment#reddit
One-click install
npx skills add https://github.com/aaddrick/written-voice-replication --skill content-hydration-aaddrick
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: content-hydration
Source: https://github.com/aaddrick/written-voice-replication/tree/main/.claude/skills/content-hydration
Command: npx skills add https://github.com/aaddrick/written-voice-replication --skill content-hydration-aaddrick

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, pandas, and includes scripts (resource) components.

What problem does it solve? Data exports often contain only URLs and IDs pointing to external content, leaving comments orphaned from their parent context and voted items as bare permalinks. This Skill resolves those references by fetching, deduplicating, caching, and joining linked content back to source records so downstream analysis has complete data. ## Core Features & Use Cases - Tiered Hydration Pipeline: Enriches comments with parent post and parent comment context (Tier 1), fetches voted and saved content (Tier 2), and catalogs external URLs by domain and category without fetching them (Tier 3). - Resumable Fetching: Uses per-tier checkpoint files, disk-cached JSON responses, and exponential backoff on rate limits so interrupted runs resume without re-fetching. - Auth-Free Reddit Access: Appends .json to Reddit permalinks to retrieve structured post and comment data without API credentials. - Use Case: You have a Reddit data export where 1,716 comments reference only a few hundred unique parent posts. Run this Skill to fetch each unique URL once, join parent titles and bodies back to every comment, and produce enriched CSVs plus a coverage manifest for downstream voice-analysis agents. ## Quick Start Use the content-hydration skill to enrich my cleaned Reddit export CSVs by fetching parent context and voted content into data/enriched/.

Frequently Asked Questions about content-hydration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fetch Reddit post data without API authentication?▼

Append .json to any Reddit permalink to get structured JSON without credentials. The response is an array where the post is at index [0] and comments are nested under index [1]. Set a descriptive User-Agent header, since Reddit blocks default Python clients.

How do I enrich Reddit comments with parent context from a data export?▼

Deduplicate the parent post URLs from the link column, fetch each unique URL once via the .json trick, then search the post's comment tree for parent comment IDs. Join the fetched titles and bodies back to source records by stable keys like id or permalink.

How do I handle Reddit rate limits when fetching many URLs?▼

Use a baseline delay of about 2 seconds between requests and apply exponential backoff with jitter on HTTP 429 or 503 responses. Checkpoint progress every 25-50 fetches so interrupted runs can resume without re-fetching completed URLs.

Should deleted Reddit content be treated as a fetch failure?▼

No. Reddit returns [deleted] or [removed] in the body field for deleted content, which is a valid fetch result. Record these as successful fetches with the deletion marker rather than retrying, since retries will never converge.

When should I not use content hydration on a data export?▼

Skip hydration when all content is already inline, when the export is small enough to inspect manually, or when you only need metadata like timestamps and counts. It is also inappropriate when external fetching is prohibited or rate limits are zero.

Related Skills

Explore More Data & Analytics Skills→
datheredathere
3.7k

data-clean

Cleans CSV, TSV, and Excel files by normalizing headers and removing duplicates.

Official
Intermediate
Happy-Technologies-LLCHappy-Technologies-LLC
34

detect-conversation-type

Classify ServiceNow conversations by type and route them to handling workflows.

Official
Intermediate
fourteenwmfourteenwm
58

google-ads-query

Query Google Ads data via GAQL templates and export results to CSV.

Community
Intermediate
Michae2xlMichae2xl

expert-in-integrating-third-party-apis-with-proper-authenticatio

Automates secure third-party API integration with authentication, error handling, rate limiting, and retry logic for REST and GraphQL clients.

Community
Advanced