tbm-backfill

Ingest TikTok and YouTube videos hourly with rate-limited fetching and progress tracking.

Updated Aug 23, 2026

Search Tags:#automation #rate limiting #youtube #ingestion #content fetching #tiktok

Ready to run

npx skills add https://github.com/OrionArchitekton/cosmocrat-core --skill tbm-backfill

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: tbm-backfill
Source: https://github.com/OrionArchitekton/cosmocrat-core/tree/main/skills/tbm/tbm-backfill
Command: npx skills add https://github.com/OrionArchitekton/cosmocrat-core --skill tbm-backfill

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the ingestion of TikTok and YouTube content, preventing rate limit issues and ensuring consistent data flow.

Core Features & Use Cases

Rate-Limited Ingestion: Fetches a small number of videos (3-5) per hour to avoid API rate limits.
Progress Tracking: Records ingestion progress in the tbm_ingest_progress table.
Use Case: Automatically pull new, relevant video content from specified platforms for analysis or archival without manual intervention.

Quick Start

Run the tbm-backfill skill to ingest new content for today's date.

Frequently Asked Questions about tbm-backfill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate TikTok and YouTube content fetching without hitting API rate limits?▼

Automate content fetching by running hourly, rate-limited ingestion that pulls a small batch of videos. This approach prevents hitting API rate limits while ensuring a consistent flow of new video data.

How does hourly ingestion track progress when fetching new videos?▼

Hourly ingestion tracks progress by recording the ingestion state in a dedicated database table. This monitoring mechanism ensures the fetching process resumes correctly and avoids duplicate content extraction.

How many videos should I fetch per hour to avoid YouTube and TikTok API limits?▼

Fetch a small number of videos, typically 3 to 5 per hour, to avoid API rate limits. This controlled ingestion volume ensures continuous automated pulling without triggering platform restrictions.

Can I use an automated ingestion schedule for pulling new video content daily?▼

Yes, you can run an automated ingestion schedule to pull new, relevant video content for today's date. It requires a defined hourly schedule to handle content fetching and progress monitoring consistently.

Why does automated content ingestion need a dedicated database table?▼

Automated content ingestion needs a dedicated database table to persistently track ingestion progress. Recording this state prevents data duplication and ensures the fetching process maintains accurate progress monitoring across scheduled runs.