skills.rest
bmearesbmearesCommunity·1 Agent Skills Included

Meerschaum

Incremental time-series ETL pipelines with automatic syncing

Syncs time-series data streams into databases by fetching only new or changed rows, deduplicating and upserting them automatically. Eliminates hand-written ETL scripts, manual incremental windows, and fragile cron jobs. Includes scheduling, plugins, SQL connectors, and a release workflow to keep data pipelines running with minimal effort.
154|10
↗
npx skills add bmeares/Meerschaum --all -g -y
Available:

Gives your AI agent the project's build, test, and architecture rules so it can safely modify the pipe-based ETL codebase and run the correct test commands.

All Skills in This Repository (1)

Pure Emerald Level Indicators
📦 In Repo
bmearesbmeares

release

Automate the Meerschaum release process from version bumping to PyPI publishing.

Community
Advanced

Frequently Asked Questions

FAQPage Schema
How to install Meerschaum?▼

Run `npx skills add bmeares/Meerschaum --all -g -y` in your terminal to install all skills in this repository globally.

What does Meerschaum do?▼

It is an ETL framework for time-series data that keeps named data streams (pipes) in sync by fetching only new or changed rows, then deduplicating and upserting them into your database.

How do I sync data from a new source?▼

Write a small plugin that returns rows or a DataFrame from a fetch function, and Meerschaum handles incremental syncing, schema management, and scheduling for you.

Which databases does Meerschaum support?▼

It connects to PostgreSQL, TimescaleDB, MySQL, MariaDB, MSSQL, SQLite, Oracle, and Valkey, plus API and custom plugin connectors.

Can I schedule recurring data syncs?▼

Yes. Any command can run as a background job with built-in cron and interval scheduling, locally or remotely on an API instance.

Related Repositories in Data & Analytics

View All in Data & Analytics→
PaddlePaddlePaddlePaddle
87.3k

PaddleOCR

Extract text, tables, and formulas from PDFs and images

Official📦 2 Skills
D4VinciD4Vinci
73.3k

Scrapling

Scrape any website and bypass anti-bot protection with AI

Community📦 1 Skills
mvanhornmvanhorn
60.8k

last30days-skill

Research any topic across Reddit, X, YouTube, and the web

Community📦 2 Skills