skills.rest
tankygranny05
tankygranny05COMMUNITY
Explore all skills by this author →
GitHub

update-clickhouse-m3u

Update ClickHouse transactions table with incremental trading data via SSH.

2|Updated Jan 30, 2026
Search Tags:#database#update#ssh#data sync#clickhouse#trading data
One-click install
npx skills add https://github.com/tankygranny05/agent-box --skill update-clickhouse-m3u
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: update-clickhouse-m3u
Source: https://github.com/tankygranny05/agent-box/tree/main/agent-box/seed/codex-skills/update-clickhouse-m3u
Command: npx skills add https://github.com/tankygranny05/agent-box --skill update-clickhouse-m3u

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of updating the ClickHouse database with new trading data, ensuring data freshness and accuracy for analysis.

Core Features & Use Cases

  • Incremental Updates: Efficiently updates ClickHouse with data since a specified date, avoiding full reloads.
  • Remote Execution: Connects securely via SSH to a remote machine (m3u) to perform the update.
  • Use Case: When you need to add the latest trading day's transactions to your ClickHouse database for real-time analysis, this skill handles the entire process.

Quick Start

Run the update script on the remote machine to update ClickHouse with data starting from 2025_12_01.

Frequently Asked Questions about update-clickhouse-m3u

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I sync incremental trading data to a remote ClickHouse database?▼

You can sync incremental trading data to a remote ClickHouse database by connecting via SSH and executing Python scripts to perform upserts on the 'default.transactions' table partitioned by 'day'.

What is the best way to update ClickHouse trading data without a full reload?▼

The best way to update ClickHouse trading data without a full reload is by filtering transaction data from a pickle file by a specified date and performing incremental upserts on the remote machine.

How does SSH remote execution work for updating a ClickHouse database?▼

SSH remote execution works for updating a ClickHouse database by securely connecting to the remote machine, loading transaction data from a pickle file, and running Python scripts to upsert data filtered by date.

Can I use Python scripts to upsert daily trading transactions into ClickHouse?▼

Yes, you can use Python scripts to upsert daily trading transactions into ClickHouse by loading data from a pickle file and targeting the 'default.transactions' table partitioned by 'day'.

Why does my incremental data sync to ClickHouse require a pickle file?▼

Your incremental data sync to ClickHouse requires a pickle file because the process loads transaction data from this specific file format to filter records by date before performing the database upserts.

Related Skills

Explore More Data & Analytics Skills→
sleepinginsummersleepinginsummer
76

agent-ssh-cli

Execute commands and transfer files on remote servers via SSH.

Community
Intermediate
RUSHYOPRUSHYOP

clickhouse-io

Optimize ClickHouse analytics with schema design and query-tuning patterns.

Community
Advanced
NightreaverNightreaver
6

ssh-exec-script

Execute multi-line shell scripts on remote POSIX SSH hosts via stdin.

Community
Advanced
chmonitorchmonitor
255

data-analysis

Run read-only SQL recipes against ClickHouse system tables for custom analysis.

Official
Intermediate