storage-optimization

What problem does it solve?

Self-hosted ClickHouse deployments often suffer from unnecessarily high storage costs, slow query performance, and disk space outages caused by unoptimized compression settings, unmanaged data lifecycle policies, and unmonitored MergeTree part counts.

Core Features & Use Cases

• Compression Codec Tuning: Select optimal per-column codecs (LZ4, ZSTD, Delta, DoubleDelta) to reduce storage footprint without sacrificing query speed for different data types.
• TTL & Tiered Storage Management: Configure automated data retention and tiering rules to move cold data to cheaper storage volumes and delete expired data to free up disk space.
• Part & Disk Health Monitoring: Track MergeTree part counts, detached parts, and disk usage to prevent performance degradation and disk-full outages.
• Use Case: A team running a 10TB time-series ClickHouse cluster can use this skill to implement Delta+ZSTD compression on timestamp columns, move 90-day-old data to S3 cold storage, and set TTL on system logs to reclaim 60% of disk space.

Quick Start

Use the storage-optimization skill to analyze your ClickHouse cluster's current storage configuration and recommend compression codecs, TTL policies, and tiered storage rules to reduce costs and improve query performance.