clickhouse-validation

Compare NRT Pulse and Fast Pipeline dimension data discrepancies in ClickHouse per latest timestamp.

Updated Apr 8, 2026
One-click install
npx skills add https://github.com/huangcd/gcusage --skill clickhouse-validation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: clickhouse-validation
Source: https://github.com/huangcd/gcusage/tree/main/.github/skills/clickhouse-validation
Command: npx skills add https://github.com/huangcd/gcusage --skill clickhouse-validation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests.

What problem does it solve?

Compare Agile (NRT Pulse) vs Fast Pipeline RL24 DAU metrics in ClickHouse to validate data consistency, enabling repeatable, automated validation and reducing manual reconciliation effort.

Core Features & Use Cases

  • Template-driven validation: Reuses predefined SQL templates to compare NRT Pulse and Fast Pipeline metrics across multiple dimensions.
  • Automatic credential handling: Uses MCP's submit_clickhouse_query to extract credentials, removing manual login steps.
  • Per-dimension analysis: Iterates over dimension values (Type, Endpoint, Platform, Operating System, Area, etc.) and reports hourly differences.
  • Latest timestamp alignment: Ensures comparisons are performed at the latest common timestamp to avoid skew.
  • Extensible output: Generates structured results suitable for dashboards or automation workflows.

Quick Start

Run the comparison against a template (e.g., agent_au) to start validating NRT Pulse vs Fast Pipeline across supported dimensions.

Frequently Asked Questions about clickhouse-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate ClickHouse metrics for consistency between NRT Pulse and Fast Pipeline?

To validate ClickHouse metrics between NRT Pulse and Fast Pipeline, you can use a template-driven comparison skill that iterates across multiple dimensions, aligns data to the latest common timestamp, and generates hourly difference reports.

What dimensions can I compare when validating ClickHouse data discrepancies?

ClickHouse data discrepancies can be compared across multiple dimensions including Type, Endpoint, Platform, Operating System, and Area, generating per-dimension reports to pinpoint exact inconsistencies between the pipelines.

How do I automate ClickHouse query execution without manual credential handling?

Automating ClickHouse queries without manual credentials is possible by using MCP-native queries via submit_clickhouse_query, which automatically extracts credentials and removes manual login steps during data validation.

How do I align ClickHouse timestamps to avoid data skew during pipeline comparisons?

To avoid data skew during ClickHouse pipeline comparisons, the validation process aligns metrics to the latest common timestamp shared by both NRT Pulse and Fast Pipeline before calculating dimensional differences.

Does the ClickHouse validation skill require manual database login configuration?

Manual database login configuration is not required, as the validation skill leverages MCP-native queries via submit_clickhouse_query for automatic credential extraction, eliminating the need for manual authentication setup.

Can I use predefined SQL templates for repeatable ClickHouse metric validation?

Predefined SQL templates can be used for repeatable ClickHouse metric validation, allowing you to run automated comparisons like the agent_au template to quickly identify NRT versus Fast Pipeline data discrepancies.