skills.rest
yunqiqiliang
yunqiqiliangCOMMUNITY
Explore all skills by this author →
GitHub

clickzetta-batch-sync-pipeline

Automate offline batch data synchronization from sources to ClickZetta Lakehouse.

8|3|Updated Mar 19, 2026
Search Tags:#data-pipeline#lakehouse#schema-evolution#data-migration#studio#batch-sync
One-click install
npx skills add https://github.com/yunqiqiliang/clickzetta-skills --skill clickzetta-batch-sync-pipeline
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: clickzetta-batch-sync-pipeline
Source: https://github.com/yunqiqiliang/clickzetta-skills/tree/main/clickzetta-batch-sync-pipeline
Command: npx skills add https://github.com/yunqiqiliang/clickzetta-skills --skill clickzetta-batch-sync-pipeline

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

实现将外部数据库到 ClickZetta Lakehouse 的离线批量同步，减少重复人力工作并确保数据一致性。

Core Features & Use Cases

  • 单表离线同步：从源表定期同步到目标表，适合简单场景。
  • 多表离线同步：支持整库镜像、多表镜像与多表合并等模式，提升批量迁移能力。
  • 任务创建、数据源配置、字段映射、同步规则、调度部署与运维，覆盖从开发到生产的完整流程。

Quick Start

创建一个批量离线同步任务，通过 Studio 完成数据源、字段映射和调度配置，然后提交以开始执行。

Frequently Asked Questions about clickzetta-batch-sync-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate offline batch data synchronization to a Lakehouse?▼

Offline batch data synchronization to a Lakehouse is automated by configuring source and target connections, field mappings, and scheduling rules to execute periodic migrations and bulk replications. This ensures data consistency while reducing manual workload.

Can I sync an entire database with multiple tables to the Lakehouse at once?▼

Yes, multi-table offline sync supports entire database mirroring, multi-table mirroring, and multi-table merging. This enables bulk migration from various sources to the Lakehouse, moving beyond simple single-table synchronization for complex scenarios.

What is the best way to configure field mappings and scheduling for data migration?▼

The best way to configure field mappings and scheduling for data migration is through Studio. You create a batch sync task, define data source configurations, establish field mappings, set scheduling rules, and then submit the task for execution.

Do I need a Sync VCluster to deploy scheduled batch sync jobs to production?▼

Yes, a Sync VCluster is required for production use when deploying scheduled batch sync jobs. It supports the execution of task creation, data source configuration, and deployment workflows for offline data synchronization.

Does the batch sync pipeline support schema evolution during data migration?▼

Schema evolution is supported during batch data migration to the Lakehouse. The pipeline handles source and target configuration alongside governance, allowing structural changes to be managed through field mappings and sync rules.

Related Skills

Explore More Data & Analytics Skills→
Snowflake-LabsSnowflake-Labs
1

oracle-connection

Configure and verify Oracle database connections for schema extraction.

Official
Intermediate
Manvendra08Manvendra08
1

clickhouse-io

Design, optimize, and operate ClickHouse databases for high-volume analytical workloads.

Community
Intermediate
giosuetedeschi-specgiosuetedeschi-spec

agent-manager-skill

Manage CLI agent lifecycles in tmux sessions with cron scheduling.

Community
Intermediate
Sir-chawakornSir-chawakorn
9

build-cdc-streaming-pipeline

Designs log-based CDC pipelines from database transaction streams to Kafka topics.

Community
Advanced