mfec-kafka-connect

Change, deploy, and verify Kafka Connect connector configs across MFEC customer pipelines.

1|Updated Jul 22, 2026
One-click install
npx skills add https://github.com/thititongumpun/skills --skill mfec-kafka-connect-thititongumpun
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: mfec-kafka-connect
Source: https://github.com/thititongumpun/skills/tree/main/skills/mfec-kafka-connect
Command: npx skills add https://github.com/thititongumpun/skills --skill mfec-kafka-connect-thititongumpun

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Editing a Kafka Connect connector JSON is risky: a renamed property, a wrong topic route, or a mismatched SMT chain silently breaks a customer data pipeline. This Skill enforces a disciplined change loop — edit, validate, diff, deploy, and prove with row-count checksums — so every connector change ends with a RUNNING connector and verified data in the sink, not just a saved file. ## Core Features & Use Cases - Versioned config management: Enforces the house naming convention where every change is a new timestamped file, keeping the previous version as an instant rollback. - Safe deploy loop: Validates configs via the Connect config/validate endpoint, diffs against the live connector, deploys with create-or-update, and checks every task reaches RUNNING. - Data proof with IVT: Runs source and sink checksum SQL per table and compares COUNT/CHECKSUM_AGG so mismatches are caught before handoff. - Debezium 1.x to 3.x migration: Documents observed property renames (e.g. database.server.name to topic.prefix) and topic layout changes for upgrade projects. - Use Case: When asked to add a table to a Debezium SQL Server source connector, the Skill updates the include list, predicate, sink topics, and IVT SQL, then deploys to uat and proves row counts before touching prd. ## Quick Start Ask the agent to add a new table to the uat Debezium source connector for the HRMI pipeline and verify the data lands in the staging sink.

Frequently Asked Questions about mfec-kafka-connect

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I safely update a Kafka Connect connector config in production?

Validate the new config with the connector-plugins config/validate endpoint, diff it against the live connector config, deploy with PUT /connectors/<name>/config, then confirm connector and every task reach RUNNING. Prove the change with source and sink checksum queries before handing off.

How do I add a table to a Debezium SQL Server source connector?

Update four places: the table.include.list, the matching TopicNameMatches predicate if a FilterTimestamp applies, the sink connector's topics list, and the IVT checksum SQL for that table. Then validate, deploy, and compare row counts.

What changed between Debezium 1.x and 3.x connector properties?

Key renames include database.server.name to topic.prefix, database.dbname to database.names, and database.history.* to schema.history.internal.*. Topics also gain the database segment, so every RegexRouter regex must be updated, and database.encrypt must be set explicitly.

Why does a Kafka Connect task fail after deploying a config change?

Read the failed task's trace from the connector status endpoint first, not the worker log. Common causes are a renamed property, a missing SMT class on the worker, or an SMT chain order where a rename breaks a downstream filter.

Can I deploy a connector change straight to production?

No. The same config file must pass deployment and IVT verification in uat before any prd deploy. Deletes, offset resets, and snapshot.mode changes replay or drop data, so they always require explicit user confirmation.