migrate-to-msk

Assess and size self-managed Apache Kafka clusters for migration to Amazon MSK Express.

Updated Jul 1, 2026
One-click install
npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill migrate-to-msk-sakicodes
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: migrate-to-msk
Source: https://github.com/sakicodes/BuildFestHackathon26/tree/main/.agents/skills/migrate-to-msk
Command: npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill migrate-to-msk-sakicodes

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Migrating a self-managed Apache Kafka cluster to Amazon MSK Express requires knowing whether your topology, Kafka version, configs, authentication, and workload quotas are compatible, and what Express instance type and broker count you need. This Skill inventories your source cluster, runs a five-pillar compatibility assessment, and fills the AWS-published MSK Sizing/Pricing workbook to produce a concrete target specification. ## Core Features & Use Cases - Discovery: Builds a cluster-config.json inventory from IaC files (Terraform, CDK, CloudFormation, Kubernetes manifests, Docker Compose), Kafka CLI output, or manual input. - Compatibility Assessment: Validates the source against MSK Express across five pillars (topology, Kafka version, configs, auth, quotas) with INFO/ADVISORY/ACTION_REQUIRED verdicts anchored to AWS documentation. - Sizing & Costing: Computes six workload inputs and fills the AWS-published MSK Sizing/Pricing workbook so its formulas recommend instance type, broker count, and monthly cost. - Use Case: You run a self-managed Kafka cluster on Kubernetes and want to move to MSK Express. Point the Skill at your manifests to get a cluster inventory, then run the assessment to learn that your SASL/OAUTHBEARER auth needs remediation and which Express instance type fits your peak throughput. ## Quick Start Ask the assistant to assess your Kafka cluster for migration to MSK Express by pointing it at your infrastructure files or an existing cluster-config.json.

Frequently Asked Questions about migrate-to-msk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate a self-managed Kafka cluster to Amazon MSK Express?

Run the two phases in order: discovery inventories your cluster from IaC files, Kafka CLI output, or manual input into a cluster-config.json, then assessment validates it against MSK Express across five pillars and fills the AWS sizing workbook. Data replication to the target uses MSK Replicator.

What Kafka versions does MSK Express support?

MSK Express supports Apache Kafka versions 3.6, 3.8, and 3.9. Other versions produce an ADVISORY verdict since your workload will run on a new Kafka version after migrating. Sources older than 2.8.1 cannot use MSK Replicator and need a MirrorMaker 2 based solution for data migration.

Which authentication mechanisms work with MSK Express?

MSK Express supports unauthenticated access, TLS client certificates, SASL/SCRAM via Secrets Manager, and IAM authentication. Custom SASL/OAUTHBEARER providers and mechanisms like Kerberos or SASL/PLAIN are not supported and are flagged as ACTION_REQUIRED. TLS in transit is mandatory for all authenticated mechanisms.

How is MSK Express cluster sizing and cost calculated?

Sizing is delegated to the AWS-published MSK Sizing/Pricing workbook. The sizing script computes six inputs (peak and average throughput, retention hours, total partition replicas) from the discovery contract and fills the workbook, whose formulas recommend instance type, broker count, and monthly cost on open.

Can I migrate from MSK Standard (Provisioned) to MSK Express with this skill?

No. The skill's scope covers only migrations from self-managed Apache Kafka (on-premises, EC2, Docker, Kubernetes, or other non-MSK deployments) to MSK Express. MSK Standard to MSK Express migrations are explicitly out of scope.

Why does the filled MSK sizing workbook show blank recommendations?

The recommendation and cost cells are workbook formulas that populate when the file is opened in Excel, LibreOffice, or Google Sheets. The script sets fullCalcOnLoad so recalculation happens automatically; if your spreadsheet app has automatic recalculation disabled, trigger a manual recalculation.