kafka-topic-setup

Creates and configures Kafka topics for the hook event pipeline.

2|1|Updated Mar 3, 2026
One-click install
npx skills add https://github.com/heyAyushh/hook --skill kafka-topic-setup
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: kafka-topic-setup
Source: https://github.com/heyAyushh/hook/tree/main/skills/kafka-topic-setup
Command: npx skills add https://github.com/heyAyushh/hook --skill kafka-topic-setup

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Ensures the required Kafka topics for the hook event pipeline are created and configured explicitly so services do not fail due to missing topics, incorrect partitions, or improper retention settings when auto-creation is disabled.

Core Features & Use Cases

  • Create standard topic set: Creates per-source ingress topics (webhooks.<source>), the normalized core topic (webhooks.core), and the dead-letter queue (webhooks.dlq).
  • Configurable defaults: Supports environment-variable driven customization for bootstrap address, source list, partitions, replication factor, and retention windows.
  • Validation and verification: Lists and describes topics to verify partitioning and replication, and includes guidance for multi-broker replication and min.insync.replicas adjustments.
  • Use Case: Run during initial environment provisioning, after Kafka cluster provisioning, or when recreating topics after correcting configuration mistakes.

Quick Start

Run the scripts/create-hook-topics.sh script on a host that can reach your Kafka broker to create the webhooks.core, webhooks.dlq, and per-source webhooks.<source> topics with default settings.

Frequently Asked Questions about kafka-topic-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create Kafka topics for a webhook event pipeline with correct partitions and retention?

Create Kafka topics for a webhook event pipeline by running a bash script that provisions per-source ingress topics, a normalized core topic, and a dead-letter queue with recommended partitions, replication factors, and retention policies.

What Kafka topics do I need to configure for processing webhooks from sources like GitHub and Linear?

Processing webhooks from sources like GitHub and Linear requires configuring per-source ingress topics (webhooks.<source>), a normalized core topic (webhooks.core), and a dead-letter queue (webhooks.dlq) to handle event failures.

Can I customize Kafka topic replication factors and retention settings using environment variables?

Customize Kafka topic replication factors and retention settings using environment variables to override default bootstrap addresses, source lists, partitions, replication factors, and retention windows during topic provisioning.

Why do my Kafka services fail when auto-creation is disabled and topics are missing?

Kafka services fail when auto-creation is disabled because required topics are missing, which this Skill prevents by explicitly creating and configuring the necessary topics with correct partitions and retention settings.

What's the best way to verify Kafka topics are created with the correct partitioning and replication?

Verify Kafka topics are created with correct partitioning and replication by listing and describing the topics after running the provisioning script to confirm the applied configuration settings.

Do I need a multi-broker Kafka cluster to use this topic provisioning script?

A multi-broker Kafka cluster is not strictly required to run the topic provisioning script, but the included guidance helps adjust min.insync.replicas and replication factors for multi-broker replication environments.