redpanda

Deploy and tune Redpanda clusters with rpk, Schema Registry, and tiered storage.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill redpanda
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: redpanda
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/redpanda
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill redpanda

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you deploy and operate Redpanda as a Kafka-compatible streaming platform while configuring topics, clients, security, and tiered storage for reliable data engineering.

Core Features & Use Cases

  • Cluster deployment (Docker/Kubernetes/bare metal): Stand up single-node for development and multi-node clusters for staging/production.
  • Topic and consumer/group management with rpk: Create topics with retention/compaction settings, inspect leaders/replicas, manage consumer offsets and lag.
  • Performance and reliability tuning: Configure producer durability/throughput and consumer fetch/commit/rebalance behavior.
  • Tiered storage (Shadow Indexing): Offload historical segments to S3/GCS/ABS and control remote read/write/delete semantics.
  • Schema Registry and Kafka Connect compatibility: Use the built-in Schema Registry APIs and run standard Kafka Connect workers against Redpanda.
  • Monitoring and security: Enable SASL/SCRAM, TLS/mTLS, ACLs, and instrument metrics via Prometheus/Grafana.

Quick Start

Configure a 3-broker Redpanda cluster with Schema Registry and tiered storage, then create a topic using rpk with the appropriate retention and remote read/write settings.

Frequently Asked Questions about redpanda

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy a Kafka-compatible streaming cluster on Kubernetes?

Deploy a Kafka-compatible streaming cluster on Kubernetes by setting up multi-node Redpanda brokers for staging and production, which reduces operational overhead compared to traditional partitioned log systems.

Does Redpanda work with standard Kafka Connect workers and clients?

Yes, Redpanda works with standard Kafka Connect workers and clients by providing Kafka API accessibility, allowing you to run existing Kafka-compatible data pipelines without modification.

How do I manage Kafka topics and consumer offsets using rpk?

Manage Kafka topics and consumer offsets using the rpk CLI to create topics with specific retention or compaction settings, inspect leaders and replicas, and monitor consumer lag.

Can I offload historical Kafka segments to S3 using tiered storage?

Yes, you can offload historical Kafka segments to S3, GCS, or ABS using Redpanda tiered storage, which controls remote read, write, and delete semantics to optimize storage costs.

How do I configure Schema Registry for Kafka-compatible streaming?

Configure Schema Registry for Kafka-compatible streaming by utilizing built-in Schema Registry APIs in Redpanda to manage data schemas and ensure compatibility across your producers and consumers.

What is the best way to secure a Kafka-compatible streaming platform?

Secure a Kafka-compatible streaming platform by enabling SASL/SCRAM authentication, configuring TLS/mTLS encryption, and applying ACLs to control broker access and restrict unauthorized topic operations.