skills.rest
redpanda-data
redpanda-dataOFFICIAL
Explore all skills by this author →
Website𝕏@redpandadataGitHub

streaming

Manage topics and produce/consume data via Redpanda's Kafka-compatible API.

6|3|Updated May 31, 2026
Search Tags:#kafka#topic-management#redpanda#tiered-storage#iceberg-topics#cloud-topics#shadow-linking
One-click install
npx skills add https://github.com/redpanda-data/skills --skill streaming-redpanda-data
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: streaming
Source: https://github.com/redpanda-data/skills/tree/main/skills/streaming
Command: npx skills add https://github.com/redpanda-data/skills --skill streaming-redpanda-data

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Redpanda Streaming provides a practical guide to using the Redpanda broker through its Kafka-compatible API, covering data production, consumption, topic management, and enterprise features without ZooKeeper.

Core Features & Use Cases

  • Produce and consume data with the Kafka API on Redpanda, including topic creation, consumer groups, and offset management.
  • Leverage enterprise capabilities such as Tiered Storage, Iceberg Topics, Cloud Topics, and Shadowing to optimize storage, scalability, and cross-cluster disaster recovery.
  • Real-world scenario: build a streaming analytics pipeline that creates topics, streams events with EOS guarantees, and routes data to downstream systems.

Quick Start

Create a topic, publish a message, and verify it can be consumed end-to-end against Redpanda.

Frequently Asked Questions about streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I produce and consume messages using the Kafka API on Redpanda?▼

You can produce and consume messages on Redpanda using standard Kafka clients or the rpk CLI. Create a topic, publish events, and verify consumption end-to-end to build a streaming analytics pipeline.

Does Redpanda support Kafka consumer groups and offset management?▼

Yes, Redpanda supports Kafka consumer groups and offset management natively. You can manage consumer groups and track offsets through the Kafka API or rpk without needing ZooKeeper.

How do I manage topics on a Redpanda cluster?▼

Topic management on Redpanda is handled through the Kafka API or rpk commands. You can create, configure, and manage topics, including enterprise features like Iceberg Topics and Cloud Topics.

Can I use Tiered Storage and Shadow Linking for disaster recovery in Redpanda?▼

Yes, Redpanda provides Tiered Storage to optimize storage scalability and Shadow Linking for cross-cluster disaster recovery. These enterprise features help manage data across self-managed and cloud deployments.

Do I need ZooKeeper to manage topics and transactions in Redpanda streaming?▼

No, you do not need ZooKeeper. Redpanda operates without ZooKeeper, allowing you to manage topics, transactions, and consumer groups directly through its Kafka-compatible API.

What are Iceberg Topics and how do they optimize data storage in Redpanda?▼

Iceberg Topics are an enterprise feature in Redpanda that optimizes storage and scalability. They enable routing streaming data to downstream systems efficiently across cloud and self-managed deployments.

Related Skills

Explore More Software Engineering Skills→
redpanda-dataredpanda-data
6

streaming-debugging

Identifies Redpanda streaming deployment root causes via debug bundles, metrics, and logs.

Official
Advanced
simplefarmer69simplefarmer69
2

ac-oracle-dune-335

Stream Ethereum on-chain blockchain events through the Dune analytics platform.

Community
Intermediate
redpanda-dataredpanda-data
6

rpk-group

Manage Kafka consumer groups via rpk group subcommands.

Official
Advanced
roanbrasilroanbrasil
5

redpanda

Manage, configure, and migrate Kafka workloads to Redpanda clusters.

Community
Advanced