connect

Automates building and operating Redpanda Connect pipelines with YAML configs and Bloblang.

6|3|Updated May 31, 2026
One-click install
npx skills add https://github.com/redpanda-data/skills --skill connect-redpanda-data
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: connect
Source: https://github.com/redpanda-data/skills/tree/main/skills/connect
Command: npx skills add https://github.com/redpanda-data/skills --skill connect-redpanda-data

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Redpanda Connect is a declarative stream processing platform that simplifies designing, validating, and running end-to-end data pipelines.

Core Features & Use Cases

  • Declarative YAML config for inputs, processors, and outputs
  • Bloblang mappings for data transformation and error handling
  • Comprehensive component discovery, resource management, and enterprise licensing

Quick Start

Run a sample pipeline with rpk connect run using a YAML file describing input, processors, and output.

Frequently Asked Questions about connect

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a streaming data pipeline using declarative YAML config?

You can build a streaming data pipeline by writing a declarative YAML file that defines your Kafka-compatible inputs, Bloblang processors, and outputs, then executing it with the rpk connect run command.

What is Bloblang used for in stream processing pipelines?

Bloblang is a mapping language used for data transformation and error handling within stream processing pipelines, allowing you to manipulate and restructure data as it flows between your defined inputs and outputs.

How do I test and run Redpanda Connect pipelines for data integration?

You test and run Redpanda Connect pipelines by executing a YAML configuration file with the rpk connect run command, which processes streaming data through your specified inputs, processors, and outputs.

Does Redpanda Connect work with Kafka-compatible inputs for enterprise data integration?

Yes, Redpanda Connect supports enterprise-connect workflows by integrating Kafka-compatible inputs, applying Bloblang processors, and managing component discovery and licensing across your streaming-data infrastructure.

What are the limitations of declarative YAML for stream processing workflows?

Declarative YAML stream processing requires understanding Bloblang for complex data transformations and error handling, while enterprise features and component discovery depend on proper resource management and licensing configuration.