connector-transform

Create custom message transforms for Apache Iggy connectors.

4.5k|375|Updated Mar 18, 2023

Search Tags:#Rust #transform #connector customization #Apache Iggy #message manipulation

Ready to run

npx skills add https://github.com/apache/iggy --skill connector-transform

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: connector-transform
Source: https://github.com/apache/iggy/tree/main/.claude/skills/connector-transform
Command: npx skills add https://github.com/apache/iggy --skill connector-transform

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides the means to create custom message transforms for Apache Iggy connectors, enabling tailored processing and manipulation of messages during their flow through the system.

Core Features & Use Cases

Transform Creation: Design custom message transformations that mutate, filter, or convert data between source/encode and decode/sink.
Authoring Custom Logic: Create field-level transforms, format conversions, and message manipulation tools without touching runtime code.
Use Case: Add a new transform to handle custom schema requirements, message envelope unwrapping, or conversion between Protobuf, Avro, and JSON formats for specific Iggy connectors.

Quick Start

Run the skill by specifying the name of the new transform in your connector configuration.

Frequently Asked Questions about connector-transform

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I create custom message transforms for Apache Iggy connectors?▼

To create custom message transforms for Apache Iggy connectors, you specify the new transform name in your connector configuration. This allows tailored message manipulation during encoding and decoding stages without touching runtime code.

Can I convert message formats between Protobuf, Avro, and JSON in Iggy connectors?▼

Yes, you can convert message formats between Protobuf, Avro, and JSON in Iggy connectors. The transform mechanism supports format conversions to handle custom schema requirements during the source and sink stages.

What are message transforms in Apache Iggy and when do I need them?▼

Message transforms in Apache Iggy are custom operations that mutate, filter, or convert data as it flows through the system. You need them when you require field updates, deletions, or envelope unwrapping for specific connector types.

Does the Iggy connector transform support field-level updates and deletions?▼

Yes, the Iggy connector transform supports field-level updates and deletions. You can author custom logic to manipulate specific message fields and add new data during the encoding and decoding stages.

What is the best way to unwrap message envelopes in an Iggy connector pipeline?▼

The best way to unwrap message envelopes in an Iggy connector pipeline is by authoring a custom transform. This approach handles envelope unwrapping directly during the decode and encode stages without modifying runtime code.