walkeros-understanding-transformers

To validate and enrich events in a data pipeline, implement transformers using an Init function for configuration and a push method to process event data, returning the modified event for downstream processing.

A transformer pipeline processes events sequentially through chain linking, where the next parameter passes validated and enriched event data from one transformer to another across pre- and post-collector stages.

To redact sensitive data before events reach a collector, wire a custom transformer into the pre-collector chain to intercept and strip or mask required fields within the push method.

Yes, you can implement inline code transformers directly within your pipeline configuration as an alternative to using package-based transformers for event validation and enrichment tasks.

Yes, using TypeScript types from @walkeros/core ensures your transformer interface, instance methods, and return values correctly align with the walkerOS pipeline structure and chain linking model.

Pre-collector transformer chains validate and enrich raw event data before collection, while post-collector chains process events after collection, allowing distinct data transformation stages within the pipeline.