flowfile-frame-and-codegen

The Flowfile Frame API is a Polars-LazyFrame-shaped Python API used for building in-process flowfile_core FlowGraphs. It provides the interface to construct and manage data flow graphs programmatically.

FlowFrame and Expr objects manage internal representations like `_repr_str` and `_ff_repr`, and handle node-emission decision logic. They dictate how data operations are structured and executed within the flowfile_core sandbox.

Generated code execution in Flowfile relies on a contract between the code and the core's sandbox, utilizing lazy vs. eager semantics to manage operations and interact with database, cloud, catalog, Kafka, and REST connectors.

Yes, the Flowfile Frame API is designed for debugging flowfile_frame scripts. It provides detailed documentation on internal mechanics and execution semantics to help developers identify and resolve issues within their data flows.

To add or change FlowFrame or Expr methods, developers should understand the node-emission decision logic and the object's internal representations. This skill provides the necessary reference for extending the Flowfile Frame API.

Flowfile uses lazy vs. eager execution semantics to optimize data processing within the core's sandbox. This approach dictates when operations are evaluated, ensuring efficient execution when interacting with external connectors.