clickzetta-zettapark

You can use a Python DataFrame API to transform Lakehouse data by creating a session, loading data, and applying operations like filter, join, and groupBy. The API translates these Python operations into SQL executed in the Lakehouse.

You can write DataFrame results directly to Lakehouse tables using the save_as_table operation. This enables end-to-end workflows from data ingestion through transformation and analytics directly into persistent storage.

The Python DataFrame API supports pandas-like workflows for distributed data processing. It translates familiar pandas-style operations into SQL that executes in the Lakehouse, enabling distributed processing without changing your workflow syntax.

To start an end-to-end Lakehouse data workflow with Python, you need to create a session for workload management. This session enables DataFrame construction, data transformations, result collection, and writing tables within a single workflow.

You can execute SQL and perform simple file operations like PUT and GET within a single Lakehouse workflow. This integrates session management, data manipulation, and file operations alongside DataFrame transformations.