flowfile-codegen-parity-campaign

Test parity between Flowfile flows, exported Python code, and FlowFrame API.

340|27|Updated Nov 9, 2024
One-click install
npx skills add https://github.com/Edwardvaneechoud/Flowfile --skill flowfile-codegen-parity-campaign
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: flowfile-codegen-parity-campaign
Source: https://github.com/Edwardvaneechoud/Flowfile/tree/main/.claude/skills/flowfile-codegen-parity-campaign
Command: npx skills add https://github.com/Edwardvaneechoud/Flowfile --skill flowfile-codegen-parity-campaign

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pytest, polars, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the parity gap between a visual Flowfile flow, its exported Python code, and the FlowFrame API, ensuring that the exported code matches the flow's results.

Core Features & Use Cases

  • Parity Testing: Checks the equivalence of the live DAG engine's result with the exported Python code.
  • Code Generation Parity: Ensures that the exported Python code matches the in-engine result.
  • Inventory and Fixing: Identifies known divergences and provides guidance on fixing them.

Quick Start

Run the parity tests to verify parity between the Flowfile flow and the generated code.

Frequently Asked Questions about flowfile-codegen-parity-campaign

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ensure API parity between a visual Flowfile flow and its exported Python code?

To ensure API parity between a visual Flowfile flow and exported Python code, you run parity tests that verify the live DAG engine's execution results match the generated code output. This identifies discrepancies and guides necessary fixes.

Why does my exported Python code return different results than the live Flowfile engine?

Exported Python code returns different results than the live Flowfile engine due to known code generation divergences. Running parity testing checks the equivalence of the DAG engine's result with the exported code to inventory and fix these specific mismatches.

What is code generation parity testing for data flows?

Code generation parity testing for data flows is the process of checking the equivalence of a live visual DAG engine's result with its exported Python code. It ensures that visual Flowfile flows and the FlowFrame API produce consistent execution results.

Do I need pytest and polars to run Flowfile parity tests?

Yes, you need pytest and polars to run Flowfile parity tests. The testing framework requires these dependencies, alongside access to Flowfile core and testing environments with database connections, to verify the generated Python code matches the in-engine result.

What is the best way to inventory and fix FlowFrame API code generation discrepancies?

The best way to inventory and fix FlowFrame API code generation discrepancies is to execute parity tests that compare the live DAG engine's output against the exported Python code. This identifies known divergences and provides guidance on fixing them for consistent results.