EdwardvaneechoudEdwardvaneechoudCommunityยท17 Agent Skills Included

Flowfile

Visual ETL pipelines that compile to Polars code

Builds data pipelines on a visual canvas or through a Polars-like Python API, with joins, filters, pivots, and aggregations previewed live at every step. Connects files, databases, cloud storage, Kafka, and REST APIs without hand-written glue code or fragile spreadsheets. Exports flows as runnable Python, schedules recurring runs, and stores results in a versioned Delta Lake catalog.
npx skills add Edwardvaneechoud/Flowfile --all -g -y
Available:

Instructs your AI agent on the monorepo's architecture, cross-service contracts, and which package-level guide or skill to load before working in any part of the system.

All Skills in This Repository (17)

Pure Emerald Level Indicators
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-docs-review

Verifies and maintains editorial standards, style guides, and persona-based navigation for technical documentation.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-architecture-contract

Document Flowfile ETL architecture and design contracts for core components.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-frame-and-codegen

Document the Flowfile Frame API internals, generated code mechanics, and execution semantics.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-frontend-conventions

Define Vue 3 and Tauri 2 frontend conventions for the Flowfile application.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-build-and-env

Sets up the complete Flowfile development environment including Docker, WASM, and Makefile targets.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-node-development

Guide development of Flowfile node types across core, frontend, Python API, and WASM layers.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-failure-archaeology

Review Flowfile incident history and design decisions for worker transport issues.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-run-and-operate

Run and operate Flowfile ETL via CLI commands and service startup.

Community
Intermediate
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-testing-and-validation

Automates execution and validation of unit, integration, and E2E tests for the Flowfile monorepo.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-research-frontier

Scope and validate exploratory Flowfile research projects with falsifiable milestones.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-codegen-parity-campaign

Test parity between Flowfile flows, exported Python code, and FlowFrame API.

Community
Advanced
๐Ÿ“ฆ In Repo
EdwardvaneechoudEdwardvaneechoud

flowfile-ai-subsystem

Guide debugging and extension of Flowfile's AI subsystem with Python.

Community
Advanced

Frequently Asked Questions

FAQPage Schema
How to install Flowfile?โ–ผ

Run `npx skills add Edwardvaneechoud/Flowfile --all -g -y` in your terminal to install all skills in this suite globally.

What is Flowfile used for?โ–ผ

Flowfile is a visual ETL platform for building data pipelines on a drag-and-drop canvas or in Python, with every flow compiling down to Polars. It handles extraction from files, databases, cloud storage, Kafka, and APIs, plus transformation, scheduling, and cataloging.

Can I build pipelines without writing code?โ–ผ

Yes. The visual canvas offers 46 node types with live data previews, and flows can later be exported as plain Python scripts when you need code.

Does Flowfile work with AI coding agents?โ–ผ

Yes. The included skills teach your agent the repo's architecture, node development, testing, and debugging runbooks so it can work on the codebase reliably.

Can Flowfile run in a browser or Docker?โ–ผ

Yes. A browser-only WASM version runs fully client-side via Pyodide, and a Docker Compose stack provides multi-user accounts, sharing, and a shared catalog.

Related Repositories in Data & Analytics

View All in Data & Analyticsโ†’