Flowfile
Visual ETL pipelines that compile to Polars code
All Skills in This Repository (17)
Pure Emerald Level Indicatorsflowfile-docs-review
Verifies and maintains editorial standards, style guides, and persona-based navigation for technical documentation.
flowfile-architecture-contract
Document Flowfile ETL architecture and design contracts for core components.
flowfile-frame-and-codegen
Document the Flowfile Frame API internals, generated code mechanics, and execution semantics.
flowfile-frontend-conventions
Define Vue 3 and Tauri 2 frontend conventions for the Flowfile application.
flowfile-build-and-env
Sets up the complete Flowfile development environment including Docker, WASM, and Makefile targets.
flowfile-node-development
Guide development of Flowfile node types across core, frontend, Python API, and WASM layers.
flowfile-failure-archaeology
Review Flowfile incident history and design decisions for worker transport issues.
flowfile-run-and-operate
Run and operate Flowfile ETL via CLI commands and service startup.
flowfile-testing-and-validation
Automates execution and validation of unit, integration, and E2E tests for the Flowfile monorepo.
flowfile-research-frontier
Scope and validate exploratory Flowfile research projects with falsifiable milestones.
flowfile-codegen-parity-campaign
Test parity between Flowfile flows, exported Python code, and FlowFrame API.
flowfile-ai-subsystem
Guide debugging and extension of Flowfile's AI subsystem with Python.
Frequently Asked Questions
FAQPage SchemaHow to install Flowfile?โผ
Run `npx skills add Edwardvaneechoud/Flowfile --all -g -y` in your terminal to install all skills in this suite globally.
What is Flowfile used for?โผ
Flowfile is a visual ETL platform for building data pipelines on a drag-and-drop canvas or in Python, with every flow compiling down to Polars. It handles extraction from files, databases, cloud storage, Kafka, and APIs, plus transformation, scheduling, and cataloging.
Can I build pipelines without writing code?โผ
Yes. The visual canvas offers 46 node types with live data previews, and flows can later be exported as plain Python scripts when you need code.
Does Flowfile work with AI coding agents?โผ
Yes. The included skills teach your agent the repo's architecture, node development, testing, and debugging runbooks so it can work on the codebase reliably.
Can Flowfile run in a browser or Docker?โผ
Yes. A browser-only WASM version runs fully client-side via Pyodide, and a Docker Compose stack provides multi-user accounts, sharing, and a shared catalog.
Related Repositories in Data & Analytics
View All in Data & AnalyticsโPaddleOCR
Extract text, tables, and formulas from PDFs and images
Scrapling
Scrape any website and bypass anti-bot protection with AI
last30days-skill
Research any topic across Reddit, X, YouTube, and the web