di-agent-flow-pyflow

Generate IBM watsonx.data integration flows from natural-language requirements using pyflow.

3|Updated May 1, 2026
One-click install
npx skills add https://github.com/IBM/ibm-watsonx-data-integration-skills --skill di-agent-flow-pyflow
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: di-agent-flow-pyflow
Source: https://github.com/IBM/ibm-watsonx-data-integration-skills/tree/main/agent/skills/di-agent-flow-pyflow
Command: npx skills add https://github.com/IBM/ibm-watsonx-data-integration-skills --skill di-agent-flow-pyflow

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you turn high-level data integration requirements into valid IBM watsonx.data integration flows without hand-building every stage, wiring, and connection detail.

Core Features & Use Cases

  • Natural-language flow authoring: Describe a source, transformation, join, or sink and generate a pyflow-based flow structure.
  • Fast structural bootstrapping: Use pyflow to create new flows or major structural changes before refining expressions and properties in the SDK.
  • Compile-time validation: Catch schema, wiring, and flow-shape issues early for more reliable DataStage and StreamSets authoring.
  • Use cases: Build production-grade ingestion pipelines, add joins or filters to existing flows, and adapt flows for editing with minimal token overhead.

Quick Start

Ask the AI to create a watsonx.data integration flow for your source, transformations, and destination using pyflow.

Frequently Asked Questions about di-agent-flow-pyflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate DataStage pipelines from natural language requirements?

You can generate DataStage pipelines from natural language by describing your sources, transformations, joins, and sinks, which produces a pyflow-based flow structure with compile-time validation for wiring and schema accuracy.

Can I build StreamSets flows in watsonx.data using plain English?

Yes, you can build StreamSets flows in watsonx.data by providing high-level data integration requirements in plain English, allowing the system to bootstrap the structural pipeline components before you refine stage-specific properties.

What is the best way to add joins and filters to existing data integration flows?

The best way to add joins and filters to existing data integration flows is to describe the structural edits in natural language, generating pyflow authoring code that validates flow shape and catches wiring issues early.

Does watsonx.data flow authoring support compile-time validation for pipeline generation?

Watsonx.data flow authoring supports compile-time validation through pyflow, catching schema mismatches, flow-shape issues, and wiring errors early to ensure reliable DataStage and StreamSets pipeline generation.

When should I use the SDK instead of natural language for pyflow authoring?

You should use the SDK instead of natural language pyflow authoring when you need to refine unsupported expressions, adjust stage-specific properties, or apply granular refinements after the initial structural pipeline bootstrapping.

What are the limitations of generating data integration flows from plain English?

Generating data integration flows from plain English is limited to structural bootstrapping and requires precise SDK follow-up for unsupported expressions, stage-specific refinements, and complex property adjustments beyond initial flow creation.