run-pipeline

Orchestrate ZenML pipelines for ETL, feature engineering, training, and evaluation.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/captainsparrow10/LLM-ENGINEERS-HANDBOOK --skill run-pipeline-captainsparrow10
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: run-pipeline
Source: https://github.com/captainsparrow10/LLM-ENGINEERS-HANDBOOK/tree/main/.claude/skills/run-pipeline
Command: npx skills add https://github.com/captainsparrow10/LLM-ENGINEERS-HANDBOOK --skill run-pipeline-captainsparrow10

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Orchestrating end-to-end ZenML pipelines to automate ETL, feature engineering, dataset generation, training, and evaluation.

Core Features & Use Cases

  • Supports ETL, feature engineering, dataset generation, training, and evaluation pipelines.
  • Provides pre-flight checks and clear pipeline commands for local development.

Quick Start

Start by ensuring Docker and ZenML services are up, then run the desired pipeline with its corresponding Poetry command.

Frequently Asked Questions about run-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run ZenML pipelines for ETL and training locally?

To run ZenML pipelines locally, you orchestrate ETL, feature engineering, and training tasks using specific Poetry commands after ensuring Docker and ZenML services are active. Pre-flight checks validate infrastructure prerequisites before execution.

What infrastructure do I need to orchestrate ZenML pipelines with Docker and Poetry?

Orchestrating ZenML pipelines requires Docker containers for MongoDB and Qdrant, ZenML server access, and Poetry installed. These infrastructure prerequisites coordinate ETL, feature engineering, and data-generation tasks during local development workflows.

Can I automate dataset generation and evaluation using ZenML pipelines?

Yes, you can automate dataset generation and evaluation by orchestrating end-to-end ZenML pipelines. The pipelines coordinate these tasks through predefined commands, automating the workflow from feature engineering through to model evaluation.

What is the best way to manage feature engineering pipelines in a local development environment?

The best way to manage feature engineering pipelines locally is orchestrating them with ZenML. This approach encodes specific pipeline names and commands, utilizing Docker containers and pre-flight checks to coordinate the workflow.

Why do my ZenML pipeline commands fail during local development?

ZenML pipeline commands fail during local development if infrastructure prerequisites are missing. Ensure Docker containers for MongoDB and Qdrant are running, ZenML server access is configured, and pre-flight checks pass before executing pipeline commands.

Does the run-pipeline Skill support end-to-end machine learning orchestration?

Yes, the run-pipeline Skill supports end-to-end machine learning orchestration by automating ETL, feature engineering, dataset generation, training, and evaluation pipelines through coordinated ZenML and Poetry commands.