dag-task-runner

Execute interdependent task workflows defined as directed acyclic graphs.

64|2|Updated Nov 8, 2021
One-click install
npx skills add https://github.com/FlatbreadLabs/flatbread --skill dag-task-runner
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dag-task-runner
Source: https://github.com/FlatbreadLabs/flatbread/tree/main/.cursor/skills/dag-task-runner
Command: npx skills add https://github.com/FlatbreadLabs/flatbread --skill dag-task-runner

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill solves the challenge of orchestrating complex, interdependent task workflows by using directed acyclic graph (DAG) structures to automatically manage task execution order, dependencies, and state, eliminating the need for manual sequencing and error-prone ad-hoc task management.

Core Features & Use Cases

  • DAG-Based Task Orchestration: Automatically execute tasks in the correct order based on their defined dependencies, ensuring that prerequisite tasks complete before dependent tasks run.
  • State Persistence: Save workflow run state between executions to resume interrupted workflows from their last successful step instead of restarting from the beginning.
  • Supervisor Mode: Run a long-lived supervisor process to monitor DAG task execution, handle long-running workflows, and manage execution across multiple runs.
  • Use Case: Use this skill to run a content processing pipeline where tasks like content validation, transformation, and deployment must run in a specific order, with the ability to pause and resume the pipeline if errors occur.

Quick Start

Use the dag-task-runner skill to execute the DAG workflow defined in the 'pipeline.json' file in your current project, using the default state directory to persist run progress between executions.

Frequently Asked Questions about dag-task-runner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run interdependent tasks in a specific order automatically?

To execute interdependent tasks automatically, define them in a directed acyclic graph (DAG) JSON schema. The dag-task-runner orchestrates task execution order based on dependencies, ensuring prerequisite tasks complete before dependent tasks run.

What is the best way to resume a data processing pipeline if it fails midway?

To resume a data processing pipeline midway, use a task runner with state persistence. This approach saves workflow run state between executions, allowing interrupted pipelines to resume from their last successful step instead of restarting from the beginning.

Can I monitor long-running workflow execution across multiple runs?

Yes, you can monitor long-running workflow execution using supervisor mode. This feature runs a long-lived supervisor process to manage DAG task execution, handle long-running workflows, and monitor execution across multiple runs.

Does dag-task-runner require a specific format for defining workflow dependencies?

DAG task execution requires a standard DAG JSON schema definition for task configuration. This format defines your workflow dependencies, allowing the orchestrator to automatically sequence tasks like content validation, transformation, and deployment.

When do I need a directed acyclic graph for task orchestration?

You need a directed acyclic graph for task orchestration when managing complex pipelines with strict dependencies, such as content validation workflows or build and test orchestration. It eliminates manual task sequencing and error-prone ad-hoc task management.