skills.rest
open-thoughts
open-thoughtsOFFICIAL
Explore all skills by this author →
WebsiteGitHub

datagen-launch-iris

Orchestrate datagen jobs on Marin's Iris TPU cluster from launch to cleanup.

276|37|Updated Dec 5, 2025
Search Tags:#orchestration#iris#tpu#datagen#tracegen
One-click install
npx skills add https://github.com/open-thoughts/OpenThoughts-Agent --skill datagen-launch-iris
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: datagen-launch-iris
Source: https://github.com/open-thoughts/OpenThoughts-Agent/tree/main/.claude/skills/datagen-launch-iris
Command: npx skills add https://github.com/open-thoughts/OpenThoughts-Agent --skill datagen-launch-iris

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Orchestrate end-to-end datagen jobs on Marin's Iris TPU cluster, enabling seamless launch, monitoring, and cleanup from a single entrypoint.

Core Features & Use Cases

  • End-to-end orchestration: launch a datagen/tracegen job, monitor progress, and perform manual cleanup when needed.
  • Sealed workflow with required inputs: tasks_input_path (HF dataset id or local directory), slug, and an operating point, ensuring reproducible runs.
  • Use Case: When asked to start a new Iris-based datagen run for a dataset slug, watch its status, and perform rescue or termination if issues arise.

Quick Start

Provide the required inputs (tasks_input_path, slug, and operating point) to the Iris launcher script to start a datagen job.

Frequently Asked Questions about datagen-launch-iris

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I launch a datagen job on an Iris TPU cluster?▼

To launch a datagen job on an Iris TPU cluster, provide the required tasks_input_path, slug, and operating point to the Iris launcher script to start the run.

What inputs are required to start an Iris datagen run?▼

Starting an Iris datagen run requires a tasks_input_path, which can be an HF dataset id or local directory, a slug, and a selected operating point.

How do I monitor and clean up tracegen jobs on Iris?▼

You can monitor and clean up tracegen jobs on Iris using the orchestration skill to watch job status and perform manual rescue or termination when issues arise.

Do I need Python 3.12 to run Iris datagen orchestration?▼

Yes, running Iris datagen orchestration requires a Python 3.12 environment to provision secrets and pass task inputs to the iris-based launcher.

Can I manually rescue a failed datagen run on Marin's Iris cluster?▼

Yes, you can manually rescue a failed datagen run on Marin's Iris cluster by using the end-to-end orchestration entrypoint to intervene and recover the job.

Related Skills

Explore More Software Engineering Skills→
sorodriguezzsorodriguezz

Using Embedded Python

Execute Python code and import packages within InterSystems IRIS.

Community
Intermediate
EmaRimoldiEmaRimoldi

experiment-data-builder

Convert experiment-plan specifications into Hydra-backed dataset generators and loaders.

Community
Advanced
tayyabexetayyabexe
3

hugging-face-datasets

Manage Hugging Face datasets with SQL querying via DuckDB.

Community
Advanced
open-thoughtsopen-thoughts
276

eval-agentic-launch-iris

Manages the full lifecycle of Iris evaluation jobs via the command line.

Official
Advanced