open-dreamer

Orchestrate multi-GPU Open Dreamer world-model training on Nebius clusters.

17|8|Updated Apr 7, 2026
One-click install
npx skills add https://github.com/nebius/nebius-physical-ai --skill open-dreamer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: open-dreamer
Source: https://github.com/nebius/nebius-physical-ai/tree/main/skills/tools/open-dreamer
Command: npx skills add https://github.com/nebius/nebius-physical-ai --skill open-dreamer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires jax, flax, uv, decord, imageio, boto3, rerun-sdk, and includes scripts (resource) components.

What problem does it solve?

This skill addresses the complexity of onboarding and executing high-performance, multi-GPU world-model training pipelines, specifically the Dreamer 4 architecture, on Nebius infrastructure.

Core Features & Use Cases

  • Multi-GPU Training: Orchestrates JAX/Flax training pipelines across multi-GPU meshes with data-parallel strategies.
  • World-Model Simulation: Enables action-conditioned latent dynamics and video tokenization for predictive modeling.
  • Use Case: Robotics researchers can use this to train a causal video tokenizer on Minecraft VPT datasets and visualize predicted world-model rollouts in the Rerun viewer.

Quick Start

Execute the open-dreamer skill to initiate a multi-GPU training smoke test on the specified repository reference.

Frequently Asked Questions about open-dreamer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a Dreamer 4 world-model on multi-GPU infrastructure?

To train a Dreamer 4 world-model on multi-GPU infrastructure, you can use this skill to orchestrate JAX and Flax NNX data-parallel training meshes on Nebius clusters, handling causal video tokenization and latent dynamics.

What is action-conditioned latent dynamics training for physical AI?

Action-conditioned latent dynamics training for physical AI is a predictive modeling process that simulates world-model environments, enabling causal video tokenization and rollout visualization using tools like the Rerun viewer.

Do I need JAX and Flax to run the Open Dreamer pipeline?

Yes, you need JAX and Flax NNX configured in your environment to run the Open Dreamer pipeline, along with a multi-GPU resource profile to manage data-parallel training meshes on Nebius infrastructure.

Can I use causal video tokenization with Minecraft VPT datasets for robotics research?

Yes, you can use causal video tokenization with Minecraft VPT datasets for robotics research to train the Dreamer 4 world-model and visualize predicted rollouts in the Rerun viewer.

How does FVD scoring work in world-model simulation pipelines?

FVD scoring in world-model simulation pipelines evaluates the quality of generated video predictions by calculating the Frechet Video Distance, which is facilitated by the skill during the action-conditioned latent dynamics training process.

What limitations exist when running multi-GPU data-parallel training meshes for world-models?

Running multi-GPU data-parallel training meshes for world-models requires a configured Nebius multi-GPU resource profile and specific dependencies including JAX, Flax NNX, decord, and rerun-sdk to execute the pipeline successfully.