skills.rest
isaac-sim
isaac-simOFFICIAL
Explore all skills by this author →
GitHub

isaac-sim-orchestrator

Orchestrates natural-language requests into validated Isaac Sim robot simulations and renders.

4.0k|530|Updated May 28, 2025
Search Tags:#isaac sim#robot simulation# orchestration#USD#physx#multi-robot#headless rendering
One-click install
npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-orchestrator
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: isaac-sim-orchestrator
Source: https://github.com/isaac-sim/IsaacSim/tree/main/skills/isaac-sim-orchestrator
Command: npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-orchestrator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Building a working Isaac Sim scene requires coordinating asset import, physics configuration, robot control, rendering, and validation across many APIs; this Skill decomposes a natural-language request into verified capabilities and routes each to the right specialist skill so the final simulation actually runs and renders correctly.

Core Features & Use Cases

  • Task decomposition and routing: Maps requests to specialist skills (usd-pipeline, isaac-sim-rendering, physics-simulation, isaac-sim-validator) and verifies each capability in isolation before integration.
  • Multi-robot fleet simulation: Provides grid placement, collision groups, navigation kinematics, and VRAM-based scaling limits for warehouse scenes with Nova Carter, Spot, and other robots.
  • Rendering and debugging playbooks: Includes RT2/PathTracing settings, ACES tonemapping, lighting defaults, and symptom-to-fix tables for black frames, OOM crashes, and articulation issues.
  • Use Case: Ask for "6 Nova Carter robots in a warehouse with 100 racks, captured on video" and the Skill composes the USD scene, configures the PhysicsScene, launches a headless sim, validates the render, and delivers the video.

Quick Start

Ask the agent to create an Isaac Sim warehouse scene with several Nova Carter robots, run it headless on your GPU, and deliver a validated rendered video.

Frequently Asked Questions about isaac-sim-orchestrator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run a headless Isaac Sim simulation on a GPU?▼

Launch with isaac-sim.sh --exec script.py in a persistent session, set DISPLAY=:0 so viewport initialization succeeds, and use a small window with hideUi=1 to save GPU memory. Run nvidia-smi first to size num_envs and choose RT2 versus PathTracing.

How do I set up multiple robots in an Isaac Sim warehouse scene?▼

Load the warehouse USD shell, place robots with a grid placement function using OverridePrim references, and keep at least 2 m between mobile robot centers. Configure a PhysicsScene with TGS solver, CCD, and 60 steps per second, and add collision groups when needed.

Why does my Isaac Sim render come out black?▼

Black frames usually mean missing lights or wrong render mode. Add a DomeLight and DistantLight, force /rtx/rendermode to RayTracedLighting, and check nvidia-smi for GPU issues. Always validate renders before delivery.

How many robots can Isaac Sim simulate given my VRAM?▼

Capacity scales roughly linearly with VRAM: about 2 robots on 12 GB, 5 on 24 GB, 10 on 48 GB, and 20 on 96 GB. Use make_instanceable for shared mesh data and disable physics on robots outside the active zone to stretch limits.

What environment variables does this orchestration workflow require?▼

It requires ISAAC_SIM_DIR pointing to the Isaac Sim install or build output, ISAAC_LAB_DIR for the Isaac Lab checkout, and WORKSPACE_DIR for per-agent outputs and caches. On Windows, CIP_ROOT points to the content-pipeline install.

Related Skills

Explore More Software Engineering Skills→
AmirTlinovAmirTlinov

isaac-sim

Set up NVIDIA Isaac Sim environments, import URDF/MJCF assets, and configure sensors.

Community
Advanced
nebiusnebius
17

isaac-lab

Orchestrate Isaac Lab reinforcement learning simulations on Nebius GPU clusters.

Official
Advanced
Logos-LiberLogos-Liber
17

omniverse

Integrate with NVIDIA Omniverse for real-time 3D scene composition and collaboration.

Official
Advanced
castackscastacks
84

write-isaac-sim-scene

Orchestrate standalone Python scripts with Pegasus extension to establish custom Isaac Sim scenes.

Official
Advanced