isaac-sim-sdg

Configure and orchestrate Isaac Sim 5.1+ SDG pipelines with YAML configs.

Updated Jun 2, 2026
One-click install
npx skills add https://github.com/liuquangao/isaac-sim-skills --skill isaac-sim-sdg
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: isaac-sim-sdg
Source: https://github.com/liuquangao/isaac-sim-skills/tree/main/skills/isaac-sim-sdg
Command: npx skills add https://github.com/liuquangao/isaac-sim-skills --skill isaac-sim-sdg

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The Isaac Sim SDG reference provides a comprehensive guide to configure, orchestrate, and troubleshoot Synthetic Data Generation pipelines within Isaac Sim 5.1+ using the Action and Event Data Generation platform (IRA, IRO, IRC, IRI) and RTX sensor planning, enabling researchers to generate labeled vision datasets with repeatable workflows.

Core Features & Use Cases

  • Domain-relevant SDG pipelines: configure actor simulation, object randomization, captioning, physical events, and camera placement for synthetic data generation.
  • End-to-end data generation: create indoor-scene datasets with annotations, captions, and event logs suitable for model training and evaluation.
  • Use Case: design a multi-agent indoor environment with incidents and writers to produce rich, labeled data for vision AI pipelines.

Quick Start

Provide a minimal YAML SDG config and bootstrap an Isaac Sim 5.1+ run.

Frequently Asked Questions about isaac-sim-sdg

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure synthetic data generation pipelines in Isaac Sim?

You configure synthetic data generation pipelines in Isaac Sim by defining YAML-based config files that orchestrate actor simulation, object randomization, and sensor placement. This automates end-to-end generation of labeled vision datasets for AI training.

What is the Isaac Sim SDG pipeline used for?

The Isaac Sim SDG pipeline is used to generate rich, labeled synthetic vision datasets by orchestrating multi-agent indoor environments. It enables researchers to capture annotated data, captions, and physical event logs suitable for model training and evaluation.

Do I need a specific Isaac Sim version to run YAML-based SDG pipelines?

Yes, you need Isaac Sim 5.1 or later to run these YAML-based SDG pipelines. It requires a pip-installed Isaac Sim environment to ensure compatibility with the Action and Event Data Generation platform components like IRA, IRO, and RTX sensors.

Can I generate annotated indoor-scene datasets using Isaac Sim?

Yes, you can generate annotated indoor-scene datasets using Isaac Sim by configuring multi-agent environments with physical incidents. The pipeline produces comprehensive outputs including annotations, captions, and event logs for vision AI pipelines.

How does RTX sensor planning work in synthetic data generation?

RTX sensor planning in synthetic data generation works by defining camera placement and sensor configurations within your YAML pipeline. It allows precise control over data capture perspectives for generating labeled visual datasets in virtual worlds.

What are the limitations of YAML config definitions for Isaac Sim SDG?

YAML config definitions for Isaac Sim SDG require strict alignment with Isaac Sim's extension namespace. Limitations include dependency on a pip-installed Isaac Sim 5.1+ environment and compatibility constraints with the IRA, IRO, IRC, and IRI components.