skills.rest
isaac-sim
isaac-simOFFICIAL
Explore all skills by this author →
GitHub

isaac-sim-rendering

Captures and validates headless rendered frames from Isaac Sim with lighting and tone mapping recipes.

4.0k|530|Updated May 28, 2025
Search Tags:#synthetic data#isaac sim#lighting#tone mapping#replicator#headless rendering#robotics simulation
One-click install
npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-rendering
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: isaac-sim-rendering
Source: https://github.com/isaac-sim/IsaacSim/tree/main/skills/isaac-sim-rendering
Command: npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-rendering

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Headless Isaac Sim rendering produces black, underexposed, or overexposed frames without explicit lighting, correct renderer settings, and tone mapping calibration, wasting hours of trial-and-error tuning.

Core Features & Use Cases

  • Headless Capture Pipeline: Uses SimulationApp with the Replicator RGB annotator to capture frames at any resolution, including on ARM64 platforms.
  • Lighting & ACES Calibration: Provides validated DomeLight/DistantLight baselines, multi-layer warehouse lighting recipes, and ACES filmIso settings for warehouse, deep-aisle, and overview scenes.
  • Frame Quality Validation: Supplies numeric thresholds (mean/max RGB, file size) to detect black, underexposed, or overexposed frames before delivery.
  • Use Case: Generate a synthetic dataset of a warehouse robot by configuring RT2 rendering, injecting multi-layer aisle lighting, settling 500 frames, and validating each captured frame before assembling video with ffmpeg.

Quick Start

Ask the AI to set up a headless Isaac Sim render of your USD stage with RT2, ACES tone mapping, and validated lighting, then capture frames to disk.

Frequently Asked Questions about isaac-sim-rendering

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I capture frames from headless Isaac Sim?▼

Launch SimulationApp with headless=True and your target resolution, define a USD camera prim, then attach a Replicator RGB annotator to a render product. Step the app for about 200 settle frames before reading annotator data as an RGBA array.

Should I use RayTracedLighting or PathTracing in Isaac Sim?▼

Default to RayTracedLighting (RT2), which converges in roughly 200 settle frames at 10-15 seconds per frame. Reserve PathTracing for final hero shots only, since it takes 5-30 minutes per frame.

Why are my headless Isaac Sim renders completely black?▼

Headless Isaac Sim has no default lighting, so frames render black without explicit lights. Add at least a DomeLight plus a DistantLight, and enable ACES tone mapping to balance exposure.

What filmIso value should I use for ACES tone mapping?▼

Use filmIso 200 for general warehouse scenes, 400 for aerial or overview-heavy shots, and 600 for deep-aisle indoor scenes. These values were validated on warehouse interiors with RT2 rendering.

How do I validate rendered frames for quality?▼

Check that rgb.max() is nonzero, the mean falls between roughly 30 and 200, and file size exceeds 200KB. A mean above 220 indicates overexposure and below 10 indicates underexposure requiring lighting changes.

Can Replicator capture Gaussian splat scenes in Isaac Sim?▼

Replicator render products may return empty arrays for Gaussian splat scenes. In that case, fall back to swapchain capture with the window size explicitly set to match the render resolution.

Related Skills

Explore More Software Engineering Skills→
kickthemoon0817kickthemoon0817
1

robot-asset-import

Import USD or URDF robot assets into Isaac Sim scenes.

Community
Intermediate
vivekvkashyapvivekvkashyap
27

synthetic-self-improve-rl

Iteratively post-train machine learning models using synthetic datasets.

Community
Advanced
khanaleemakhanaleema

sensor-integration

Generate Pyodide-compatible Python code for sensor fusion and perception simulations.

Community
Advanced
axel-kaliffaxel-kaliff

smoke-render

Render RGB and depth PNG frames from a robosuite Lift environment using MuJoCo or Isaac Sim.

Community
Intermediate