isaac-sim-sensor

Configure RTX and physics sensors with Replicator pipelines in Isaac Sim 6.

4.0k|530|Updated May 28, 2025
One-click install
npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-sensor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: isaac-sim-sensor
Source: https://github.com/isaac-sim/IsaacSim/tree/main/skills/isaac-sim-sensor
Command: npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-sim-sensor

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Setting up cameras, lidar, radar, acoustic, IMU, and contact sensors in Isaac Sim 6 / Kit 110 requires navigating new experimental namespaces, vendor asset catalogs, and asynchronous GMO output handling, which this Skill codifies into working patterns.

Core Features & Use Cases

  • RTX Sensor Setup: Create lidar, radar, acoustic, and RTX camera sensors via isaacsim.sensors.experimental.rtx, including the SUPPORTED_LIDAR_CONFIGS vendor catalog (Ouster, Hesai, Velodyne, Robosense) and USDA mount attachment.
  • Physics Sensors: Instantiate IMU, contact, effort, and joint-state sensors from isaacsim.sensors.experimental.physics with correct timeline play requirements.
  • Synthetic Data Generation: Build Replicator pipelines with annotators, writers (BasicWriter, KittiWriter, CosmosWriter, PoseWriter), and domain randomization triggers.
  • Use Case: Attach an Ouster OS1 lidar variant to a robot mount, consume its GenericModelOutput stream with a custom Writer, and capture randomized RGB/depth/segmentation data for training a perception model.

Quick Start

Use the isaac-sim-sensor skill to create an Ouster OS1 lidar on my robot and stream its point cloud output through a Replicator writer.

Frequently Asked Questions about isaac-sim-sensor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add a lidar sensor to a robot in Isaac Sim?

Use Lidar.create() from isaacsim.sensors.experimental.rtx with a config key from SUPPORTED_LIDAR_CONFIGS and a variant name, or reference a vendor USD asset under a mount prim and set the sensor variant set. The wrapper handles both authoring and runtime access.

How do I read lidar or radar data in Isaac Sim 6?

Attach a Replicator Writer to the sensor rather than polling get_data each frame. RTX sensors emit GenericModelOutput asynchronously under multitick, so polling drops or duplicates frames while the Writer sees every output event.

Which lidar models does Isaac Sim support out of the box?

The SUPPORTED_LIDAR_CONFIGS registry includes Ouster OS0/OS1/OS2/VLS-128, Hesai XT32 and Pandar series, Velodyne VLP/HDL, Robosense, SICK, Zvision, and NVIDIA example rotary and solid-state sensors, each with selectable variants.

Does Isaac Sim 6 still support the old isaacsim.sensors.physics API?

Legacy isaacsim.sensors.physics and camera classes still load, but the implementation moved to the experimental namespaces. New code should use isaacsim.sensors.experimental.rtx and isaacsim.sensors.experimental.physics per the official migration guides.

Why does my IMU or contact sensor return no data in Isaac Sim?

Physics sensors only stream while the timeline is playing. Call app_utils.play(commit=True) or timeline.play() before invoking get_data(), otherwise the sensor produces no readings.

How do I create a custom lidar scan pattern in Isaac Sim?

Author a USDA prim with the OmniSensorGenericLidarCoreAPI schema and define emitter-state arrays for azimuth, elevation, and fire time per beam. Then wrap the existing prim with Lidar(path) without a config argument.