isaac-camera

Create and configure RTX camera sensors with annotators and lens distortion in Isaac Sim.

4.0k|530|Updated May 28, 2025
One-click install
npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-camera
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: isaac-camera
Source: https://github.com/isaac-sim/IsaacSim/tree/main/skills/isaac-camera
Command: npx skills add https://github.com/isaac-sim/IsaacSim --skill isaac-camera

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Setting up simulated cameras in Isaac Sim requires navigating USD camera prims, RTX sensor wrappers, Replicator annotators, and lens distortion schemas, and this Skill consolidates that workflow into tested patterns for Isaac Sim 6 / Kit 110.

Core Features & Use Cases

  • Camera Authoring & Runtime Capture: Create cameras with RtxCamera and capture RGB, depth, segmentation, and bounding-box data through CameraSensor, TiledCameraSensor, or plain UsdGeomCamera plus Replicator render products.
  • Lens Distortion & Calibration: Apply OpenCV pinhole, OpenCV fisheye, or LUT distortion via OmniLensDistortion*API schemas, and convert real-world OpenCV/ROS intrinsics into USD focal length, aperture, and principal-point offsets.
  • Animation & Synthetic Data: Animate camera transforms with keyframes and randomize camera poses with Replicator for synthetic data generation.
  • Use Case: You are building a multi-camera rig for reinforcement learning data collection and need fisheye distortion matching a real calibrated camera; this Skill shows the exact schema attributes and intrinsics conversion code.

Quick Start

Ask the AI to create an RTX camera in Isaac Sim with an RGB and depth annotator at a given resolution and focal length.

Frequently Asked Questions about isaac-camera

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a camera in Isaac Sim and capture RGB images?

Create an RtxCamera prim, wrap it in a CameraSensor with a resolution and annotator list such as rgb, then call play and read frames with sensor.get_data. Alternatively, define a UsdGeom.Camera and attach Replicator annotators to a render product.

How to convert OpenCV camera intrinsics to USD camera parameters?

Compute focal length as fx times sensor width divided by image width, set horizontal aperture to the sensor width, and derive vertical aperture from fy to preserve aspect. Set aperture offset attributes from the principal point offsets cx and cy relative to image center.

What is the difference between isaacsim.sensors.camera.Camera and RtxCamera?

The legacy Camera class is now a stub; the implementation moved to isaacsim.sensors.experimental.rtx. New code should use RtxCamera for authoring plus CameraSensor for runtime capture, following the official migration table for renamed methods like set_focal_lengths.

Does Isaac Sim support fisheye lens distortion on cameras?

Yes, apply the OmniLensDistortionOpenCvFisheyeAPI schema to the camera prim and set attributes such as fx, fy, cx, cy, k1, and imageSize. OpenCV pinhole and LUT-based distortion schemas are also supported.

How do I simulate multiple cameras efficiently for RL data collection?

Use TiledCameraSensor, which batches many cameras into a single render call, making it suitable for multi-view reinforcement learning data collection. SingleViewDepthCameraSensor is available for stereo-style depth simulation.

Why are my Isaac Sim camera focal length values wrong after migration?

USD expresses focal length and apertures in tenths of a scene unit, so a 35 mm lens is 35 on a centimeter-stage but 0.025 on a meter-stage. Check your stage units and use the new set_focal_lengths API instead of the legacy setter.