test-in-simulation

Run end-to-end Isaac Sim simulation tests with monitoring and ROS bag recording.

84|28|Updated Jun 7, 2024
One-click install
npx skills add https://github.com/castacks/AirStack --skill test-in-simulation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-in-simulation
Source: https://github.com/castacks/AirStack/tree/main/.agents/skills/test-in-simulation
Command: npx skills add https://github.com/castacks/AirStack --skill test-in-simulation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

After implementing and integrating a module, test it in the full Isaac Sim simulation environment to verify end-to-end functionality, including monitoring, recording, and analysis of simulation tests.

Core Features & Use Cases

  • Simulation environment validation: verify the module launches and participates in the autonomy stack.
  • Monitoring & analysis: observe nodes, topics, and performance metrics during test runs.
  • Recording & regression checks: capture ROS bags for post-test analysis and regression testing.

Quick Start

Start the full Isaac Sim simulation, launch the module, and execute the predefined test scenarios to confirm correct behavior.

Frequently Asked Questions about test-in-simulation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run end-to-end module tests in Isaac Sim?

To run end-to-end module tests in Isaac Sim, start the full simulation, launch your module, and execute predefined test scenarios to verify autonomous stack functionality. This validates correct behavior and integration.

What do I need to set up before testing autonomy modules in simulation?

Testing autonomy modules in simulation requires a working autonomy stack, Isaac Sim container access, and test scenarios defined in SKILL.md. These prerequisites ensure the environment can execute and monitor full simulation runs.

Can I record ROS bags during Isaac Sim scenario tests for regression analysis?

Yes, you can record ROS bags during Isaac Sim scenario tests for post-test analysis and regression checks. This captures topics and performance metrics to verify module behavior across local and remote setups.

How does simulation validation verify that a ROS2 node participates in the autonomy stack?

Simulation validation verifies a ROS2 node by launching the module in the Isaac Sim environment and monitoring nodes, topics, and performance metrics during test runs. This confirms end-to-end participation and correct behavior.

What is the best way to monitor performance metrics during an Isaac Sim test run?

The best way to monitor performance metrics during an Isaac Sim test run is to use automated scenario testing tools that observe nodes and topics while executing predefined scenarios. This enables real-time monitoring and result analysis.

When should I use Isaac Sim for end-to-end testing instead of local unit tests?

Use Isaac Sim for end-to-end testing after implementing and integrating a module, when you need to verify full simulation environment functionality including monitoring, recording, and analysis. Local unit tests lack the full autonomy stack context.