compass

Orchestrate COMPASS robot navigation training from SAGE-10k scene search to OSMO cloud submission.

125|14|Updated Feb 21, 2025
One-click install
npx skills add https://github.com/NVlabs/COMPASS --skill compass-nvlabs
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: compass
Source: https://github.com/NVlabs/COMPASS/tree/main/.claude/skills/compass
Command: npx skills add https://github.com/NVlabs/COMPASS --skill compass-nvlabs

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires huggingface_hub, numpy, isaacsim, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill eliminates the fragmented, manual work of setting up and running COMPASS cross-embodiment mobility policy training, unifying scene search, USD conversion, scene registration, training, evaluation, and cloud submission into a single guided workflow to reduce setup time and avoid costly errors from broken scenes or misconfigured commands.

Core Features & Use Cases

  • SAGE-10k Scene Integration: Search the 10,000-scene SAGE-10k dataset by natural language description, convert matching scenes to USD format, and register them for COMPASS training without manual scene generation.
  • Guided Training Pipeline: Orchestrate residual RL training runs with mandatory visual verification gates to catch invalid scenes or robot spawn issues before launching expensive full-scale training, plus evaluation of trained checkpoints.
  • Cloud Submission Support: Submit training workloads to OSMO cloud clusters directly from the workflow for scaled training without manual container and workflow configuration.
  • Use Case: A robotics researcher can request "train a navigation policy for a cluttered warehouse scene" and the skill will handle searching for a matching SAGE-10k scene, converting it to USD, verifying it in Isaac Sim, registering it, running a preview training run for user confirmation, and launching the full training job.

Quick Start

Use the compass skill to train a cross-embodiment navigation policy for a bedroom scene by searching SAGE-10k for a matching layout, converting it to USD, verifying the scene in Isaac Sim, and launching a full training run with a preview check for confirmation.

Frequently Asked Questions about compass

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a cross-embodiment robot navigation policy using SAGE-10k scenes?

Cross-embodiment robot navigation policy training with SAGE-10k involves searching the dataset by natural language, converting matching scenes to USD format, and registering them for residual RL training. The compass skill orchestrates this end-to-end workflow including evaluation and cloud submission.

Can I search the SAGE-10k dataset by natural language description for robot navigation training?

Yes, SAGE-10k dataset scene search supports natural language descriptions to find matching layouts for robot navigation training. The compass skill handles searching 10,000 scenes, converting results to USD format, and registering them for COMPASS training workflows without manual scene generation.

Do I need Isaac Sim to verify scenes before running residual RL navigation training?

Isaac Sim visual verification is required as a mandatory gate to catch invalid scenes or robot spawn issues before launching expensive full-scale residual RL training. The compass skill enforces this verification step to prevent GPU-intensive training on broken scenes.

What's the best way to submit robot navigation training workloads to OSMO cloud clusters?

Submitting robot navigation training workloads to OSMO cloud clusters is streamlined through the compass skill, which handles container and workflow configuration automatically. This enables scaled training directly from the guided pipeline without manual cloud setup or configuration steps.

How does USD scene conversion and registration work for COMPASS navigation training?

USD scene conversion transforms SAGE-10k matching scenes into Isaac Sim compatible format, followed by registration for COMPASS training. The compass skill automates this pipeline execution, eliminating manual context switching between scene management and training configuration steps.

Why does my COMPASS navigation training workflow require a preview training run?

A preview training run provides mandatory visual verification to catch invalid scenes or robot spawn issues before launching expensive full-scale training. The compass skill enforces this gate to prevent GPU-intensive training on broken scenes and requires user confirmation before proceeding.