isaac-rl

Guides RL locomotion policy development for Unitree G1 using NVIDIA Isaac Sim and Isaac Lab.

Updated Mar 18, 2026
One-click install
npx skills add https://github.com/robotics-playground/skills --skill isaac-rl
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: isaac-rl
Source: https://github.com/robotics-playground/skills/tree/main/skills/isaac-rl
Command: npx skills add https://github.com/robotics-playground/skills --skill isaac-rl

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Expert guidance for NVIDIA Isaac Sim/Lab RL robotics. Use this skill to accelerate setup, experimentation, and interpretation of results when building reinforcement learning locomotion policies for humanoid robots such as Unitree G1.

Core Features & Use Cases

  • Guidance on designing RL workflows for Isaac Sim and Isaac Lab, including environment design, reward shaping, and domain randomization.
  • Practical use cases spanning sim-to-real transfer, curriculum learning, and policy deployment for robotics locomotion.
  • Framework-aligned best practices for PPO, SAC, and TD3 workflows, observation/action space definitions, and evaluation strategies.

Quick Start

Run a PPO walk-through in Isaac Lab to initialize a Unitree G1 locomotion task and begin training.

Frequently Asked Questions about isaac-rl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a reinforcement learning locomotion policy for Unitree G1 in Isaac Sim?

To train a Unitree G1 locomotion policy in Isaac Sim, initialize the task in Isaac Lab and run a PPO walk-through to configure the environment, set observation and action spaces, and begin the training pipeline.

What is sim-to-real transfer and how does domain randomization work for robotics RL?

Sim-to-real transfer deploys policies trained in simulation to physical robots; domain randomization varies simulation physics, dynamics, and visuals during RL training to ensure the learned locomotion policy generalizes to real-world conditions.

Can I use SAC or TD3 instead of PPO for humanoid robot locomotion in Isaac Lab?

Yes, Isaac Lab supports SAC and TD3 workflows alongside PPO for humanoid robot locomotion; this guidance covers framework-aligned best practices for configuring these algorithms, observation spaces, and evaluation strategies across all three.

What's the best way to design reward shaping and curriculum learning for RL locomotion policies?

The best way to design reward shaping and curriculum learning for RL locomotion policies is to systematically structure environment rewards and progressively increase task difficulty, guiding the robot toward stable walking behaviors during training.

Does Isaac Sim require specific environment setup or observation space definitions to start RL training?

Yes, Isaac Sim requires defining observation and action spaces, configuring the RL environment, and setting up domain randomizations before initializing PPO, SAC, or TD3 training pipelines for the Unitree G1 humanoid robot.

Why does my RL policy fail during sim-to-real deployment on a humanoid robot?

RL policies often fail during sim-to-real deployment due to insufficient domain randomization, poorly shaped rewards, or observation space mismatches; addressing these environment design factors and deployment considerations improves transfer to the physical Unitree G1.