Realistic robot simulation and RL training before real-world deployment
Isaac Sim is a robotics simulation platform built on NVIDIA Omniverse that enables photorealistic, physically accurate simulations of robots and environments. It provides a comprehensive toolkit for robotics development, including physics simulation, sensor simulation, and visualization capabilities. Isaac Lab is a reinforcement learning framework built on top of Isaac Sim, designed for training and deploying RL policies for robotics applications.
Isaac Sim uses GPU-accelerated physics simulation to enable fast, realistic robot simulations that can run faster than real-time. Isaac Lab extends this with pre-built RL environments, training scripts, and evaluation tools for common robotics tasks like locomotion, manipulation, and navigation. Together, they provide an end-to-end solution for developing, training, and testing robotics applications entirely in simulation before deploying to real hardware.
You'll build Isaac Sim from source on your hardware platform and set up Isaac Lab for reinforcement learning experiments. This includes compiling the Isaac Sim engine, configuring the development environment, and running a sample RL training task to verify the installation.
Required:
Optional:
Use the matrix below to confirm your hardware platform, recommended default local settings, and whether multi-node applies.
| Hardware platform | OS | Memory | Recommended default local settings | Multi-node capable hardware |
|---|---|---|---|---|
| DGX Spark | DGX OS (Linux) | 128 GB Unified Memory | Isaac Sim build from source (linux-aarch64); Isaac Lab RL sample (Isaac-Velocity-Rough-H1) | — |
Hardware requirements
Software requirements
gcc --version shows version 11.xgit --version and git lfs version succeedv6.2.0 and Isaac Lab 3.0 at commit 4b081ff69eee56bb65137b762f2d265eb92ec36e from release/3.0.0, as shown in the Instructions. Use this Lab revision, which targets Sim 6.2; the earlier v3.0.0-EA tag targets Sim 6.1. Do not substitute the default develop branchesAll required assets can be found in the Isaac Sim and Isaac Lab repositories on GitHub: