~/projects/reinforcement-learning

Reinforcement Learning

Policy training and evaluation in Genesis and Isaac Sim.

Standard and custom cartpole environments trained across many parallel instances, then evaluated as single rollouts.

  • genesis
  • isaac-sim
  • parallel-envs
  • policy-eval
Isaac Sim viewport with a grid of parallel training environments

Genesis Sim · typical cartpole

The classic balancing task as a baseline.

01

Training

parallel envs
Genesis viewer showing many cartpole environments training on a checkered floor
02

Evaluation

single rollout
Genesis viewer showing a single cartpole balancing during evaluation

Genesis Sim · custom cartpole

A custom cartpole model in the same training loop.

01

Training

parallel envs
Genesis viewer with many custom cartpole environments and their coordinate frames
02

Evaluation

single rollout
Genesis viewer with the custom cartpole evaluated on its own

Isaac Sim · RL

The same workflow in NVIDIA Isaac Sim.

01

Training

parallel envs
Isaac Sim with a grid of robots training in parallel
02

Evaluation

single rollout
Isaac Sim with a single robot during evaluation