Fei-Fei Li

World Labs’ R2S2R Engine Clones a Single Robot Demo Into Thousands of Training Scenarios

World Labs has developed a new simulation engine called Real-to-Sim-to-Real (R2S2R) that can clone a single robot task into thousands of training scenarios by varying lighting, object placement, physical properties, and camera angles. This engine, which incorporates technology from the acquired startup SceniX, aims to overcome the bottleneck of accumulating sufficient real-world experience for robot deployment. The R2S2R engine reconstructs real-world robot demonstrations into interactive virtual worlds that behave physically the same, allowing control models trained in simulation to be effectively transferred to real hardware with minimal failure.