Interactive World Simulation with Cosmos for Physical AI
In briefReal-time interactive world simulation with Cosmos for training physical AI
SummaryThis paper presents a shared framework that adapts Cosmos world foundation models for real-time interactive simulation. It streams visual observations in response to actions and scene controls, letting users and embodied agents interact with evolving virtual environments. The approach is demonstrated on camera navigation, robot manipulation, controllable video transfer, and multi-view autonomous vehicle simulation, with code and model checkpoints released.