Nvidia Cosmos AI Platform to Train and Develop Autonomous Vehicles and Robots Launched at CES 2025

Nvidia launched Cosmos, a brand new synthetic intelligence platform that incorporates a number of generative world basis fashions (WFMs), on Monday on the Consumer Electronics Show (CES) 2025. The platform doesn’t solely comprise these AI fashions but in addition embrace superior tokenisers, accelerated video processing pipeline, and guardrails that allow the platform to develop bodily AI programs similar to autonomous automobiles and robots. Additionally, the corporate open-sourced the WFMs and made it obtainable for educational and analysis functions. Nvidia additionally launched the Llama Nemotron household of AI fashions at CES 2025.

Nvidia Cosmos World Foundation Models

In a newsroom post, the tech large detailed its new Cosmos platform. The platform will solely host WFMs together with a number of elements that permit for the coaching and growth of bodily AI programs. Notably, bodily AI programs are machines that include mechanical elements and skill to work together and take actions in the actual world.

Nvidia highlighted that coaching and creating bodily AI programs, together with robots and autonomous automobiles, is a pricey enterprise because of the requirement of huge quantities of real-world information and a various vary of testing environments. Cosmos platform’s WFMs remedy each issues.

The tech large claimed that these world AI fashions can generate large quantities of photoreal and physics-based artificial information that can be utilized to coach bodily AI programs. The information may also be used to evaluate current robots by subjecting them to testing environments. Additionally, Nvidia Cosmos additionally permits builders to construct customized fashions by fine-tuning the WFMs.

Nvidia’s Cosmos world AI fashions include video search and understanding to permit builders to seek out particular coaching movies from the massive database. The fashions can draw on Nvidia Omniverse platform to generate physics-based managed 3D situations. The platform additionally gives simulation-based coaching for bodily AI.

These AI fashions can be found below an open mannequin licence and may be previewed by builders by way of Nvidia utility programming interface (API) catalogue or from Hugging Face. The tech large revealed that a number of firms centered on robotics and bodily AI have already adopted Cosmos. These embrace 1X, Agile Robots, Agility, Figure AI, Foretellix, Fourier, Galbot, Hillbot, IntBot, Neura Robotics, Skild AI, Virtual Incision, Waabi and XPENG, and Uber.