20.8 C
New York
Friday, February 21, 2025

Microsoft Muse AI Model Unveiled; Can Generate Game Visuals and Controller Actions


Microsoft researchers launched a brand new synthetic intelligence (AI) mannequin on Wednesday that may generate 3D gameplay environments. Dubbed the World and Human Action Model (WHAM) or Muse, the brand new AI mannequin was developed by the tech large’s Research Game Intelligence and Teachable AI Experiences (Tai X) groups in collaboration with Xbox Games Studios’ Ninja Theory. The firm stated that the big language mannequin (LLM) will help sport designers within the ideation course of, in addition to assist generate sport visuals and controller actions to assist creatives in sport growth.

Microsoft Unveils Muse AI Model

In a blog post, the Redmond-based tech large detailed the Muse AI mannequin. This is a analysis product presently, though the corporate stated that it’s open-sourcing the weights and pattern knowledge of the mannequin for the WHAM Demonstrator (an idea prototype of a visible interface to work together with the AI mannequin). Developers can check out the mannequin on Azure AI Foundry. A paper detailing the technical points of the mannequin is printed within the Nature journal.

To prepare a mannequin on such a posh space is a tough proposition. Microsoft researchers collected a considerable amount of human gameplay knowledge from the 2020 sport Bleeding Edge, a sport printed by Ninja Theory. The LLM was educated on a billion picture motion pairs, which is equal to seven years of human gameplay. The knowledge is claimed to be collected ethically and is used just for analysis functions.

The researchers stated that scaling up the mannequin coaching was a significant problem. Initially, Muse was educated on a cluster of Nvidia V100 GPUs, however then it was scaled to a number of Nvidia H100 GPUs.

Coming to the performance, the Muse AI mannequin accepts textual content prompts in addition to visible inputs. Additionally, as soon as a sport setting is generated, it may be additional enhanced utilizing controller actions. The AI responds to the actions made by the person to render new environments aligned with the preliminary immediate, and according to the remainder of the gameplay.

Due to being a singular AI mannequin, typical benchmark assessments can’t correctly consider its capabilities. The researchers highlighted that they’ve internally examined the LLM on metrics akin to consistency, variety, and persistence. Since it’s a research-focused mannequin, the outputs have been restricted to only 300x180p decision.

Affiliate hyperlinks could also be routinely generated – see our ethics assertion for particulars.



Latest Posts

Don't Miss