Xbox Reveals Muse AI Model for Gameplay Experimentation

Microsoft revealed today Muse AI, a new generative AI model designed for game ideation created in collaboration between Xbox and Microsoft Research. Muse has been trained using Bleeding Edge, the multiplayer arena game from Hellblade 2 developer Ninja Theory, and Microsoft believes it can help developers during the game ideation process by simultating real-time gameplay.

Another use-case for Muse that Microsoft suggested today is game preservation: AI technology could indeed become a cost-effective solution for developers interested in porting old games to modern platforms.

“What’s groundbreaking about Muse is its detailed understanding of the 3D game world, including game physics and how the game reacts to players’ controller actions. This allows the model to create consistent and diverse gameplay rendered by AI, demonstrating a major step toward generative AI models that can empower game creators,” explained Fatima Kardar, Corporate Vice President, Gaming AI at Microsoft.

Xbox’s Muse AI is currently capable of generating game visuals, controller actions, or both, but it has some important limitations. The current AI technology can generate visuals at a resolution of 300×180 pixels, and previous models were limited to a 128×128 resolution. While it’s still early days, it’s probably inevitable that game development will be disrupted by generative AI technology. However, Microsoft wants to encourage a responsible of use of AI and engage with game developers early on.

“As we look ahead, we’re focused on how AI can address the barriers and frictions to playing and developing games,” Kardar said today. “This means that we’ll share our AI product innovation earlier on, providing opportunities for players and creators to experiment with and co-build new AI features and capabilities with us. This allows us to make sure that our AI innovations address real problems and add new value to creating or playing with Xbox.”

Microsoft plans to discuss AI Experiences from Xbox in greater detail ahead of the Game Developers Conference (GDC) in March. The company also plans to make a series of AI-powered game experiences on its Copilot Labs website where Copilot Pro subscribers can access various experimental AI features.