Notebookcheck Logo

Google DeepMind's Genie 2 is a real-time 3D world generator

Google DeepMind's Genie 2 is a real-time 3D world generator (Image Source: Google DeepMind)
Google DeepMind's Genie 2 is a real-time 3D world generator (Image Source: Google DeepMind)
Google DeepMind has announced Genie 2, a foundational world AI model that can create real-time, interactable 3D environments. The company says this will enable fast prototyping for interactive experiences and help with training AI agents.

Google DeepMind, an AI research subsidiary for Google, has announced Genie 2, a foundational world model that can create "action-controllable, playable 3D environments," for rapid prototyping and training AI agents. 

The company says that Genie 2 builds on the work of its predecessor and can create "a vast diversity of rich 3D worlds." It can simulate object interactions, character animations, physics, and Non-Playable Characters (NPC) with their animations and interactions. The model accepts both text and visual prompts. 

Genie 2 can remember parts of the world that are not observable to the player and render them when they become viewable again, similar to how Level of Detail (LOD) works in games by adjusting the complexity of objects and environments based on the player's Field Of View (FOV). 

The model can generate new content in real time and maintain a consistent world "for up to a minute." It can also render environments from multiple perspectives, including first-person, third-person, or isometric. 

It can also generate advanced effects like smoke, object interactions, fluid dynamics, gravity, and advanced lighting and reflections. DeepMind says the model can enable rapid prototyping of new concepts and ideas. You can also create and control AI agents through simple prompts. 

Many companies are building foundational world models that can simulate and create representations of an environment. For example - Decart's Oasis lets you play a real-time AI-generated version of Minecraft, and AI pioneer Fei Fei Li's start-up, World Labs, also has a 3D generator.  

static version load dynamic
Loading Comments
Comment on this article
Please share our article, every link counts!
Mail Logo
> Expert Reviews and News on Laptops, Smartphones and Tech Innovations > News > News Archive > Newsarchive 2024 12 > Google DeepMind's Genie 2 is a real-time 3D world generator
Rohith Bhaskar, 2024-12- 6 (Update: 2024-12- 6)