Google DeepMind’s Genie 4 builds AI worlds that talk and change on command

Google DeepMind has released Genie 4, a world model that builds photorealistic worlds in real time. They come with sound, and with characters that speak. It opened to trusted testers as a research preview on 27 October, the lab said in a blog post.

Users steer a simulation with text prompts as it runs, changing the weather, moving the camera or adding a person or object. DeepMind says it is its first real-time world model to generate audio natively. That includes music, ambient noise and dialogue that reacts to the user.

“Understanding and simulating the world is a crucial aspect of building AGI,” the DeepMind team wrote.

Gemini in the loop

Genie 4 builds on Google’s Gemini models. Gemini Omni anchors how the worlds look and behave. Gemini 3.8 Flash works as an agent in the loop. It watches the scene, breaks a goal into steps and checks each new frame to confirm that a step worked.

In one experiment, Gemini 4 Argon, the model Google released publicly this month, planned a task for Genie 4 to simulate: Apptronik’s Apollo humanoid playing checkers. DeepMind says this opens up endless training scenarios for robots.

Scenes now stay consistent for up to two minutes, double Genie 3’s limit, Rebecca Bellan reported for TechCrunch. The lab says physics such as aerodynamics and collisions are more realistic, and that people move more naturally.

“What we’ll increasingly see in the future are these hybrid world models, where you have a combination of Gemini writing code and text, and Genie ingesting that in real time and simulating reality at different levels of abstraction,” Tejas Kulkarni, a research director at Google, said in a briefing, according to TechCrunch.

Who gets it, and when

Testers in film, journalism, education, gaming and engineering have used the model for previsualisation and game prototypes, according to DeepMind. Photojournalists have tried turning archival photos into simulations. Next, it comes to Google AI Ultra subscribers in Project Genie. Early partners will get it in the Gemini API and Google AI Studio. DeepMind has opened a waitlist but gave no date.

Ultra plans start at $100 a month, Ryan Whitwam wrote for Ars Technica. Ars also noted that the reveal of Genie 3 last year sent gaming stocks tumbling.

DeepMind lists limits. Details and object permanence can drift as a simulation runs longer or after several prompt edits. Legible text and audio accuracy are still in development. All video and audio from Genie 4 carries SynthID, Google’s invisible watermark.

The release comes as the world model field consolidates. AMD agreed to buy World Labs. Amazon has been in talks to buy Decart, and Rivian bought Third Dimension for driving simulation.