Skip to main content
Genie 4 from Google DeepMind creates a world from a prompt, a reference image, or both. Walk through it with movement keys, look around with the arrow keys, and hear the world as it runs in real time. Use live instructions to change the scene or ask a character in it to speak. Each world lasts up to 60 seconds. This reference has four pages: this overview, the schema, the prompt guide, and a tutorial with a complete browser app. Use Genie4Model from the typed SDK, @reactor-models/genie-4, to connect, start worlds, and receive typed snapshots. The package also provides React hooks and components. See Typed Model SDKs.

At a glance

Key features

Explore Worlds

Move with WASD and look around with the arrow keys.

Video and sound

Receive the world through separate video and audio tracks.

Change the scene

Send plain-language instructions while the world is live, including lines for a character to say.

Quick start

Scaffold the example project with create-reactor-app. The tutorial shows how to build a small app from scratch.
The example app uses the typed SDK, @reactor-models/genie-4. For your own browser code, install that package and provide the token resolver. The media controls let the user start playback if the browser blocks autoplay.

How it works

  1. Connect a Reactor session and attach both output tracks. Read the initial getState() reply.
  2. Call startWorld() with a prompt, an uploaded image reference, or both.
  3. Watch state.phase move from starting to live. A successful start call alone does not mean the world is live.
  4. Send the complete set of held keys on each change. Use instruct() for changes to a live scene.
  5. End the world with endWorld(), or let its time limit expire. Start a new world with its inputs again.