Genie4AI

Open

Model for building and managing a world in real-time, allowing scene and environment modification via text commands.

Description

The goal of the product is to create an interactive environment where the user can describe a place and then interact with it, changing it during the generation process.

The target audience includes specialists who require visualization and testing of concepts, as well as developers working on scenario or game projects.

Capabilities include describing scenes, moving around them, changing weather conditions, adding characters, and interacting with them through natural dialogue.

The working process involves describing a location, then immersing oneself in it and making subsequent changes that are saved in the current state of the world.

The system uses Gemini planning to maintain causal relationships, which allows changes to be saved, and also generates sound accompaniment, including music and dialogues.

Limitations include that interaction sessions are limited to a few minutes, and visual details may drift during long sessions.