×
Community Blog Alibaba Launches HappyOyster, a World Model Product for Real-Time Immersive Creation and Interaction

Alibaba Launches HappyOyster, a World Model Product for Real-Time Immersive Creation and Interaction

Alibaba unveiled HappyOyster, a pioneering open-ended world model product for real-time world creation and interaction.

HappyOyster

Alibaba today unveiled HappyOyster, a pioneering open-ended world model product for real-time world creation and interaction. Created by its Alibaba Token Hub (ATH) business group, HappyOyster enables users to create, explore, and direct immersive digital environments with unprecedented control.

Unlike traditional video generation tools that rely on a linear workflow of “writing a prompt, waiting for rendering, and then receiving a video clip”, HappyOyster continuously integrates user instructions during the generation process. This allows scenes to respond to inputs in real time, creating a truly interactive experience. HappyOyster is ideally suited for fast-paced visual production scenarios, such as real-time film making, interactive drama creation, game concept prototyping.

HappyOyster features a Wandering mode which enables users to construct real-time interactive scenes using multimodal text and image prompts. Once a world is created, users can transition seamlessly from creator to explorer, navigating their bespoke environments in real time. It supports a first-person / third-person perspective, allowing users to freely change direction and camera movement, and move beyond the original frame while the world keeps generating and remains coherent.

To cater for diverse creative needs of users, HappyOyster also offers a Directing mode which serves as a sophisticated engine for real-time video production. Capable of generating up to three minutes of continuous 720p footage, Directing mode empowers users to take the director’s chair. Users can step in at any moment, using text, voice, or images to switch camera angles, direct characters, or alter the course of the story. The world responds immediately and continues unfolding in line with those instructions.

Check the video

The Foundation: A Native Multimodal Paradigm

HappyOyster’s immersive capabilities are rooted in its natively multimodal architecture. By training on expansive, long-form video datasets, HappyOyster captures complex physical state transitions to deliver high-fidelity, long-duration dynamic scenes.

HappyOyster integrates diverse control signals—including text, navigation actions, and image inputs—directly into its foundation. This allows user instructions to continuously shape the environment’s evolution, achieving a seamless balance between generation quality, temporal stability, and precise control.

HappyOyster is currently available to users through an Early Access program. To begin creating and exploring interactive scenes, please visit https://www.happyoyster.cn/

For more detailed information regarding the platform’s capabilities, please visit https://www.happyoyster.cn/docs


This article was originally published on Alizila written by Claire Mo.

0 1 0
Share on

Alibaba Cloud Community

1,379 posts | 491 followers

You may also like

Comments