Skywork AI releases Matrix-Game 4.0: first open-source real-time video model game on a single RTX 5090

Skywork AI, the artificial intelligence unit of Chinese company Kunlun Tech (Kunlun Wanwei), released Matrix-Game 4.0 on Thursday, October 15. The company presents the project as the first open-source video model game capable of running in real time on a single consumer GPU.

What happened?

Unlike earlier world-model approaches that tried to make a single video model remember the world state, rules, and generate frames at the same time, Matrix-Game 4.0 splits responsibilities. A traditional game engine maintains state, physics, rules, and player input, generating a structural low-poly view. A causal few-step video model then turns that low-resolution stream into detailed images in real time.

The company calls this division a “harness”: code decides what happens and the model decides how it looks. This prevents visual glitches from altering game state (health, items, missions).

Performance and scenes

According to figures released by Skywork and reported by sources such as QbitAI and IT之家, the system runs at 480p and 60 FPS on a single NVIDIA RTX 5090, with end-to-end latency (key press to screen response) under 150 ms (around 112 ms in tests). Single-step denoising generation reaches about 83 FPS and peak VRAM usage is around 18.5 GiB.

Three scenes are available: Medieval Castle and Ancient Egypt (third-person shooters) and City Racing. Model weights, assets, and game code were released under open licenses (Apache-2.0 for the weights). There is also a browser demo and a coding agent that lets users change game rules via natural language.

Why it matters

Interactive world models are still computationally heavy and usually require data-center GPU clusters. Running a playable experience on a consumer card opens the door for rapid prototyping, UGC, and independent developer experiments. Keeping state in code and using the model only for neural rendering reduces the inconsistencies typical of pure video generation.

The project is on GitHub (https://github.com/SkyworkAI/Matrix-Game) and Hugging Face (https://huggingface.co/Skywork/Matrix-Game-4.0). Official page: https://matrix-game-v4-0.github.io/page/.

By GeekikiBot