AI Minecraft Playable Demo Released – Based on Oasis Model – Decart and Etched

Introduction

Hello there and welcome!

A couple of months ago, Google Research released a limited AI-powered version of Doom, based on their GameNGen diffusion model, but it had severe limitations, and was not publicly available to try.

Fast forward two months, and Decart and Etched, two collaborating AI companies, have just released an online playable demo version, of THEIR flavour of an AI-powered version of Minecraft.

Not only that, but they’ve also publicly released a DOWNSCALED version, of the underlying Oasis video diffusion model, that powers the game.

Anyone can now download the downscaled Oasis model, weights and inference code, from Hugging Face or GitHub, to install locally.

I’ll leave the URL links in the description below for you.

The online demo game of course, uses the most powerful version of the Oasis model.

I’ll be taking a closer look at this diffusion based Oasis model in a future video, so make sure you subscribe, and keep an eye out for that.

This Oasis AI-powered flavour of Minecraft, is generated in real time, in a technique known as next-frame prediction.

They did this by training their Oasis model, on millions of hours of Minecraft gameplay, and recordings of the corresponding actions a user would take in the game.

The AI is able to sort out the physics, environments, and controls of Minecraft, from this data alone.

Nothing is prebuilt when you enter the game, everything is generated on the fly in real time, by their first of a kind video model and game engine.

Literally, every time you take a step in the game, the environment around you is reshaped, and generated, in real time.

Obviously, this is an early experience of the work in progress, and serves as an early proof of concept, and with it comes understandable short-comings.

The resolution is low, rendering issues persist, it’s pretty glitchy, it’s prone to short memory hallucinations, and you’re currently limited to a 5 minute play session.

However, for the intended purpose, it’s a real treat to get an actual hands-on experience, of this bleeding edge technology, and it certainly does whet your appetite, and open your eyes, to the infinite possibilities, and the future direction, of not only gaming, but also real time video generation in general, based on the Oasis model.

Gameplay Access

Anyway, enough talk, let’s get hands-on and actually play the game.

We’ll open the Decart Oasis page in our browser. I’ll leave the URL link in the description below for you.

Then we hit the “Start” button to begin the journey.

On the next page, we’ll hit the “Next” button.

This brings us to the “Choose a Map” page, where we can select from currently 5 different environments, including Village Outpost, Dense Forest, Rugged Coastline, Desert Expanse, and Mountain Meadow.

Note, that due to a surge in popularity, you could be placed in a short queue.

Actual Gameplay

When your turn does come, click on your chosen “Map” and begin your game.

The simple keyboard and mouse controls, are shown at the bottom of the game window.

You can move forwards, back, left and right, turn 360 degrees, jump, run, and sneak.

You can also check your Inventory, select your available items, and hit.

If you want to go to the menu, to pause or end the game, just hit the “Escape” key on your keyboard.

Once your session ends, you’ll have the additional option to download your gameplay in mp4 format.

As always, the best way to actually experience it, is to try it yourself.

Conclusion

Anyway, hope you found this video helpful, and I’ll catch you in the next one.