We trained it on about 500k hours of Minecraft videos, and it learned how to fight creepers, build walls and other structures, and explore to find visual goals.
We're considering putting up a public API for larger models like this one, let us know if you'd like to be able to put Pan in your own server :)
What's most interesting about the model isn't the performance that it gets in Minecraft, but how general the method is. When we scale it up, it should be able to act in any kind of video game, as well as robots in the real world (which are really just another video game).
xnx•34m ago
agajews•31m ago
(Versus Dreamer, which needs to be trained on a hand-written reward function for each task that you want to do.)