https://www.microsoft.com/en-us/research/articles/whamm-real...
The tmux thing had me confused for a moment until i realized it was emulating tmux. Super fun. Is the model window width aware?
Time is an input too. If nothing is pressed, the model gets a WAIT token with a duration instead of a key, which is how snake keeps moving on its own.
Interesting. I wanted to ask, how that model compares with the fine-tuned version, but I just saw the author provided benchmarks. Interesting that fine-tuning improved the memory so significantly, wouldn't have expected that.
Though, on second thought, I had an experience where I was able to, as a human, fine-tune my memory beyond what I previously thought was possible!
obilgic•57m ago
prodigycorp•35m ago
andai•9m ago
https://www.youtube.com/watch?v=z3pV6FHvcgM