SOTA open source model for image and vid generation.
Beats all others but is too big to run on most people’s computers at 64b params.
Still impressive nonetheless given its artificially generated training sets.
Beats nano banana 1 but not yet competitive with 2 or seedance2, grok imagine,etc.
xnx•10m ago
Great summary. I find image and video generation models are a more understandable reality check for how close local models are to frontier models.
causal•32m ago
I'm struggling to understand what this does.
> Generates future observations and action sequences.
Is that just a complicated way of saying video gen?
swiftcoder•27m ago
As I understand it, they mean both computer vision and video gen, linked by a pretty robust world model. One of their hosted examples is purely analysing an existing video, the other is predicting (i.e. video gen) from a static image to a video
derac•16m ago
Look at the table of supported modalities. It can take in input of image/video/text/actions and output image/video/text/actions.
aabdi•47m ago
Still impressive nonetheless given its artificially generated training sets.
Beats nano banana 1 but not yet competitive with 2 or seedance2, grok imagine,etc.
xnx•10m ago