The speed means absolutely nothing when it is finishing almost dead last when compared to the frontier AI companies.

Pricing at $0.25 and $0.75 already puts its cost well above reasonably reputable inference providers for deepseek v4 flash or qwen 3.8-flash-next or similar class of open weight LLMs that fit in under 170GB of RAM, so I don't see the point. I think this is probably also stupider than laguna s 2.1 which can also be very cheap to serve.

If you care about speed Cerebras gpt-oss-120b is 1400tk/s and "just as smart" in ranking.

I've used it on a few for fun projects and its decent but the speed is crazy to watch.

I honestly think the diffusion LLM approach is a dead end

It's telling that frontier labs like Google toyed around with it but didn't invest further even for their most speed and cost sensitive small models

Still unclear for what, if any use cases this is pareto frontier