I hope we figure out how to scale up diffusion models. Gemini is a cool tech demo, and Inception is almost smart enough to be interesting. There's a lot of tasks that you just need a certain intelligence floor for, and after that getting smarter doesn't really help. For those, speed could be a huge differentiator.

I think that diffusion models might be a better way to generate code than autoregressive left-to-right generation

Title should probably contain [2023]