I cannot judge his research output at Meta but he failed pretty bad at the LLM race. Since so many other organizations succeeded at creating open source models of far higher quality at much lower cost, it would be instructive to understand what exactly went wrong there.
Was he even involved in this?
What? Until the Chinese jumped in Llama was the premium open source model. The reason that the Chinese were successful at MOE was just that they were limited with chips and had to think outside the box. US labs are operating on the power law. They also, arguably, distilled from western models (llama).
Kind of hilarious to me to consider him "failing" with LLMs. Given his remit was a research time horizon of 8-10 years, and the fact that he's gone on record saying that he expects the technology will stall out in the time horizon, it seems he can only take Ws and ties. Indirect influence on open-sourcing the models to propel research forward (which is pretty important for a chief scientist) which added benefit for Meta's other products.
nis0s•2mo ago
falcor84•2mo ago
torginus•2mo ago
(I forgot sims).
Besides I wonder what does a company, whose entire product lineup revolves around looking cool and successful and admired in front of strangers with a product whose main mode of usage involves blindly flailing around in a room with a plastic box stripped to your face.
Pedro_Ribeiro•2mo ago
I enjoyed games like No Man's Sky in VR, but they just don't hit the same high notes.
heromal•2mo ago
marcuskane2•2mo ago
Was this written in earnest or as an ironic/facetious joke?