> Mistral seems to have given up on reaching the frontier and focuses instead on niches like moderation, OCR, and robot navigation.
That's not actually true. They at least claim they have a new attempt at a large model they plan to release near the end of this summer.
Their last 'large' model was a flop that needed to be replaced by their Medium 3.5, but they have not yet given up on large models, even if they're also making smaller more specialized models for now (because that's somewhere they actually do rather well).
That's not to say I don't hope they will. It would be incredible if they could do that despite their limited funding and the wide swath of projects they are working on. I do think that lack of focus is going to be a big problem.
ben_w•37m ago
I think is possible that these models can *culturally*(/memetically) benefit the creator via e.g. being trained to propagandise for the values of the originator, but it is unclear to me if this hypothesis has even been properly tested.
However, even absent benefit from creating new models, there are still good reasons to support the economic changes that would allow such models to be created in Europe:
We need a more unified, EU-wide, approach to investment both private and public; we need to upgrade the power grids even just because they're old and a poor fit for existing supplies and demands let alone forecast new demands and new supplies; and we need local chip factories to protect against supply chain problems in the event of conflict involving existing suppliers.
I expect the AI-training investment bubble to burst before the EU gets any of those things, those things are good regardless.
fabianlindfors•8m ago
One thing I'm inclined to believe though is that the investment being made into compute and research today may not benefit the investors, but it will be net-positive on a longer time scale for the wider populace. A comparison to the internet and the dot-com bubble seems fitting.
And from that perspective I'd also be worried about the bubble bursting before Europe even gets started, as what remains after a bubble would still largely serve the US and China.