Seems like it depends on what you can wish for?
It could be luck, but I don't know -- it keeps one-shotting relatively hard stuff. And taking initiative to think about what potential regressions it should look out for, and choosing to do strategic refactoring when it should do. It is not confidently incorrect hardly at all, doesn't tell me that it's fresh risky pile of changes is ready for production without having exercised all the code paths and writing a bunch of tests, etc.
We might be reaching the next level here...
That's my point. This "open source" doesn't feel like the real open source. It's open just for the few ones with ton of capital, and mostly in the US, or US adyacent markets. It's like if SpaceX publish an open source rocket design and people celebrating like it's the new Linux. Feels more like a goodwill gesture than something with real impact for the benefit of mankind, like the spirit of open source software as commonly understood.
Even if end-users can't run these models themselves at home, there are a lot more and varied options to choose from, especially considering privacy and data protection.
You can apparently also do GLM-5.2 at Q4_K_XL with 2x RTX 3090 and lots of RAM [1], but I don't think that counts as a potential frontier model.
dgellow•4d ago
Good for consumers, it’s competition at its best, we get cheaper, better services. But I would be pretty concerned integrating an AI lab products into my business without having a good abstraction that makes it easy to swap between vendor.
astqs•4d ago
I’d look for OpenResponse-compatible endpoints in your shoes. These are meant to be plug and play.