Ask HN: Will Open Source force companies like Anthropic to shift their focus?
3•mrburton•1h ago
What I mean by this, will Open Source own the creating of amazing models and cause companies like OpenAI and Anthropic to focus on verticals?
I know there's a high costs right now for training models, but I'm sure innovation will change this long term.
Comments
uberman•42m ago
Do you mean fine tuning (say via LoRA) or working with an "open weight" model or are you talking about true "open source" models. If it is the latter, I struggle to understand how a circa GPT3 model requiring millions and millions to train would be a good use of resources over one of the former.
mrburton•33m ago
Great clarifying question; sorry I should have been more clear.
I mean working with open weights and in the future, creating their own open source models from the ground up. At the moment, that's not reasonable, but I'm leaving the door open for when/if there's a break through in training that greatly reduces the costs of training new models.
Right now, LoRA can give amazing results with small models.
verdverm•23m ago
I certainly hope so, DeepSeek has been giving out more of the code behind their systems
mrburton•5m ago
Likewise, I this direction gives engineers a way also to fight back with all the hackers/scammers. It'll create so many new companies as well.
uberman•42m ago
mrburton•33m ago
I mean working with open weights and in the future, creating their own open source models from the ground up. At the moment, that's not reasonable, but I'm leaving the door open for when/if there's a break through in training that greatly reduces the costs of training new models.
Right now, LoRA can give amazing results with small models.