frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: What happened to self-hosted models?

3•curiousaboutml•17h ago
Hi HN, sorry for using a burner account.

It seems to me that up until the beginning of the last year, we saw a couple of new "open" model release announcements almost every week. They'd set a new state of the art for what an enthusiast could run on their laptop or home server.

Meta, Deepseek, Mistral, Qwen, even Google etc. were publishing new models left and right. There were new formats, quantizations, inference engines etc. and most importantly - a lot of discourse and excitement around them.

Quietly and suddenly, this changed. After the release of gpt-oss (August 2025), the discourse has been heavily dominated around hosted models now. I don't think I've seen any mention of Ollama in any discussion that reached HN's front page in the last 6 months.

What gives? Is this a proxy signal that we've hit a barrier in LLM efficiency?

Comments

al_borland•17h ago
My wildly uneducated guess is that they are getting to the point where they need to figure out how to profit off all this investment, and releasing self-hosted open-source models isn’t going to help them do that.
curiousaboutml•17h ago
Possibly, but it's not just the release of new models. It seems the community itself has lost interested in self-hosted models.
nacozarina•17h ago
Investors need everyone to avoid self-hosted models and pay premium subscriptions for large centralized models, else they will never earn the profits they want. Self-hosted models spoil their revenue forecasts.
electroglyph•17h ago
there are tons of models released still. even some non-Qwen ones!
bityard•16h ago
HN only covers a very small slice of interesting things that happen in tech every day. If it's your only source of tech news and information, you are missing out on a LOT.

There are plenty of self-hosted models being released all the time, they just don't make it to HN. For that, you need to find a community that is passionate about testing and tinkering with self hosted models. A very popular one is "/r/localllama" on Reddit, but there are a few others scattered around.

doublerabbit•5h ago
Could you recommend other sites? I only use HN exclusively but would be keen on decent tech new sites without having to sieve through the sludge of Google.

TheRegister, SlashDot and hackaday I know of.

gnosis67•16h ago
Ollama has changed. Early versions were raw, and then they were optimized (I’m on a laptop with 64GB RAM), and then they fell to shit. Optimized for someone else’s home rig I suppose.

And my old favorite models broke so I have to link different versions. nous-hermes2-mixtral I miss your sage banter.

Now everything runs on an excessive lag.

softwaredoug•15h ago
One thing that happened was the providers got better at hosting smaller and cheaper models. So you could self host or just get your work done with GPT 5 nano.
potsandpans•12h ago
They're still going. I just bought a 5090 for myself this Christmas to do more interesting things.

I mostly use them for game assets.

Trellis2 is very cool. Ive managed to put together a sdxl -> trellis -> unirig pipeline to generate 3d characters with mixamo skeletons that's working pretty well.

On the llm front, deepseek and qwen are still cranking away. Qwen3 a22b instruct, imho does a better job than gemini in some cases with ocr and translation of handwritten documents.

The problem with these frontier open weight models is that running them locally is not exactly tenable. You either have to get a cloud GPU instance, or go through a provider.

- https://github.com/microsoft/TRELLIS.2 - https://github.com/VAST-AI-Research/UniRig

jaggs•12h ago
There are a lot of local models being released every week. You really need to log into /r/localllama to stay up to date.

Ask HN: When has a "dumb" solution beaten a sophisticated one for you?

4•amadeuswoo•3h ago•4 comments

Ask HN: What's a standard way for apps to request text completion as a service?

47•nvader•5d ago•23 comments

Ask HN: Senior engineering mngrs: how has AI changed your day-to-day work?

26•kitetm•17h ago•4 comments

Ask HN: Best way to find chill job where I can learn and grow as a swe

33•digitdiglet•2d ago•42 comments

Are There Any Similar Sites Like Downdetector?

2•nomadfounder•10h ago•0 comments

Ask HN: Would you pay for a privacy-first social platform?

7•sammiej•10h ago•9 comments

Ask HN: Should I learn Docker to deploy my app in VPS?

4•danver0•12h ago•5 comments

macOS Tahoe 26.2 ships with an outdated version of Python 3.9.6

5•Gabrielfair•9h ago•5 comments

Ask HN: Any Microsoft employees/devs here? What's happening to Microsoft?

107•thehamkercat•4d ago•83 comments

Ask HN: Is it time for HN to implement a form of captcha?

88•Rooster61•2d ago•132 comments

Ask HN: What happened to self-hosted models?

3•curiousaboutml•17h ago•10 comments

Tell HN: Get a dying iPhone 12 mini in 2026

25•remywang•2d ago•21 comments

Implementing NaN Boxing in a Stack-Based VM

5•tracyspacy•3d ago•0 comments

Ask HN: How to make working in software fun again?

6•canxerian•1d ago•7 comments

Ask HN: How would you decouple from the US?

34•yawa_me_worht•2d ago•20 comments

How to search Remote-from-Anywhere jobs

8•andrewstetsenko•14h ago•3 comments

Working on decentralized compute at io.net sharing what we're learning

4•plutodev•1d ago•3 comments

Ask HN: What's your preferred digital payment method?

3•vednig•1d ago•21 comments

Ask HN: How do you do store-and-forward telemetry at the edge?

5•Aydarbek•3d ago•3 comments

Ask HN: Feeling irrelevant in back end. How to pivot to automotive software?

3•culopatin•2d ago•3 comments

Ask HN: Why isn't AI spawning profitable indie games?

6•eveningsun•2d ago•11 comments

Funding Opportunities with Amateur Radio Digital Communications (ARDC)

5•ARDC_73•2d ago•1 comments

I've maintained an open source task manager for 8 years

6•johannesjo•1d ago•1 comments

I built an AI agent that deploys a PR to production

3•amouehsan•2d ago•1 comments

Ask HN: Where is legacy codebase maintenance headed?

6•AnnKey•2d ago•4 comments

Ask HN: Have AI tools like agents affected your motivation at work?

7•SpicyNoodle•1d ago•2 comments

Amazon Prime AI overviews can't even get the basics right

43•PyWoody•5d ago•13 comments

Git analytics that works across GitHub, GitLab, and Bitbucket

3•akhnid•4d ago•1 comments

Ask HN: Has anyone else been struggling with search lately?

31•areoform•5d ago•20 comments

You've reached the end!