frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Why call it "inference" instead of just "model hosting"?

5•bluebic•1h ago

Comments

mrhottakes•1h ago
Inference sounds cooler and more mystical. Any old company can host something, "running inference" requires 10x rock star engineers and a CEO that acts like a badass who wears a leather jacket and has Thoughts about demographics.
rubylimetea•39m ago
This literally has to be it. The people that say it tend to say it a lot.
bitpush•1h ago
Same difference between S3 bucket and Google Photos (web). Both "host" images but one provides an experience on top of the underlying assets.
rubylimetea•37m ago
That's interesting, the idea that hosting implies a front-end (whether UI or API).

So it's similar to why we don't call Heroku or Vercel "hosting" or "compute" because it's more of a service (though "cloud" and "platform" are pretty vague too).

dtagames•1h ago
Like so many things in computing, we like to make up words and also reuse old ones for completely different things.

I'd say "hosting" means making something available to you in the cloud. Model makers don't offer that.

They sell "inference," which is a compute task with real hardware costs for them. The task runs against their model, which is not hosted for you.

seydor•55m ago
Are you really hosting the model? Are you making its bed, cooking its food and cleaning up for it?

Ask HN: How do I find startups that are looking for a dev? How to approach them?

3•need_a_work23•1h ago•4 comments

Ask HN: Is anyone giving out tokens for benchmarking LLMs?

3•emosenkis•2h ago•1 comments

Ask HN: What's the best AI coding tool today?

2•FrenchDevRemote•6m ago•0 comments

Tell HN: ChatGPT exports do not contain all conversation messages

2•afpx•2h ago•0 comments

Tell HN: Namecheap gave my account to an unverified third party

463•Thrashed•21h ago•172 comments

Ask HN: Why call it "inference" instead of just "model hosting"?

5•bluebic•1h ago•6 comments

Ask HN: How to get in touch with Paddle (MoR)

6•probst•8h ago•1 comments

Ask HN: How much software do you build for yourself these days?

4•lellow•4h ago•7 comments

Ask HN: Has your typing gotten worse with AI?

2•aizk•5h ago•5 comments

Single-click and remote OpenCode session right in the browser

2•jashandeep31•7h ago•0 comments

A VSCode extension for AI to understand your project

2•bailingyuan•7h ago•2 comments

Ask HN: Is there a website that tracks excessive writes to SSDs in OS/app betas?

30•amichail•1d ago•26 comments

Ask HN: Any Good Pi.dev Setups?

3•galsapir•7h ago•1 comments

Ask HN: If OpenAI hacked HuggingFace, why aren't OpenAI prosecuted?

28•sam_lowry_•1d ago•35 comments

Ask: Why does everything Microsoft create lately feel fragile and half-baked?

10•nothrowaways•21h ago•12 comments

Ask HN: Convince me to not to shelve my app (I've decided to)

2•asdfbank•11h ago•2 comments

Pixel phones getting ad notifications

7•explodes•18h ago•7 comments

Ask HN: Is HN's duplicate url detection broken?

4•khaledh•15h ago•1 comments

Ask HN: What Linux distro do you daily drive?

22•addajones•19h ago•47 comments

How to Resolve Software Deployment Issues with SeaTicket

2•Daniel-Pan•16h ago•0 comments

Ask HN: What changed in your life when you started meditating (and how)?

31•dondraper36•1d ago•26 comments

Doesn't OpenAI have every incentive to destroy HuggingFace?

7•jrm4•21h ago•2 comments

Ask HN: What verb best describes what a developer does in 2026?

4•jdlib•22h ago•6 comments

Where to find inspiration for a (reactive) personal website?

2•mryingster•22h ago•2 comments

Ask HN: Have you noticed an improvement in AI responses with memory disabled?

3•zbikowski•23h ago•1 comments

Ask HN: How do people keep track of organizational knowledge?

29•kadhirvelm•3d ago•24 comments

Naming a pattern in AI-generated code: Modular Mirage

2•ErsanG•11h ago•0 comments

You've reached the end!