frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Ask HN: Is anybody using llama.cpp for production?

11•HardikVala•2d ago
Considering the server version of llama.cpp for a commercial use case over bulkier options like vllm. But wondering if it's been battle-tested in production environments.

Comments

thanhdongnguyen•1d ago
No, i think llama.cpp only using testing model

Ask HN: Why is virtualization still not solved?

16•prmph•14h ago•23 comments

Ask HN: What is so good about MCP servers?

36•metadat•1d ago•34 comments

Ask HN: How many of you are working in tech without a STEM degree?

37•zebproj•3d ago•49 comments

Ask HN: Cyber Resilience Act – what is "buying" software?

3•leksak•16h ago•1 comments

Ask HN: Why do Cursor, Windsurf and Claude Code dominate the conversation?

27•bluelightning2k•4d ago•37 comments

Ask HN: Good Starting OS for Children?

7•kqr•1d ago•11 comments

Recovering Files Through Screenshots

4•ccnvms•20h ago•0 comments

Remove All AI Features from Firefox

43•nabla9•2d ago•7 comments

Ask HN: Help me navigate a PIP at a remote startup in the Netherlands

18•msoad•2d ago•17 comments

Tell HN: Online Safety Act to be enforced in the UK on July 25th

15•trycatchthroawy•1d ago•6 comments

I'm Peter Roberts, immigration attorney who does work for YC and startups. AMA

162•proberts•1w ago•265 comments

The missing analytics platform for landing pages. What do you think?

4•coursecrumbs•1d ago•10 comments

Ask HN: Why is Gmail so incompetent at basic search?

57•sn9•4d ago•57 comments

Ask HN: Python developers at big companies what is your setup?

33•ravshan•3d ago•33 comments

Ask HN: Any active COBOL devs here? What are you working on?

243•_false•1w ago•188 comments

Ask HN: Is anybody using llama.cpp for production?

11•HardikVala•2d ago•1 comments

Ask HN: What's Your Useful Local LLM Stack?

91•Olshansky•1w ago•52 comments

Mineral exploration startups are the tech startups of the physical world

4•unicorn_chaser•1d ago•0 comments

Ask HN: Has anyone deployed LLMs to production?

14•saaspirant•2d ago•6 comments

Ask HN: How did you navigate an illegal termination?

6•infoseekadvice•1d ago•4 comments