frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: What are you using for LLM inference in production?

3•chrislim•2h ago
I started with OpenAI back in the GPT-3 days, then bounced between the major labs (with a brief interlude with Workers AI).

I eventually settled on Gemini 2.5 Flash Lite as my workhorse, using it against structured data/vectors as a chatbot. It was cheap, good enough, and most importantly, fast - but it's now being sunset and I'm not sure where to go to find similar performance.

Groq seems promising but developer access hasn't been available for months. I'd love to use open source, but I never found anything comparable (cost/performance/speed).

Would love to hear your suggestions.

Ask HN: What are you using for LLM inference in production?

3•chrislim•2h ago•0 comments

Strategic Oil Reserves Down to a Record Low Two-Week Supply

12•megamike•10h ago•3 comments

Ask HN: Can Apple Ever Be Disrputed?

4•Taikhoom2010•9h ago•10 comments

Ask HN: What former "must-have" AI agent skills have you deprecated?

3•lpjstack•14h ago•0 comments

Ask HN: After 8 Years of Failed Apps, Should I Give Up?

4•asoomi07•10h ago•7 comments

Can LLMs have an "accent" like second language speakers?

3•hmokiguess•11h ago•0 comments

Stripe's opt-out Radar price increase dressed up as a free trial

9•rapind•17h ago•1 comments

I built an independent peptide testing lab that accepts mailed samples

6•peptidelabs•17h ago•0 comments

Ask HN: Do older programmers/CS academics view AI safety as a form of arrogance?

5•amichail•20h ago•12 comments

Robotics development made dead simple (open source)

22•Ekami•4d ago•7 comments

Ask HN: Navigating Source Code (especially on large projects)

5•thekey•22h ago•2 comments

YC startup offers interviews to people who get their name permanently tattooed

18•codexon•1d ago•11 comments

Ask HN: Should authors disclose if they are paid to write a blog post?

4•wseqyrku•1d ago•5 comments

Tell HN: Airbnb updated "necessary" cookies aren't

7•janalsncm•1d ago•0 comments

Ask HN: Crooked Timber showed showed me a virus captcha, What now?

43•Jgoauh•2d ago•47 comments

Belkin killed my smart switch. I got it working again without their app

13•gaborme•1d ago•3 comments

How to get more coding productivity with LLMs

8•DaveParkCity•1d ago•2 comments

Ask HN: Which one do you use for planning and coding between sonnet and Opus?

3•neverenderr•1d ago•10 comments

Is Cloudflare classifying opencode.ai as malware?

3•_raz•1d ago•4 comments

You've reached the end!