frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Ask HN: Who's still keeping a DOS machine up because the business depends on it?

267•mlaux•2d ago•288 comments

Ask HN: Allow agents access to cloud files with least privilege?

3•beerglass•4h ago•2 comments

I was impressed by Jev, please explain why I shouldn't be

5•effisfor•3h ago•10 comments

Ask HN: How are you getting inference for personal projects?

2•variety8675•6h ago•4 comments

Ask HN: Any nerds out there who've read a lot of research papers?

28•shriy-singh•3d ago•27 comments

Ask HN: Hypothesis: Cellular providers are deprioritizing voice calls?

21•tkdb•3d ago•38 comments

Ask HN: IEEE expulsion of Fei-Yue Wang?

11•sathomasga•2d ago•1 comments

Ask HN: Who is the inspiration for your thinking?

8•SMAAART•18h ago•14 comments

Tell HN: OpenAI $500 ProMax plan listed in API

27•GustavHartz•2d ago•48 comments

Ask HN: Is Opus 5.5 another step change?

14•consumer451•1d ago•17 comments

How to Freelance Now?

16•Alexadar•1d ago•15 comments

Ask HN: How do you deal with cyber attacks once you scale?

6•cehgmaster•3d ago•3 comments

Ask HN: Which model do you use for work?

7•george_max•2d ago•13 comments

Ask HN: What vendor you'd switch out if a better option was available?

7•jviotti•2d ago•20 comments

What do you do now as a software engineer?

5•fawazali•20h ago•7 comments

Tell HN: Substack obfuscating text to break reading mode

18•xnx•5d ago•4 comments

FYI: OpenAI "spend limits" aren't always limits

2•iambateman•1d ago•1 comments

Tell HN: Chrome 154 corrupt Fontconfig cache and crash KDE Plasma

6•vdfs•1d ago•0 comments

Ask HN: LM Studio Bionic with Python?

3•HoldOnAMinute•2d ago•1 comments

Ask HN: How do you feel about the new $500 OpenAI subscription?

5•preommr•2d ago•12 comments

Ask HN: Has anyone built a leaderless multi-agent system?

3•har-ki•2d ago•2 comments

Anyone using a Wispr Flow alternative that is non-cloud?

22•itsjeremiahs•4d ago•17 comments

Ask HN: Does spec-driven development still pay off with frontier coding models?

6•sarangk90•3d ago•3 comments

Ask HN: Anyone else's OpenAI and Claude API keys mysteriously leaked last night?

2•par•2d ago•1 comments

Ask HN: What job boards are good these days?

23•phendrenad2•4d ago•16 comments

Ask HN: Are .shop domains down?

6•esher•3d ago•8 comments

Ask HN: How do you use LLMs to secure your code and services?

4•cpa•2d ago•1 comments

Ask HN: Migrating personal email domain from Gmail to iCloud?

4•osener•2d ago•5 comments

Ask HN: Where to look for jobs?

6•0x737368•2d ago•1 comments

Ask HN: Does a startup need both founder and company X accounts?

3•OnionLayers•2d ago•1 comments
Open in hackernews

Ask HN: How are you getting inference for personal projects?

2•variety8675•6h ago
It seems like the major providers are starting to cut back the usage included with their monthly subscriptions. How are people handling inference for side projects these days?

Are you still using Codex/Claude subscriptions, paying for hosted open weight models, running local models, etc

Comments

intrr•6h ago
Claude subscription (the cheapest $20/month one) -- I very rarely hit the limits, particularly the weekly ones. But then again, the largest codebase I ever work on is 50k lines.

I'd prefer local models massively for both work and "pleasure" (I love LLMs as random cognitive sparring partners), but then again, my bank account massively disagrees :/

spottedmarley•6h ago
I've been on the Claude Max plan for quite a while now but I also run my own local models and every week there are new local models that are slowly but very surely closing the gap to frontier-level quality and so, pretty soon, I won't use APIs at all. Can't wait!
sds357•5h ago
I have a Proxmox machine with dual P40 gpus that pass thru to a vm with ollama running for local inference. Been working great for over 2 years.
iliedanila•50m ago
In order to have an efficient use of tokens, I created proper documentation from the start of the project: - What component is where, what it does and how it does it - Kept a history of all the architectural decisions - How a new component (of a known type) should be added to the system - Instructed the agent to keep this information valid and up to date as part of the PR prerequisites.