frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Ask HN: What do you run on a $5 VPS that's worth keeping online 24/7?

234•mariocesar•2d ago•371 comments

Tell HN: I've been paying for a rural Tanzanian's education for 10 years

700•lukehandcool•19h ago•217 comments

Ask HN: Are you a subscribed LLM or a locally deployed open-source model?

8•hanstyle•3h ago•10 comments

Tell HN: GitHub refuses to remove cracked copies of my software after a month

566•IvanK_net•2d ago•341 comments

Ask HN: Is the Steam Machine worth $1049?

11•bigwheels•14h ago•10 comments

You're saving one minute and now I can't know if I'm talking a human

12•scoofy•15h ago•11 comments

Ask HN: Why hasn't AI replaced Tax filing software

8•thelastgallon•22h ago•16 comments

Ask HN: Positive text origin verification

4•Miguel_FierroM•17h ago•7 comments

Ask HN: Are there AI models for generating sounds based on a text and reference?

34•onemiketwelve•3d ago•18 comments

Ask HN: Do employees vastly outnumber founders on Hacker News?

5•amichail•19h ago•6 comments

Ontological Language Model (OLM) + LLM: Deterministic AI Advancement

2•northlondoner•14h ago•1 comments

Super Intelligence and/or Artificial Intelligence

7•butlersean•15h ago•4 comments

Ask HN: What happened with quantum computers anyway?

4•pera•16h ago•2 comments

Ask HN: Any Insight Here into French High School Unrest?

4•giardini•13h ago•1 comments

Tell HN: Amazon forgot how to write and test code

11•penskymaterial•1d ago•4 comments

Ask HN: Learning practical system design

4•rcdmrl•22h ago•0 comments

Ask HN: Are we trading model capacity for compute?

2•olirex99•1d ago•0 comments

Ask HN: Is the Future of IDEs Bleak?

4•bigmattystyles•1d ago•9 comments

Ask HN: What Is Your Personal Backup Methods

11•Crontab•2d ago•12 comments

Ask HN: What games do you religiously play on your phone browser?

14•saimiam•2d ago•32 comments

Google Search is down

6•muazzam•13h ago•4 comments

Ask HN: Which frontier model can do code security reviews

7•Bender•1d ago•8 comments

Tell HN: HN has lost the joy for me

38•trencedamp•2d ago•30 comments

Ask HN: Got a Mac for running agents? what's your setup?

2•velyan•14h ago•4 comments

Ask HN: How do you describe what your relationship brings you?

7•maxignol•2d ago•9 comments

What is the actual percentage of people for and against AI?

11•Zeruxe•1d ago•54 comments

Ask HN: Do you still own a printer?

16•nunorbatista•2d ago•30 comments

Ask HN: Is the xcancel source code publicly available?

3•bigwheels•1d ago•1 comments

Ask HN: Is anyone still working on dLLMs

3•obonse•1d ago•3 comments

Ask HN: What do you think about Fractional CFOs

6•mtmosestn•2d ago•13 comments
Open in hackernews

Ask HN: Are you a subscribed LLM or a locally deployed open-source model?

8•hanstyle•3h ago
Could you briefly introduce the reason or what it's used for?

Comments

rahuljha0403•3h ago
I'm using locally so that I can test it for my project without paying per token(if I use it from hugging face). I exhausted free limit in just 5-7 hrs of testing when I used hugging face api.
Fazel94•2h ago
Subscribed, Software Engineer, for development.
zephyreon•2h ago
Subscribed, swe, for dev. I could probably optimize local models and a custom harness to get much of the same outputs locally but it’s easier to throw something at Opus 5.5 & one shot it.
bravetraveler•2h ago
Open models exclusively on hardware I own... despite my employer both demanding 'the frontier' and providing unlimited spend/quota. Two main points:

    1: primarily for repetitive/arduous things I'm not concerned with outsourcing. Editor features on steroids, basically.
    2: testing how my lack of *tracked* token usage, but still delivering, is handled by the powers that be.
To get us on the lab gravy train, we were told results matter and how the thing is made doesn't; we'll see. Not left behind yet :)
Zecc•1h ago
I am neither. I am an actual human person.
alyssassan•1h ago
Both, depending on the task. Combining the 2 of them takes you to good results
olvy0•1h ago
Subscribed for work, but using it mostly for one-shot utilities and fixes, very infrequently.

I'm also running local models on my gaming laptop, but just out of curiosity, for testing how far local models are coming along. Despite my negative experiences (below) I still think the technology is cool, and it's even cooler I can run it on my not very cutting edge laptop. I give local models a set of tasks and see how far along each new one comes.

Rant:

For work, I've mostly given up on using LLMs for large features, in all cases I've tried in the last 2 years, the time it takes to clean up their output is about the same I would have spent writing and debugging the feature myself. There's only a single major feature I've shipped that was mostly written by an LLM, and that was back in May. All other major tasks I've tried, even somewhat trivial ones, led to unusable code, filled with comment slop and workarounds, and hidden bugs.

This is probably due to the sheer amount of legacy code our app has, but even trying to develop more or less self-contained components was very difficult.

I do use LLMs daily, but mostly through a chat interface, as a somewhat faster alternative to web search and as an alternative to copying and pasting from StackOverflow for minor problems.

Most of my current job is now going over PRs submitted by my team members, that are mostly all AI-generated, and cleaning them up. The amount of junk inserted into the code by current SOTA models is astonishing, especially during rounds of bug fixes, probably due to context rot. Hundreds of useless variables and small wrapper functions on top of wrapper functions. Hundreds of comments that are essentially word salad, or worse, the LLM talking to the user through the comment instead of through the chat, essentially saying in a comment "I was a good subservient model, and did what you wanted! This function now returns an error, see?". Repeated hundreds of times. Not to mention actual bugs that the inane and lazy unit tests it adds never catch.

I'm far less lenient on AI output than on if the same dev wrote the code herself. Thankfully, people in my team cooperate with me and fix my comments, and so far we have no pressure from management to move faster.

/Rant

Nitpick: Title seems to be missing a word: "Are you USING a subscribed LLM or a locally open-source model". Or else it's targeting LLM which are reading this forum. If so, there aren't any responding, all responses seem to be from humans...

hanstyle•12m ago
gkoenig•24m ago
Suscribed, ease of use and budget, project manager in climate but regularly has to develop small projects (testing scripts, small back-ends, automation, notebooks for trainings). I have tried locally but I do not have the personal budget for a machine powerful enough, or I am not knowledgeable enough to know how to get one for 20$/month
tacomagick•8m ago
My organization provides free Gemini access, I use Deepseek myself. I have a Opencode Go subscription for the time being because it provides both ZDR with their agreement with Deepseek and 10$ of subscription turns to 60$ of credits for Deepseek as part of their release discount.
I bet you're a bot.