frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Running local LLMs? What's your model and hardware

5•alfiedotwtf•1h ago

Comments

roscas•1h ago
qwen3-coder:30b

codestral:22b

codegemma:7b

codellama:34b

north-mini-code-1.0:q8_0

laguna-xs.2:latest

Currently testing those above on AMD Ryzen 5 3600x with 48GB of RAM and a nVidia 3080 with 10GB of VRAM.

Favorite model is laguna-xs.2 because it is really fast on CPU and very good.

alfiedotwtf•1h ago
If you’re able to run qwen3-coder, have you thought about 3.6 27B or 35B? Looking at benchmarks, 3.6 looks its gained a lot over qwen3-coder
alfiedotwtf•58m ago
Oh! Looks like I’ve been sleeping on Laguna!

Data Privacy while using API tools

3•11shyam11•43m ago•2 comments

Ask HN: What do you predict the world will look like in 5-10 years?

3•justanything•2h ago•3 comments

Tell HN: Mojo is becoming open source

5•theanonymousone•2h ago•1 comments

The open source DOCX editor submitted to HN a few weeks ago has been deleted

92•gcanyon•17h ago•41 comments

Ask HN: Is there a quiet market for 'no enforced AI' dev jobs?

6•reinhardt•3h ago•9 comments

Ask HN: Is "no source code was copied" still a sufficient copyright defense?

64•oscgam1•23h ago•74 comments

Ask HN: Running local LLMs? What's your model and hardware

5•alfiedotwtf•1h ago•3 comments

Ask HN: Where is the programming profession going?

141•syntaxbush•2d ago•156 comments

Ask HN: What GUI/desktop app do you use to keep track of different AI sessions?

2•howToTestFE•5h ago•3 comments

Ask HN: Has Ilya Sutskever spoken publicly lately?

5•aurenvale•7h ago•0 comments

Tell Zillow: Fee-Simple vs. Leasehold Filter

3•HoldOnAMinute•16h ago•1 comments

Roblox parental controls are a dystopian security disaster

22•notsure357•20h ago•3 comments

Ask HN: How much coding should beginners learn in the AI era?

35•JohnDSDev•2d ago•45 comments

Ask HN: Norway bans AI in elementary schools

15•mellosty•1d ago•17 comments

Ask HN: Which AI concepts are here to stay, and which will churn?

3•datsci_est_2015•18h ago•7 comments

Ask HN: Techniques for learning things quickly using coding agents?

3•throwaw12•18h ago•1 comments

Ask HN: Who remembers Fry's Electronics – the "church" of IT people?

7•netfortius•1d ago•4 comments

I feel like VSCode is falling apart

12•othmanosx•1d ago•15 comments

Ask HN: How is GPU power draw measured at scale?

5•anax32•1d ago•2 comments

Ask HN: What home printer do you use/recommend?

18•niyazpk•3d ago•22 comments

Ask HN: Why does every AI demo sound perfect but real world deployment always

7•VaderAi•1d ago•10 comments

Decoupling Compute and Memory for Async GPUs

8•yiyingzhang•1d ago•2 comments

Ask HN: What surprised you about Estonia e-Residency and running an Estonian OÜ?

81•jvilalta•2d ago•76 comments

My website gets more attacks than human visitors

5•tommy2970•1d ago•5 comments

Ask HN: Anthropic banned me from using Claude Code and I don't know what to do

81•ayi•4d ago•93 comments

Ask HN: Quickbooks Alternative?

5•bix6•1d ago•2 comments

Google AI overview for "keynesian economics" is written in Korean

4•something765478•1d ago•4 comments

Ask HN: What are the hardest problems AWS Lambda MicroVMs can solve now?

6•iaziz786•2d ago•2 comments

Ask HN: Do you thank your agents when they did a good job?

7•ex-aws-dude•1d ago•13 comments

How to find AI-conservative companies to work for?

21•tossitawayplz•3d ago•12 comments