frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: What does your local LLM setup looks like?

3•the-mitr•2h ago
What models and hardware you are using? For what purpose? What were the challenges? Any tricks that helped you in doing this?

This might help new users like me setup theirs.

Comments

aniokono•1h ago
Claude.MD and other MD context files with guardrails and enforcement?

Are you offering something in this space?

abahgat•39m ago
I bought a pretty powerful desktop computer for gaming in late 2025. It came with an RTX 5080, which I started using to run some local LLMs and run some experiments (most recently, I was trying to get agents to get better at playing Zork I).

I've mostly enjoyed having WSL to leverage Linux dev tools, but it seems like it's still adding overhead that prevents me from taking advantage of the GPU in full, so I'll likely get another drive and install Linux.

I tried Qwen, Llama, Mistral and Gemma. Gemma 4 was pretty impressive.

xiaoyu2006•8m ago
V100 32G SXM2 adapted to PCIE. Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B. I use them when I feel of privacy is important or I just want to mess around.

Ask HN: What are you working on? (June 2026)

206•david927•15h ago•746 comments

I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

347•iliashad•15h ago•86 comments

Ask HN: What does your local LLM setup looks like?

3•the-mitr•2h ago•3 comments

Ask HN: How are thinking efforts implemented?

97•simianwords•1w ago•30 comments

I'm Eric Ries, author of "The Lean Startup" and new book "Incorruptible" – AMA

797•eries•4d ago•576 comments

Ask HN: Year of Linux Desktop is fun with LLMs

3•mirekrusin•8h ago•2 comments

Ask HN: Favorite text heavy blogs that are a joy to read?

113•joshmarinacci•5d ago•29 comments

Ask HN: Why hasn't there been a real competitor to Ticketmaster yet?

262•mdni007•6d ago•239 comments

AWS Bedrock to require sharing data with Anthropic for Mythos and future models

423•TomAnthony•4d ago•254 comments

Ask HN: Want to build something open source on nights and weekends together?

39•vira28•4d ago•16 comments

Is there a name for the type of comments agents add where they leak the prompt?

17•xdennis•1d ago•8 comments

Notes on DeepSeek

208•vinhnx•4d ago•140 comments

Ask HN: Would it be useful to have a slop button in addition to flag?

36•BugsJustFindMe•4d ago•23 comments

Ask HN: Are most corporate SWE jobs performative?

247•hnthrow10282910•4d ago•282 comments

Ask HN: What are tools you have made for yourself since the advent of AI?

441•aryamaan•6d ago•775 comments

Ask HN: How do you get into a flow state when using AI to code?

93•kilroy123•3d ago•120 comments

I procrastinate by building tools to stop me from procrastinating: A sad story

20•thisislorenzov•3d ago•10 comments

FTX's former Anthropic stake would be worth about $75B at today's valuation

40•adam_rida•14h ago•22 comments

Ask HN: Are you still using a Vision Pro?

171•y1n0•5d ago•214 comments

Story of How Im Running an Unlimited $6/Month AI Provider on 4x RTX 3090s

7•yolo-auto•1d ago•3 comments

Ask HN: Is anyone shorting the overspend in AI yet?

17•ggm•4d ago•15 comments

Ask HN: Is there a metric for AI code quality?

6•fractalf•3d ago•6 comments

What if we legally required politicians to work regular jobs 2 months a year?

11•ekoeko•1d ago•14 comments

Ask HN: What internal tool did you build that became a product?

7•nehpets•4d ago•6 comments

Ask HN: Did we witness the "Trinity moment" for AI?

18•vld_chk•1d ago•28 comments

Tell HN: iOS devs, get back lots of disk space: xcrun simctl delete unavailable

5•amichail•1d ago•0 comments

Ask HN: I Need Help for a Product

9•memoryleakgame•2d ago•5 comments

Ask HN: Agents get dumber before release of new model version?

9•sporkland•3d ago•7 comments

Ask HN: Which cheap Chinese LLM are you using?

15•linzhangrun•1d ago•6 comments

Ask HN: What is the AI adoption approach at your org?

6•iExploder•1d ago•8 comments