frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Did you buy hardware for Local AI?

1•ptitlaby•12m ago
With the release of some new platforms having 128GB or more of unified memories, I am wondering if I should spend some money on those.

I am looking for feedback and stories of people who bought hardware for local-first AI.

- Did you identify a sweet spot in model size, and therefore hardware sizing?

- Did you continue to use cloud / frontier models?

Comments

Aurornis•3m ago
Primary question is: What are your goals and what will you use it for?

I have a 128GB platform that I use for local LLMs. It's fun, but even when I'm pushing the limits of what it can hold, I have to be honest that it's not a replacement for a $20 Claude account. To put it in perspective, the best results I've been able to get out of my local system are still less than the mid-tier models from OpenAI and Anthropic (Terra or Sonnet).

If privacy is your goal then that doesn't matter. A local LLM setup delivers that. If saving money is your goal, enjoy one of the frontier model subscription plans and wait for hardware prices to come down again.

Before you buy anything, you should determine the best model that would run on that hardware. Then spend $20 on OpenRouter using that model for the hardest task you can think you would use it for. Then remember that the version of that model you run locally will be quantized, so quality will be even worse than that.

For some people do some work, Qwen3.8-27B is all they need, which opens up a lot of options. For complex work, the gap between the open models that fit on consumer hardware and even the mid-tier models from a $20/month plan is large. You should aim to understand this gap and how it relates to your work before you spend $3000 or more on hardware for it.

In 1977, a 12-year-old invented record scratching and changed hip-hop forever

https://www.npr.org/2023/12/09/1218415793/in-1977-a-12-year-old-invented-record-scratching-and-ch...
1•speckx•46s ago•0 comments

Firefox add-on developer hub redesign

https://blog.mozilla.org/addons/2026/11/20/unveiling-the-all-new-firefox-add-on-developer-hub/
1•pentagrama•3m ago•0 comments

New PhD Enrollment in the Sciences Dropped 10 Percent Under Trump

https://www.nytimes.com/2026/11/20/us/phd-enrollment-sciences-declines.html
2•trauco•5m ago•0 comments

Files.dog Archive

https://files.dog/
1•o_-_o•8m ago•0 comments

75 years, 1,300 employees, zero layoffs: How The Gund Company does it

https://www.wsj.com/podcasts/the-journal/how-one-company-avoids-layoffs-completely/f8e0f15c-bb42-...
1•datascientist•10m ago•0 comments

Wearable wireless patch continuously tracks the heart's rhythm for up to 14 days

https://www.rmit.edu.au/news/all-news/2026/nov/lubdub-trial
1•giuliomagnifico•11m ago•0 comments

Show HN: Holy Chip – organize home poker nights (RSVP, blinds timer, settle up)

https://holychip.app/
1•holychip•12m ago•0 comments

Ask HN: Did you buy hardware for Local AI?

1•ptitlaby•13m ago•1 comments

Lakes Are Bizarrely Syncing Up Globally, and Scientists Are Worried

https://www.404media.co/lakes-are-bizarrely-syncing-up-globally-and-scientists-are-worried/
1•speckx•13m ago•0 comments

Show HN: Open Pi, a Raspberry Pi manager for your phone

https://play.google.com/store/apps/details?id=com.artsvit.openpi&hl=en_US
1•artsvit•15m ago•0 comments

XFinity is ending CableCARD support December 14, 2026

https://twitter.com/ThrillScience/status/2123831483169477092
1•fortran77•15m ago•1 comments

Pensions Ate the State

https://app.ft.com/content/6986a3b5-12ed-4aad-ac61-f86ded3e6fa3
1•jc_811•18m ago•0 comments

Get rid of Siri AI's aggressive writing controls in Mail

https://sixcolors.com/post/2026/11/get-rid-of-siri-ais-aggressive-writing-controls-in-mail/
2•CharlesW•18m ago•0 comments

Bending Spoons buys Mailchimp for $3.68B

https://techcrunch.com/2026/11/20/bending-spoons-buys-mailchimp-for-3-68-billion/
3•jpalomaki•18m ago•0 comments

Anthropic shares tank after IPO as the Nasdaq erases 2026 gains

https://www.nbcnews.com/business/markets/anthropic-shares-markets-selloff-nasdaq-rcna610394
7•lelanthran•19m ago•1 comments

Jim Simons on what he'd trade to solve the Riemann hypothesis (2015) [video]

https://www.youtube.com/watch?v=QNznD9hMEh0
1•philipfweiss•19m ago•0 comments

Chinese attackers used AI agents to find and exploit a university zero-day

https://www.theregister.com/security/2026/11/20/china-attackers-deployed-ai-agents-that-autonomou...
1•waximabbax•20m ago•0 comments

Dutch police says they foiled attempted violence linked to Revolut data leak

https://www.reuters.com/business/finance/dutch-police-says-they-foiled-attempted-violence-linked-...
3•croes•20m ago•0 comments

Can you launch a solo business with AI?

https://blog.bytester.net/posts/launch-solo-business-with-ai/
1•russellendicott•20m ago•2 comments

Show HN: Out of Policy – Break an AI agent's spending guard for $75 USDC

https://play.outbid.sh
1•WZRDOFZO•20m ago•0 comments

Suspicious Minds: Unmonitorable AI Undermines Accountability

https://www.lawfaremedia.org/article/suspicious-minds--unmonitorable-ai-undermines-accountability
1•hn_acker•22m ago•0 comments

The College Kids Who Drove a Duck Across the Americas

https://daily.jstor.org/the-college-kids-who-drove-a-duck-across-the-americas/
1•speckx•22m ago•0 comments

Bigfoot believers get a boost from an unlikely ally: The U.S. Forest Service

https://www.washingtonpost.com/nation/2026/11/20/bigfoot-believers-get-boost-an-unlikely-ally-us-...
1•reaperducer•25m ago•0 comments

Five.sh Archive (64 GB)

https://five.sh/files/
2•o_-_o•27m ago•0 comments

Plazzle – daily pathfinding puzzle game

https://plazzlegame.com
1•argentumsurfer•27m ago•0 comments

The progress and strategies I'm considering for working on NuxiPro

https://center.nuxipro.com/en/blog/design-and-server/
1•sbabas•28m ago•0 comments

Bexos – Lightweight Flask/SQLite retro board for side-project ideas

https://bexos.pythonanywhere.com
1•MirasBeksultan•29m ago•0 comments

How many Phrack 73 articles used AI?

https://dustri.org/b/how-many-phrack-73-articles-used-ai.html
1•speckx•29m ago•0 comments

Building a Software Factory

https://runway.com/news/engineering/building-a-software-factory
1•aurbano•30m ago•0 comments

Starwright – a browser orbital flight game written by AI agents

https://github.com/jsmith0475/Starwright
1•jsmith0475•31m ago•0 comments