frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

https://vettedconsumer.com/unified-memory-explained-why-mini-pcs-can-run-70b-models-a-big-gpu-cant-and-where-they-slow-down/
27•ermantrout•5h ago

Comments

LoganDark•1h ago
Can't really run it as well, though. My "mini PC" is an M4 Max with 128GB of unified memory and the memory bandwidth is still sorely lacking for inference (although it's far better than any non-unified consumer architecture!).
mountainriver•50m ago
Yeah this is such a funny thing going around. Try to run or train a small/medium sized model on a MacBook. It doesn’t go very good compared to a dedicated gpu

This is likely the right path in the future but it isn’t there yet today

bahmboo•48m ago
To be fair it's "only" half the throughput of a 4090 and a third of an RTX 6000. Significant but not an order of magnitude.
OutOfHere•52m ago
Let's also ensure the SSD doesn't age prematurely.
craftkiller•47m ago
I was under the impression that when you're streaming the weights from disk because the full model won't fit in memory, that it is solely reading from the SSD, not writing, so it wouldn't be causing wear on your SSD.
Havoc•36m ago
Think future generations of AMD could get quite interesting. They’re no doubt seeing people whining about mem throughput specifically
throwa356262•27m ago
"Can't" is not really correct.

Nowadays, specially with MoE models you can run parts of the model on GPU and still get some speed up.

ReptileMan•23m ago
>The two numbers that decide everything

Do you have LLM paranoia? The moment you read something in this style suddenly your brain starts doubting whether you are consuming human generated content.

cheevly•17m ago
Maybe like… focus on the actual content instead of perceived writing patterns? Crazy I know.
glimshe•14m ago
This. I don't particularly like the LLM writing style, but we've read a ton of very poorly written texts over the year with no complaints. LLMs are average writers with an annoying style, but not bad writers. If the content is good, I don't care if a LLM wrote it.
jazzyjackson•12m ago
It’s a flag that no care went into it. Web surfing involves lots of little decisions following cues of “is this worth my time”
lukeinator42•11m ago
The writing style is this staccato LLM-like style that is difficult to read as it has zero flow and meaningless sentences.

Like what does the second sentence even mean? Is it even a sentence? "The roofline math, the prompt-processing catch, the NPU red herring, and the owner-measured speeds."

Write code like a human will maintain it

https://unstack.io/write-code-like-a-human-will-maintain-it
159•ScottWRobinson•2h ago•117 comments

Late Bronze Age Collapse

https://acoup.blog/2026/01/30/collections-the-late-bronze-age-collapse-a-very-brief-introduction/
154•dmonay•3h ago•62 comments

Successful Companies Go Blind

https://ianreppel.org/how-successful-companies-go-blind/
48•speckx•2h ago•18 comments

Europe's Largest Unions Demand Right to Cancel Work on Days Above 30C

https://novaramedia.com/2026/07/09/europes-largest-unions-demand-right-to-cancel-work-on-days-abo...
36•robtherobber•2h ago•33 comments

My burner email blocklist blocked me

https://benjamin.piouffle.com/blog/burner-email-blocklists/
21•betree•1d ago•18 comments

Lost city discovered beneath Egypt's desert with ancient church

https://www.dailymail.com/sciencetech/article-15956159/Incredible-lost-city-discovered-Egypts-des...
22•Bender•4d ago•1 comments

GPT-5.6

https://openai.com/index/gpt-5-6/
1449•logickkk1•22h ago•1015 comments

A Love Letter to Flashcards

https://lesleylai.info/en/flashcards/
3•surprisetalk•10m ago•0 comments

The mathematical secrets of Barcelona's Sagrada Familia

https://mappingignorance.org/2026/06/30/sagrada-familia/
61•Gedxx•1w ago•9 comments

Good Tools Are Invisible

https://www.gingerbill.org/article/2026/07/10/good-tools-are-invisible/
132•theanonymousone•5h ago•94 comments

In Emacs, Everything Looks Like a Service

http://yummymelon.com/devnull/in-emacs-everything-looks-like-a-service.html
103•kickingvegas•7h ago•61 comments

Show HN: Getting GLM 5.2 running on my slow computer

https://github.com/JustVugg/colibri
797•vforno•1d ago•198 comments

Laylo (YC S20) Is Hiring a Head of Finance

https://www.ycombinator.com/companies/laylo/jobs/qce41D2-head-of-finance
1•amellin794•3h ago

Train sim created by just one person is being called the best ever made

https://kotaku.com/a-train-sim-created-by-just-one-person-is-being-called-the-best-ever-made-2000...
758•oumua_don17•5d ago•304 comments

EU Commission: addictive design Instagram and Facebook in breach of the DSA

https://ec.europa.eu/commission/presscorner/home/en
155•jeroenhd•4h ago•106 comments

Show HN: Runloom – Go-style coroutines for Python free-threaded

https://github.com/robertsdotpm/runloom
17•Uptrenda•2h ago•6 comments

Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

https://vettedconsumer.com/unified-memory-explained-why-mini-pcs-can-run-70b-models-a-big-gpu-can...
27•ermantrout•5h ago•13 comments

Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

https://www.macrumors.com/2026/07/06/apple-silicon-exec-explains-mac-mini-ai-demand/
149•tosh•4d ago•208 comments

Ditching Vagrant: VMs with KVM and Virsh on Debian

https://benjamintoll.com/2026/06/29/on-ditching-vagrant/
56•fanf2•4d ago•23 comments

AI-generated videos to maximally drive a target brain region

https://nevo-project.epfl.ch/
176•smusamashah•8h ago•180 comments

Interview with Mitchell Hashimoto about Ghostty and Zig

https://alexalejandre.com/programming/interview-with-mitchell-hashimoto/
317•veqq•22h ago•168 comments

Hy3

https://hy.tencent.com/research/hy3
528•andai•1d ago•108 comments

ActivityPub over ATProto

https://berjon.com/ap-at/
26•albuic•2h ago•11 comments

How RCA Victor sold Sound Service to classrooms in 1939

https://pncnmnp.github.io/blogs/rca-victor-education.html
3•pncnmnp•19h ago•2 comments

EU Parliament greenlights Chat Control 1.0

https://www.patrick-breyer.de/en/eu-parliament-greenlights-chat-control-1-0-breyer-our-children-l...
1530•rapnie•1d ago•765 comments

Ancient Coins: What About Spartan Coins?

https://coinweek.com/ancient-spartan-coins/
8•thunderbong•5d ago•2 comments

The glass backbone: Why the Army's logistics will break in the next war

https://mwi.westpoint.edu/the-glass-backbone-why-the-armys-logistics-will-break-in-the-next-war/
427•baud147258•1d ago•572 comments

Proton AG Services is currently experiencing some issues

https://status.proton.me/incidents/01lxtcq155lc
21•exploraz•2h ago•18 comments

A road to Lisp: Why Lisp

https://scotto.me/blog/2026-07-09-why-lisp/
273•silcoon•1d ago•259 comments

Building a real-time AI tutor for 5-year-olds

https://www.ello.com/blog/teaching-a-child-in-1000-ms
128•catalinvoss•18h ago•263 comments