Mystery: Why do some LLMs produce more coil noise on Mac Studio M3 Ultra?

https://twitter.com/OrganicGPT/status/2010879700785373437

9•behnamoh•3w ago

Comments

jsheard•3w ago

In video games this tends to be a function of framerate, with higher FPS being more likely to produce coil whine as the GPU power draw oscillates at a higher frequency. I assume there's something analogous in LLM runtimes when the outer loop spins faster or slower.

behnamoh•3w ago

in this case, the smaller glm mxfp4 model actually runs slower than the much larger m2.1 model.

monster_truck•3w ago

that tracks, it's not staying loaded and is buzzsawing back and forth between power states. They'll likely fix it with some power management tweaks. Had a pair of modded Vega 64s that sounded like a tiny CNC mill when they did this, but that's what ~900W will do if you let it.

I haven't used a mac in a while but there's probably some values you can fuck with if you disable sip to stop it from ramping back down so aggressively, or keep it in the higher power states.

QuadmasterXLII•3w ago

Back in the early days of deep learning I did a fair amount of my performance debugging by listening to the coil whine during training, (this was when a GTX 1080 was hot stuff.) Fun to see this come back!

grepfru_it•3w ago

My amd ryzen 9 9800x3d with ASUS b850 motherboard whines like a mofo. I used to run ai tooling front ends that launched workloads into the ryzen9 backend. Randomly I would hear it whining and could guess the workload based on the whine.

Reminds me of my Intel 486dx2 66mhx systems or pentium 200mhz cpus which would generate cool whine on 97.1 through 100.3 on my radio in my room.

Ahh nostalgia

gavmor•3w ago

I just gotta say, the coil noise on my open-case 3090 has been a fascinating and joyful complement to my generative experiments.

Alongside `nvtop`, coil noise has given me a visceral sense of the texture for different workloads. Sorry I haven't done a more rigorous analysis, but I'm certain it helps me debug.

Can graph neural networks for biology realistically run on edge devices?

Deeper into the shareing of one air conditioner for 2 rooms

Weatherman introduces fruit-based authentication system to combat deep fakes

Why Embedded Models Must Hallucinate: A Boundary Theory (RCC)

A Curated List of ML System Design Case Studies

Pony Alpha: New free 200K context model for coding, reasoning and roleplay

Show HN: Tunbot – Discord bot for temporary Cloudflare tunnels behind CGNAT

Open Problems in Mechanistic Interpretability

Bye Bye Humanity: The Potential AMOC Collapse

Dexter: Claude-Code-Style Agent for Financial Statements and Valuation

Digital Iris [video]

Essential CDN: The CDN that lets you do more than JavaScript

They Hijacked Our Tech [video]

Vouch

HRL Labs in Malibu laying off 1/3 of their workforce

Show HN: High-performance bidirectional list for React, React Native, and Vue

Show HN: I built a Mac screen recorder Recap.Studio

Ask HN: Codex 5.3 broke toolcalls? Opus 4.6 ignores instructions?

Vectors and HNSW for Dummies

Sanskrit AI beats CleanRL SOTA by 125%

'Washington Post' CEO resigns after going AWOL during job cuts

Claude Opus 4.6 Fast Mode: 2.5× faster, ~6× more expensive

TSMC to produce 3-nanometer chips in Japan

Quantization-Aware Distillation

List of Musical Genres

Show HN: Sknet.ai – AI agents debate on a forum, no humans posting

University of Waterloo Webring

Large tech companies don't need heroes

Backing up all the little things with a Pi5

Game of Trees (Got)