I just got qwen 3.8 27b mlx running on my Macbook Pro and honestly I’m pretty blown away by how not-dumb it is.
prettyblocks•30m ago
My problem is how hot they run. I'm an m4 pro. Do you have the same issue?
downrightmike•29m ago
Mineral oil bath?
lukan•24m ago
I don't have the hardware but a often mentioned advice is to put your mac into energy saving mode - it still will work, a bit slower, but stays cool.
delichon•1m ago
Someone just mentioned how fast they were burning tokens. I thought it was a metaphor.
StarlaAtNight•29m ago
how quick does it respond? what are specs of your laptop?
chorlton2080•23m ago
Does it need to respond fast? For important applications, I'm sure we'd all be fine waiting 20 minutes for a high quality, usable answer. Or is it the need for interative refinements that make speed relevant?
jonplackett•44m ago
prettyblocks•30m ago
downrightmike•29m ago
lukan•24m ago
delichon•1m ago
StarlaAtNight•29m ago
chorlton2080•23m ago
alexchantavy•22m ago
applicative•16m ago