Only thing that separates them is the build quality and the extra 20W of boost the framework desktop and this variant support.
They have a note on the thermals but no measurement of noise. Doesn't matter if it's stricly a whoosh or a whine, only if they bother people in the same room. And the small ones like Bosgame get a consistent complaint about the noise in in-depth youtube videos.
https://github.com/pettijohn/corsair-ai-workstation-performa...
Open, cheap & good enough will win the race.
Hardware is the exact same as what used to be available for $2K last year (and is still $1K cheaper from Chinese OEMs).
LTT Lab's LLM testing is getting more sophisticated, which is great - I think it's worth noting that ROCm/Vulkan versions and llama.cpp build versions are going to have some big differences for numbers.
For those wanting to get the most out of their Strix Halos, there's both kernel tweaks and utilities like ryzenadj that can help you get the most out of it. ( http://strixhalo.wiki/ has most of that documented). Also, if you're running for coding or agentic work, if you model supports MTP, that's mature and should give you a decent (30%?) decode boost.
The differences are basically, sparks require ARM and sparks allow interconnects; so if you do have dreams of electric sheep to chain them together, you're not gonna get the AMD halo units.
But if you just want to putz around with a dev machine and do other things, not sure you'd want a spark.
As traditionally AMD was a supplier of parts.
Microsoft = yes, they care enormously, as Surface has taken away many sales. Albeit they sold some ChromeBooks
But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark.
The Spark is literally a faster version of this, with better software support.
Edit: And I say that as an owner of a Ryzen AI Max 395 device.
For anyone considering these devices, the only reason I would recommend against them is if you plan on getting multiple to link together - the DGX Spark has a much, much faster interconnect bandwidth ceiling than the AMD devices do.
Otherwise, they're great!
With the current RAM and SSD prices... I rather a bit later.
PS6 supposedly will be priced >$1k: https://youtu.be/-F1JS-4Abjo
However for local single-user setups, it's often better to have access to more capable/bigger MoE models at reasonable speeds and lower concurrences, which is enabled by these platforms.
It's great to get lots of tokens, but being able to handle and extent context is why it'll continue to be a great machine compared to any of the small graphics cards.
it allows you to run smaller models much better
imo 3090s make the most sense if you can buy at least 2x ideally 4x but of course we're talking about a completely different budget at that point
"The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"
https://community.frame.work/t/was-there-no-possible-way-to-...
128 bit: 96 GB?
256 bit: 192 GB
512 bit: 384 GB?
1024 bit: 768 GB?
I fear that by the time the RTX Spark comes out it'd have to be $6k, and by the time a 128gb or more machine with 700+gb/s comes out it'd be at $10k, way out of most consumers' hands.
kamranjon•55m ago
It has the same 256 GB/s memory bandwidth limit as every board previously, not sure why this is even being released right now as if it's some new fangled thing - you can go get a Framework Desktop for roughly the same price or a GMKtec EVO-X2 for a bit cheaper.