This device is selling for $1,999. In the product page on their website, they show the device plugged into a MacBook Pro.
A MacBook Pro already has excellent ability to run local LLMs, so why wouldn't someone just spend that $1,999 on maxing out their MacBook specs (extra RAM and GPU) instead?
Or why not buy a Mac Mini with 48GB of RAM for $2300?
Perhaps they don't want a new/upgraded machine or prefer a more portable solution.
In practice you are better off:
- if youre in the mac ecosystem using 2k and upgrading to the ultra class chip next time you want to buy
- if youre into windows wait for the next ryzen ai max chip slated for next year.
- if you want desktop consider gx10 given that you need a computer to use this anyway
In retrospect it is crazy how good the m1 max series is given the amount of ram and memory bandwidth.
ingen0s•31m ago
micromacrofoot•26m ago
> SoC (Armv9.2
> CPU + NPU) 30TOPS +
> dNPU 160TOPS
simonw•10m ago
majorchord•9m ago