I think the B65 is priced at $650. Both supported by llamacpp I believe. With that power draw you could run two of them.

Intel GPU prices have stayed fine, but I do wonder if they are viable for Inference if they will wind up like Nvidia GPUs, severely overpriced.

Recent kernels have SR-IOV support for these chips too. B&H has them listed for $950.

https://www.bhphotovideo.com/c/product/1959142-REG/intel_33p...

When 32GB NVIDIA cards seem to start at around $4000 that's a big enough gap to be motivating for a bunch of applications.

Buy 4?

They certainly look viable as replacements for my Tesla P40 for virtual workloads.

Being able to keep infrastructure on Linux is a big advantage.

Support for Single Root IO Virtualization (SR-IOV) to enable compute and Graphics workloads in virtualized environments.

one can upgrade and swap parts with a computer running an Intel GPU. Linux is very well supported compared to Mac hardware.

with those $2k you can have 2xB70, with 1.2Tb/sec and 64G Vram, on linux ( and you can scale further while mac prices increase are not linear 0

There was the video a little while back where LTT built a computer for Linus Torvalds and they put an Intel Arc card inside, so I'd imagine Linux support is at the very least, acceptable.

[1] https://www.youtube.com/watch?v=mfv0V1SxbNA