AMD stubbornly refuses to recognise the huge numbers of low- or medium- budget researchers, hobbyists, and open source developers.
This ignorance of how software development is done has resulted in them losing out on a multi-trillion-dollar market.
It's incredible to me how obstinate certain segments of the industry (such as hardware design) can be.
AMD is doing just fine, Oracle just announced an AI cluster with up to 131,072 of AMD's new MI355X GPUs.
AMD needs to focus on bringing rack-scale mi400 as quickly as possible to market, rather than those hobbyists always find something to complain instead of spending money.
this guy gets it - absolutely no one cares about the hobby market because it's absolutely not software development is done (nor is it how software is paid for).
we're talking about the majority of open source developers (I'm one of them). if researchers don't get access to hardware X, they write their paper using hardware Y (Nvidia). AMD isn't doing fine because most low level research on AI is done purely on CUDA.
[1] This is the AMD Instinct MI350:
https://www.servethehome.com/this-is-the-amd-instinct-mi350/
https://www.tomshardware.com/pc-components/gpus/amd-says-ins...
pella•4h ago
kristianp•2h ago
See https://arxiv.org/abs/2402.17764
treesciencebot•54m ago
I will doubt that they will be able to reach %60-70 of the FLOPs in majority of the workloads (unless they hand craft and tune a specific GEMM kernel for their benchmark shape). But would be happy to be proven wrong, and go buy a bunch of them
pella•25m ago
Tinygrad:
" https://x.com/__tinygrad__/status/1935364905949110532