De-centralized computing is similar to what happened in IBM/Sony Cell CPU: independent SRAMs with an associated vector unit, doing transfers to the main/host DRAM via DMA using a high performance ring buffer. The benefit is simpler architecture, but more difficult software implementation, although for AI or graphics development behind an abstraction could be perfectly fine.