I am thinking not only in terms of GPU, but Database usage as well.
And 80TB with 1TB/s? Thanks to AI hardware is getting interesting again.
nialse•5mo ago
Agreed. Looking forward to having this kind of performance at hand for next to no money in 10 years. (Not sarcasm.)
Consolidation has gone from having a data center with separate servers for all functions, to consolidating in a couple of racks, and will go on to being single server plus redundancy for most workloads you can imagine at some point in the future. Unless AI manages to convince us that we need the performance and cooling of 10:s of kWs per rack.
Some times I imagine that the IT of most companies, the part that is not ”in the cloud” that is, could run on a single server already. And maybe could even host the cloud functions if the admin know how hadn’t been lost to time.
ksec•5mo ago
And 80TB with 1TB/s? Thanks to AI hardware is getting interesting again.
nialse•5mo ago
Consolidation has gone from having a data center with separate servers for all functions, to consolidating in a couple of racks, and will go on to being single server plus redundancy for most workloads you can imagine at some point in the future. Unless AI manages to convince us that we need the performance and cooling of 10:s of kWs per rack.
Some times I imagine that the IT of most companies, the part that is not ”in the cloud” that is, could run on a single server already. And maybe could even host the cloud functions if the admin know how hadn’t been lost to time.