Is this actually true? I thought that hyperscalers keep datacenters at arm's length, using subsidiaries and outsourcing a lot of things.
They can run other ML stuff but I don't see how the world could absorb the amount of compute/RAM for these other workflows.
Since the hardware itself depreciates quite fast compared to the buildings, the long lasting physical structure is probably the best bet, being repurposed for more general computing (since all HVAC, electricity, and other expensive infrastructure is already in place).
Then the inference mega datacentre investment becomes a losing proposition for those who paid too much for the wrong kind of computers, but AI users still get more compute, lower prices etc.
So they're sitting on real estate with access to massive amounts of water, electricity, and high bandwidth network connections. Seems like that combination of resources could be useful for a lot of other things beyond just data centers.
Like you could probably run desalination plants, large scale hydroponic farms, semiconductor manufacturing, or chemical processing facilities. Anything that needs the trifecta of heavy power, water infrastructure, and fiber connectivity could slot right in.
I don't see any reasonable path moving forward for these datacenters for the amount of money that they have invested.
Depending on where, and (more importantly) when you last read about this, there's been some developments. The original book that started this had a unit conversion error, and the reported numbers were off by about 4500x what the true numbers are (author claimed 1000 times more water than an entire city consumption, while in reality it was estimated at ~22% of that usage).
The problem is that we're living in the era of rage reporting, and corrections rarely get the same coverage as the initial shock claim.
On top of this, DCs don't make water "disappear", in the same way farming doesn't make it disappear. It re-enters the cycle via evaporation. (also, on the topic of farming, don't look up how much water it takes to grow nuts or avocados. That's an unpopular topic, apparently)
And thirdly, DCs use evaporative cooling because it's more efficient. They could, if push came to shove, not use that. And they do, when placed in areas without adequate water supply, use regular cooling.
(I recommend this video by Hank Green on the subject: https://www.youtube.com/watch?v=H_c6MWk7PQc . Water usage of data centers is a complex and quite localized concern, not something that's going to be a constant across every deployment)
But I don't really think that focusing on GPU market is gonna work as I don't really see much reason to cater to GPU intensive workloads unless you are affiliated with AI (for most part, some GPU compute is good but datacenters shouldn't really invest so much in GPU compute)
I feel like I am more optimistic about buying stuff (preferably compute) 3-5 years down the board when things might become cheap in my opinion
But this is still a very long time. On one hand I want Ai bubble to burst asap to lessen the impacts of financial crisis but on the other I really think about the financial crisis and think if there are any ways to mitigate the economy's loss so that it doesn't become 2008 crisis
But reality to me feels as if the chances of Bubble popping up is inevitable, the only question is if we can do anything to lessen the strain on the average person all around the world. I think America will be impacted the most but I wonder how geo-politically this might impact other countries as compared to the 2008 crisis.
I don't really think the american govt. is doing anything to lessen the strain the bubble can cause tho, perhaps even promoting things like stargate/AI bubble itself.
It's just sad for 3-4 years. Lets hope economy gets better and more reasonable than AI hype
After "AI": Anticipating a post-LLM science and technology revolution (evalapply.org)
2 points by adityaathalye 1 day ago | 8 comments
https://www.evalapply.org/posts/after-ai/index.html
> I, for one, welcome the coming age of the post-LLM-datacenter-overinvestment-bust-fueled backyard GPU supercomputer revolution.
I can't be the only one who's noticed that the volume of crypto stuff being pushed slowed as the AI fervor ramped up?
I'd bet anything that they know people are pissed the market has wildly misallocated capital and are trying to save face by framing it as a cost that directly impacts consumers. In reality, the fear is knowing that our investor class is really too dumb to handle the money we've stuck in a box called "the world's retirement funds" and handed to them.
all it took was a chatbot that says "you're a genius"
What a great analogy. People building too many steam engines was one of the main factors that lead to the first world war.
This glut of finances leaves those few with a problem: what to do with it? And since accumulation of wealth is the ultimate goal, FOMO encourages increasingly foolish decisions (or at least unsustainable ones).
The housing crisis is one of the outcomes. This AI bubble is another. I'm sure if we look around, we can find other examples.
If resources were more evenly distributed, we would see different regions and peoples doing more varied things which would be appropriate for their needs.
But yes, we should also make sure that everybody can benefit from it.
...in the concentration of money.
"The handful of benevolent god-kings will be nice to people" is not a model for a decent future.
He says this and then publishes the letter on LinkedIn? What's the play?
christophilus•3h ago
kouunji•2h ago
walthamstow•1h ago
blell•35m ago
scottyeager•15m ago
throwaway_ocr•1h ago
Havoc•38m ago