What! Ends with a cliff-hanger!? I NEED TO KNOW WHAT POINTS HE MISSED!!!

(but not badly enough to buy a $100/mo subscription).

He's a churlish AI skeptic that isn't worth listening to.

Anyway, I think they are really well positioned for local inference, if local inference will be a thing they will be fine.

A lot has been made of Google's recent earnings being cash flow negative (I think for the first time ever?). Building data centers is something Google is very good at. They've also partially or wholly insulated themselves from a collpase by using Special Purpose Vehicles ("SPVs") where the collateral for loans is simply the GPUs. Even the physical building and the land its own is leased from another subsidiary. Google is still a cash cow. I also think they may break the NVidia mohnopoly with their own TPU hardware given enough time.

Microsoft too is a cash cow and seemingly hasn't bet the farm on Copilot.

And Apple is a real dark horse here. They, like Microsoft, don't seem to have bet the farm on AI but also, they're in a unique position to drive a move to local LLMs with their own silicon. Their ARM CPUs use a shared memory architecture. Nvidia strictly segments the market by limitng VRAM on consumer GPUs. Apple can get around that. They just don't have the raw FLOPS to compete yet. There have been rumors they're targeting the M7 series in 2028 for a big jump in AI performance.

This market is going to boil down to performance-per-Watt (IMHO) and that's going to be interesting to watch as NVidia moves up to an annual product cycle. what will the new generation do to existing deployements when hardware 1-3 years is at a severe PPW disadvantage? we'll see.

Personally I just want to be able to buy 64GB of RAM for $200 and an SSD for under $100 again. You know, like 2025.

Once upon a time there was a Chinese farmer whose horse ran away. That evening, all of his neighbors came around to commiserate. They said, “We are so sorry to hear your horse has run away. This is most unfortunate.” The farmer said, “Maybe.” The next day the horse came back bringing seven wild horses with it, and in the evening everybody came back and said, “Oh, isn’t that lucky. What a great turn of events. You now have eight horses!” The farmer again said, “Maybe.”

The following day his son tried to break one of the horses, and while riding it, he was thrown and broke his leg. The neighbors then said, “Oh dear, that’s too bad,” and the farmer responded, “Maybe.” The next day the conscription officers came around to conscript people into the army, and they rejected his son because he had a broken leg. Again all the neighbors came around and said, “Isn’t that great!” Again, he said, “Maybe.”