I'm glad Zuckerberg appreciates my homemade porn. Nobody else seems to.

The author seems surprised that the downloaded content is only "loosely connected," like a blog post about selling a house and a porn flick about a realtor. But that just proves that no humans were involved in scoping the content at all.

AI training data was vacuumed up without any consideration for the source or even the content itself. The fundamental way LLM models are built invites you to do just that. To get to the biggest "L" (for "large") you must suck up as much content as possible.

They brought it on themselves, by design, and are only now finding out what they actually ingested.