This is absolutely the correct and original take. This modern corporate bending over backwards to try to appease the lawyers and pretend the web isn't public is the new and weird take. Seriously, if it's not supposed to be public then don't put it in public.
When I send a HTTP request to a webserver on the public internet it is up to them to decide if they want to respond to that request. And it is 100% up to me what I do with the data in that request on my machine in private.
>Common Crawl doesn’t log in to the websites it scrapes, but its scraper is immune to some of the paywall mechanisms used by news publishers. For example, on many news websites, you can briefly see the full text of any article before your web browser executes the paywall code that checks whether you’re a subscriber and hides the content if you’re not.
This weasly idea above, that corporations get to decide how you display the HTML, is very, very dangerous to our society. It's as if visiting a website and downloading the publicly available contents is a nation setting up an embassy of "foreign soil" on your hardware that they control and you don't.
Their cultural expectation is that you cannot do what you want with that data. Modifying it or how it's displayed is, to them, is like walking into their business location and moving around the displays. So obviously the only legal interface is the one they provide "at their location" or via another incorporated entity they associate with. But of course they aren't at their location they're at my location on my property in my PC. But slowly this commercial norm is working it's way into leglistation to become our reality as web attestation.
What they see, and what they want, is a situation equal to you going to their business premise and sitting down at one of their machines. They want to own your computer in just the same way simply by you visiting a website. That shit's fucked.
I'll turn off CSS and JS if want to and read the text if I want to on my computer in my RAM. If you don't want me doing that don't respond to the HTTP request. And stop trying to characterize all interactions on the web as between corporations. There are more of us human people than corporate people. Our use cases matter.
Alex Reisner and The Atlantic should be ashamed of themselves. They obviously don't know what they're talking about and are just repeating a corporate PR line, or, at best, intentionally trying to create controversy out of nothing.
As an aside, I do host a website from my desktop computer at home and you are free to access it! It's public. I intentionally put it on the public internet. I do not use a smart phone or the internet via phone.
Sorry, no. That's a software engineer's fantasy. And it's not even applicable to this case: it's not like Common Crawl is is only uses the data on their own machine in private, they're distributing it. Copyright is a real thing, that grants real rights, whether you like that or not. It doesn't disappear because computers and you don't like it.
Your vision that each recipient has the right to break this compact just undermines the model. I really like that I can spend $20 at the theater to watch a movie that cost $100m to develop. And while I understand your point about HTTP, I would rather live in a world where costs can be easily shared fairly and efficiently. Yeah, some publishers will gouge me, but the market sorts that out.
The shamelessness of the propaganda reaches new heights. The industry shills no longer even attempt to make arguments, they just rely on people repeating their slogans.
I don't think the LLM companies are fully innocent here, to be fair.
bookofjoe•3mo ago
stuartjohnson12•3mo ago
8474_s•3mo ago