true! but how does one find all those ips?

Allmost all the bottraffic I see is from random residential proxies though.

I initially thought this was a good idea too until another comment pointed out you'll lose most business or personal customers in offices because they connect through VPN gateways running on those cloud services (especially Azure)

There have been a number of articles on the frontpage of HN about the residential proxy traffic. It is happening. This was one of the most popular:

https://news.ycombinator.com/item?id=49491791

>But I don't see that happening.

Then you are not looking. Already have to switch to resi proxies from time to time when encountering yet another smartass who decided to play security theater and block datacenter ips on his shitpile he calls website, because "OUR USERS MUST BE GOOD BOYS WHO LOVE TO LIVE UNDER SURVILANCE AND ALLOW ISP TO TRACK THEM 24/7" (and before you say something like "others can track you too!", your ISP has the ability to knock on your door, they should be given as little information as possible, let them do metadata analysis on per-person basis if they really want it, but no 1-click mass surveillance shit).

If you are valuable, you will be be scrapped. Turning user hostile in a hopeless endeavor to "protect yourself" is not the solution.

Yeah, I can imagine it being a problem if it was from different IP addresses, but surely putting a limit on requests from a single IP would be a straightforward fix? Although maybe until it happens, you don't think about it.

"we" in this sentence is really a handful of encloistered silicon valley weirdos. Most people do not like it and have no real say in the matter.

Who's "we"?

People really still buy into that framing? I think it's pretty clear that it's generally just about money as it has always been.

would the implied intent (from the inclusion of adult content) of training models on open3dlab content, without asking them, render Roblox's actions _less_ antisocial???

honestly for me is the hypocrisy

we've spent the entire 2010s with lots of talk whether creating a scraper for google or linkedin and packaging that data to sell is illegal just for the entire thing to turn around where large companies are basically burning small servers down with requests to do the exact same thing

Man if only there was such a thing as good manners, good behaviour, accepted practices from a community to not massively hammer servers. If only these websites had been up for a decade with very few problems, before a notoriously manipulative, lying, deceiving, abusive company that makes money off of child abusers came in and just went hurr durr free data in the WORST possible way instead of just politely asking for a dump.

[delayed]

I mean, it's not the size of the download, it's the unauthorised scraping of community assets strictly against terms and ignoring robots.txt by an American corporation. Resource of a kind that used to get kids threatened with spending most of their life in prison.

But I agree that this kind of theft by US corporations is no longer news.

(Yes, it's theft: they were aware they may not do it and according to the article attempted to get around further restrictions. I mean it's literally even theft of the $3 you mention — you don't have to be in possession the $3 to illegally deprive its owner of it under common theft statutes)

Would you also say that general licensing is irrelevant for everyone?

Can I scrape all GPL source code from github. Then use the code commercially and then say so what, they made their source code available to download?

This is quite simple put in the article.

> The crawler did not respect our robots.txt, (which it did retrieve), ignored our Terms of Service, (which forbid scraping), and defied the creators' licenses: 423 of the 712 projects are licensed for non-commercial use only.

It's a community site, first model I looked at (Tanya by Shrimport) is under CC-BY-ND-NC licence (Creative Commons, By attribution, No-derivatives, Non-commercial).

AI training by definition is derivative, and Roblox not using it for commercial purposes if used in production is practically nil.

This is a huge part of why AI upsets people, we can't have nice things such as communities where people are sharing 3d models without it being feeding ground for commercial companies that has little intention to ever honor any licences or compensate authors.

They ignored the licenses, so kinda moot point you're making.

Oddly, this makes their argument even stronger. Why would Roblox download this?