thats right, no AI queries, means exactly that.

just like signs such as no trespassing: active shooting range; or apiary[bee] yard; or open shaft mines, means that exactly, and in my region, signage is sufficient no gate or fence required.

every so often someone thinks they are too important for that to apply and they find out the signage is no joke when they encounter the target line, and backstop being hit from somewhere uprange; or violate the space of a bee hive; or fall into a shaft. some even have the nerve to complain this is a threat.

robots.txt == no trespassing == stay out unless invited

„Hey I have this nice picture in my living room. If you want to see it just come by.“ - People actually do. - „How dare they!“

"Front door" is to "entering" as "plain HTTP request (public)" is to "authenticated HTTP request (login)."

An AI that is randomly guessing passwords to an authentication/login endpoint is clearly malicious.

I think it's more like this:

Is it unethical to lock/obstruct the public sidewalk in front of your house because it blocks people who only want to pass by and look at the house?

We did just fine before crawlers had indexed the internet. We’ll do just fine without them. It will be more difficult to find answers, and it will be more difficult to hate communities. Double win.