Me too, but the issue is more nuanced. Google's bots are already being blocked by some mainstream sites due to the crappy "AI-search" (a.k.a. LLM-summarization), which, of course, is a wet dream for Google and the like. Some are starting to block Google's crawlers also for small personal sites:
jruohonen•1h ago
Me too, but the issue is more nuanced. Google's bots are already being blocked by some mainstream sites due to the crappy "AI-search" (a.k.a. LLM-summarization), which, of course, is a wet dream for Google and the like. Some are starting to block Google's crawlers also for small personal sites:
https://utcc.utoronto.ca/~cks/space/blog/web/DoYouNeedGoogle...