frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Most publishers allow AI bots to crawl their sites

https://newoldweb.com/analyzing-5818-publishers-robots-txt-files-most-non-profit-news-organizations-allow-ai-bots-openai-most-commonly-blocked
4•netaustin•3mo ago