Cloudflare is rolling out pay-per-crawl scheme for AI Agents but this will obviously impact web scraping as 20% of the web is behind Cloudflare.

There are already numerous ways to bypass CF but curious how they would be able to stop web scraping?

Have they built up a giant database of residential proxies from BrightData and others over the years and can detect if these are proxies?

I'm curious to know what web scrapers on HN thinks about this move and what your plans are.