How well does this (and similar services) deal with anti-bot protection? What happens if I attempt to retrieve a page protected by the cloudflare checkbox or by Anubis? An error, no useful content, or the actual content I want?
m00dy•8m ago
you can bypass those easily except Google Captcha v3, you need to have your own proxy swarm to make it at scale.
weird-eye-issue•4m ago
There is no single answer to this, it entirely depends on the exact service in exact page
Most US services like Claude and ChatGPT send a specific user agent that makes it easy to block them and specifically does not try to get around any sort of bot protections
Meanwhile other services could use a variety of tactics such as simply setting a browser user agent and/or using random data center IPs or residential IPs, etc etc and then the blocking would just come down to whatever the individual page has configured which can actually be pretty hit or miss
dsco•9m ago
DeepSeek Flash really came at a bad time before the Anthropic IPO. I use this thing daily and it’s neck and neck with SOTA models. The search is one of the things setting it apart.
redox99•7m ago
It's really not neck and neck with Opus 5.5.
sudo_cowsay•4m ago
i thought open models weren't SOTA. therefore not neck and neck... in your experience, do you think it depends on your type of work?
Doohickey-d•13m ago
m00dy•8m ago
weird-eye-issue•4m ago
Most US services like Claude and ChatGPT send a specific user agent that makes it easy to block them and specifically does not try to get around any sort of bot protections
Meanwhile other services could use a variety of tactics such as simply setting a browser user agent and/or using random data center IPs or residential IPs, etc etc and then the blocking would just come down to whatever the individual page has configured which can actually be pretty hit or miss