A post on r/webscraping this week asked a question that keeps coming up: "I'm using Selenium through Chrome, need to scrape ~1M pages at ~1s/page, but every request hangs 7-8s on a Cloudflare challenge." At 7 seconds per page, 1M pages takes 81 days. That's not a rate limit problem.
That's a detection problem — and you can't fix it with more threads. The replies to that post are a goldmine of advi