Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones)Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.#404media#EN#2024#robots.txt#bots#AI#scrapers#blocklist·404media.co·Jul 30, 2024Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones)
