AI crawler wars threaten to make the web more closed for everyone#Web#Search#Criticism·technologyreview.com·Feb 11, 2025AI crawler wars threaten to make the web more closed for everyone