zlacker

[return to "Google vs. the Open Web"]
1. andy99+cw[view] [source] 2023-07-26 13:17:34
>>ColinW+(OP)
How does WEI work with non-browsers, like curl or python requests? I was wondering if there is some motive here to monopolize web scraping (especially with respect to harvesting AI training data)?
◧◩
2. AndroT+jy[view] [source] 2023-07-26 13:25:57
>>andy99+cw
I mean that’s part of the point. It’s there to exactly lock out scrapers. Or crawlers, for that matter. What a happy little coincidence.
[go to top]