zlacker

[return to "Google to explore alternatives to robots.txt"]
◧
1. dazc+g9[view] [source] 2023-07-08 07:28:04
>>skille+(OP)
Since robots.txt is currently ignored by bad actors, why would any alternative be better?
◧◩
2. berkle+da[view] [source] 2023-07-08 07:41:02
>>dazc+g9
> bad actors

I prefer the term ‘Chad third-party scraper’ [1]

https://pbs.twimg.com/media/FxkeJmjakAENFI8?format=jpg&name=...

[go to top]