zlacker

[parent] [thread] 2 comments
1. dazc+(OP)[view] [source] 2023-07-08 07:28:04
Since robots.txt is currently ignored by bad actors, why would any alternative be better?
replies(2): >>tjpnz+D >>berkle+X
◧
2. tjpnz+D[view] [source] 2023-07-08 07:35:58
>>dazc+(OP)
Because Google can start ripping off content in the open with impunity.
◧
3. berkle+X[view] [source] 2023-07-08 07:41:02
>>dazc+(OP)
> bad actors

I prefer the term ‘Chad third-party scraper’ [1]

https://pbs.twimg.com/media/FxkeJmjakAENFI8?format=jpg&name=...

[go to top]