zlacker

[parent] [thread] 1 comments
1. Sohcah+(OP)[view] [source] 2025-12-05 23:44:24
How are you this naive? Do you really think scrapers give a damn about your robots.txt?
replies(1): >>cpncru+L6
◧
2. cpncru+L6[view] [source] 2025-12-06 00:39:14
>>Sohcah+(OP)
The legitimate ones do, which is what I was referring to. Obviously there are bastard ones as well.
[go to top]