zlacker

[parent] [thread] 0 comments
1. dasil0+(OP)[view] [source] 2023-07-08 16:26:57
I don't understand what you have against robots.txt. It's just a way to signal what you want crawlers to do on your site. It's not complicated or mandatory, but it gives you a way to influence how your site is accessed. I'm not sure why you would jump straight to litigation as a better solution—that solves a much smaller set of problems at a much higher cost.
[go to top]