zlacker

[parent] [thread] 1 comments
1. oasisb+(OP)[view] [source] 2025-12-06 16:34:31
No true scotsman needs Cloudflare, as any true scotsman can block AI bots themselves is not a strong argument.
replies(1): >>cpncru+bU
2. cpncru+bU[view] [source] 2025-12-07 00:30:45
>>oasisb+(OP)
But is there any actual evidence that any major AI bots are bypassing robots.txt? It looked as if Perplexity was doing this, but after looking into it further it seems that likely isn't the case. Quite often people believe single source news stories without doing any due diligence or fact checking.
[go to top]