zlacker

[parent] [thread] 0 comments
1. afs35m+(OP)[view] [source] 2023-07-25 04:09:23
Scraping webpages is extremely useful and this would seem to combat this. It's also extremely useful by... oh yes... Google. And I'm sure they would find a way to whitelist their scrapers to index pages, but archive.org? Oh you're SOL.
[go to top]