zlacker

[parent] [thread] 4 comments
1. threat+(OP)[view] [source] 2022-02-18 12:31:33
Mirror: https://web.archive.org/web/20220218111600/https://www.econo...
replies(1): >>retube+T4
◧
2. retube+T4[view] [source] 2022-02-18 13:04:35
>>threat+(OP)
Thanks. Hoes does WBM get the page? Does the economist let it's crawlers through?
replies(3): >>jeroen+45 >>Cthulh+Yb >>flerch+Lc
◧◩
3. jeroen+45[view] [source] [discussion] 2022-02-18 13:06:07
>>retube+T4
Crawlers are often permitted to get more web visibility. I think the Web Archive also crawls the web as a browser sometimes, so they can't always distinguish between crawlers.

That said, with NoScript on I can just read the economist article, no banners or anything.

◧◩
4. Cthulh+Yb[view] [source] [discussion] 2022-02-18 13:54:17
>>retube+T4
I do wonder; at some point, Google said they would penalize websites that show their crawlers something else than real visitors.
◧◩
5. flerch+Lc[view] [source] [discussion] 2022-02-18 13:59:03
>>retube+T4
Just disable javascript and the entire article loads on the economist.
[go to top]