zlacker
[parent]
[thread]
4 comments
1. KuiN+(OP)
[view]
[source]
2023-05-31 22:34:11
Archive.org was knocked offline the other day due to some AI startup scraping it to death. It’s not a good thing.
replies(1):
>>moneyw+er
◧
2. moneyw+er
[view]
[source]
2023-06-01 02:39:22
>>KuiN+(OP)
Source, they don’t rate limit
replies(3):
>>Kon-Pe+Ps
>>pipers+8z
>>edgyqu+EE
◧◩
3. Kon-Pe+Ps
[view]
[source]
[discussion]
2023-06-01 02:55:13
>>moneyw+er
https://news.ycombinator.com/item?id=36110527
◧◩
4. pipers+8z
[view]
[source]
[discussion]
2023-06-01 04:13:23
>>moneyw+er
True - and their lack of rate limiting ended up letting someone overwhelm their servers, knocking them offline.
◧◩
5. edgyqu+EE
[view]
[source]
[discussion]
2023-06-01 05:23:11
>>moneyw+er
They put out a blog asking people not to scrape afterwards. A simple google will be much fast than asking for sources.
[go to top]