zlacker

[parent] [thread] 6 comments
1. sschue+(OP)[view] [source] 2023-06-01 12:48:50
I guess these clients just need to scrape the websites and make post request via website with fake user agents etc.

It's a lot of work but for a small fraction of 20m a year you can hire a team who only work on that.

Didn't Digg primarily die from a redesign? Why has the web become so forgiving these days? People don't seem to give a shit anymore. "Oh OK, I'll use the official reddit app filled with ads, OK I will watch your 30 second pre-roll. OK I will give you may data for free". /s

replies(2): >>anonre+Y1 >>Kranar+fc
2. anonre+Y1[view] [source] 2023-06-01 13:03:02
>>sschue+(OP)
Good luck releasing a client like that on the App Store.
replies(1): >>sschue+k9
◧◩
3. sschue+k9[view] [source] [discussion] 2023-06-01 13:45:57
>>anonre+Y1
On what grounds is Apple or Google going to block it? You're using the website wrong?
replies(1): >>iggldi+hj
4. Kranar+fc[view] [source] 2023-06-01 14:01:59
>>sschue+(OP)
>It's a lot of work but for a small fraction of 20m a year you can hire a team who only work on that.

I tried doing something like this for scraping corporate profiles. It's a lot harder than it seems. Most websites try to block bots that do this kind of scraping (unless you're Google/Facebook/etc...), so you end up having to setup a boatload of VPNs to make it seem like the bot is coming from multiple sources, but the VPNs end up being very unreliable and they too get banned as well.

For my own small scale it did manage to work but it was very challenging. I'd imagine doing it at the scale of Apollo would be all but impossible to get away with.

replies(1): >>sschue+oh
◧◩
5. sschue+oh[view] [source] [discussion] 2023-06-01 14:25:16
>>Kranar+fc
They will block bots and large scrapers.

What you have to do is have the app do it directly. This is more work if you have to do it in the app but it makes life for reddit a living hell as they can not just filter high requests nunbers as the traffic is coming from individuals.

◧◩◪
6. iggldi+hj[view] [source] [discussion] 2023-06-01 14:32:57
>>sschue+k9
Re Google, possibly through this, as per https://support.google.com/googleplay/android-developer/answ... ?

"We don’t allow apps that interfere with […] or access in an unauthorized manner […] other […] servers, networks, application programming interfaces (APIs), or services, including but not limited to other apps on the device, any Google service, or an authorized carrier’s network."

"Examples of common violations: […] Apps that access or use a service or API in a manner that violates its terms of service."

replies(1): >>sschue+Uu
◧◩◪◨
7. sschue+Uu[view] [source] [discussion] 2023-06-01 15:15:22
>>iggldi+hj
Doesn't matter, those policies won't mean much as soon as the EU forces Apple and Google to allow 3rd party app stores.

I would also argue that accessing a website is not an API or an undocumented feature but a public entity. Who decides how a browser is supposed to display a website? It's up to the browser maker not some app store review process. That is why we have moz- CSS and apple meta tags.

[go to top]