zlacker

[parent] [thread] 3 comments
1. altfre+(OP)[view] [source] 2023-07-25 07:54:59
> The market is trying really hard to price out web scraping... scraping is becoming non-existent in user-space apps

Uhh... Those two matters are pretty much unrelated to each other. Scraping is becoming non-existing because the era of static web pages has ended. No need to "scrap" when you have a nice, performant JSON REST API provided for you.

replies(2): >>flagra+4t >>wrapti+Mk3
2. flagra+4t[view] [source] 2023-07-25 12:10:24
>>altfre+(OP)
SSG vs SSR really has nothing to do with whether an API exists to provide the data you would otherwise need to scrape.

When was the last time you saw a site with a JSON API providing metadata, like the json-ld for a product on an e-commerce site? Or an API just for the open graph data? How would you even discover these APIs for sites that you don't own?

It's also worth noting that very, very few JSON APIs today are actually REST. They rarely include all the context needed, and in general JSON is much less useful than XML when you're talking to other APIs that you don't own since JSON can't easily describe the shape and datatypes of the content.

3. wrapti+Mk3[view] [source] 2023-07-26 01:38:20
>>altfre+(OP)
> No need to "scrap" when you have a nice, performant JSON REST API provided for you.

There are no performant json rest APIs provided these days though. The days of public APIs are long gone.

replies(1): >>altfre+BC5
◧◩
4. altfre+BC5[view] [source] [discussion] 2023-07-26 16:57:38
>>wrapti+Mk3
HTML "APIs" weren't meant for public either.

In practice, if there is a mobile app, there is an API. Whether it's creators object to your usage is mostly their own problem.

[go to top]