zlacker

[parent] [thread] 1 comments
1. fifilu+(OP)[view] [source] 2024-08-24 20:43:15
One reason SQL has become more popular lately is as an API for map/reduce.

Before you would write a Java/c++ class that would do the map/reduce job for you distributed over 100s of CPUS. And you would feel like you were on the bleeding edge doing innovative stuff.

Turns out that SQL is a perfect API for map/reduce.

Everything you write in SQL can be transformed into a massively parallel job. And you don't even know about it.

This is the secret behind BigQuery and Trino/Presto/Athena.

replies(1): >>mr_toa+I1c
2. mr_toa+I1c[view] [source] 2024-08-29 05:12:32
>>fifilu+(OP)
If your data is relational. SQL can get pretty ugly with semi-structured data, graph traversal etc.
[go to top]