I wonder if Kafka represents an existential angst in these Kubernetized Microservice times. Or is it more simply I am just too dumb to learn and use this shit correctly.
I mean, whoever in their right mind would want to:
- have a snapshot of data
- query data, including ad-hoc querying
- query related data
- have trasactional updates to data
When all you need is an unbounded stream of data that you need to traverse in order to do all these things.
One of those things being “store it in a relational model” or “write a sum to a key value store” or something else.
This ability comes for free with Kafka, but is very not-free when using a relational model.
> Relational database seem to be a crazily overengineered solution in search of a problem
Why would an answer to that need to mention Kafka consumers?