Yes it matters, there are use cases if not only for privacy focus people. Why would the hold the keys? I actually have found a good example of one that I am working to verify.
The chat is a bit more transient but you're transferring messages encrypted again over websocket for example, then decrypted on client.
I'm not seeing what the blocker is, or even issues with scale given its the client side doing the work.