Matrix is 100% open source, has a larger community maintaining it and is federated.
If you're worried about backdoors then you should have more eyes on the code.