For example, in NLP a huge amount of pre and post processing of data is needed outside of the GPU.
If python is fast enough for your case, then fair enough. And yes, it is fast enough for a lot of cases out there. Especially, for example, if you batch requests.