This is so bizarre. I would show a huge lack of empathy as well.
But I agree with you that "I can't continue this conversation" is probably not the best way to respond, even in that case.
If you don't care about the person and their emotions, don't say anything. Nobody else will know otherwise (other than the person you clearly don't actually care about). Feigning care is sometimes worse than just clearly not caring at all.