As a rule, any parasite, invasive bacteria, or virus harms its host, but over time they usually evolve towards exploiting the host more efficiently, which often includes being less harmful.
Among these, viruses integrate quite closely with their host, so viruses that jump into a new species should normally infect less well, but sometimes they infect fine and just harm the host excessively. SARS, MERS, etc.