Don't forget the third big part: stopping them from violating the rights of others.
They do temporarily lose some rights, they do (and should) get them back when their "debt to society" is paid (which I find a slightly weird term, but whatever), why shouldn't the right to vote be one of the rights that you get back when you're rehabilitated and reintroduced into society, just like your right to freely move about?