It has been a significant amount of work just dealing with all the derppelgängers out there who use an address they don't own for important things. Medical records. Divorce papers. Mortgages. The short of it is that it doesn't even require maliciousness on someone else's part to be affected by impersonation, accidental or otherwise. So yeah, keep what you've got, because there's no guarantee the next person to get it will not somehow affect you.