If you want them to pay, tax the fuel and consumables like tyres, or put a tax based on how hard is to recycle the car once it hits the scrapper. Bit more complex with EVs I admit, but making someone pay just for keeping car even if they use it once a week is silly.
Yearly fee should be proportional to legalese required to keep it registered (paying wages), not much more.