What model of router is it? This really feels like a situation where something has to be broken, I can't imagine any router, no matter how cheap, has an expected ping rtt maxing out at around 2 seconds. Notably, your minimum rtt is under 2 ms, so it's definitely capable of getting a response to you faster than that, maybe it's just overloaded or something?