First thing I would try is seeing if the front end has a different retry strategy for a different status code (say 503). If so I'd change the status returned for throttling to be that (503).
Barring that, turning off server side throttling or atleast making it less aggressive to slow the retry storm seems the most reasonable.