I'm pretty sure you have to keep the checkbox unticked so that the Amazon app can install apks and even update itself. In fact Amazon's official documentation[1] for installing their app doesn't tell users to uncheck the checkbox. The way I see it, keeping the untrusted apks checkbox ticked is a massive security risk.
[1] https://www.amazon.com/underground