If you don't enable this feature (which isn't enabled by default in Debian) you won't have this problem.
But they do have an excellent solution to the whole updates debacle: Install them in a separate location, initialise them when booting or when they're finished installing, and delete them when they're inaccessible from a few standard locations like /boot or /proc.