Now instead of one layer with hardware contact, you have two (assuming you want performance too). Twice the attack surface.
In the real world, if someone exploits your PDF reader, they don't have to circumvent your OS: your OS hands over everything you can access, by design. One could argue that a better security model baked into the OS would make more sense than a virtualization hack, but the latter has the advantage of actually existing.