https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/
https://www.microsoft.com/en-us/research/group/autonomous-sy...
The alignment problem will come up when the robot control system notices that the guy with the stick is interfering with the robot's goals.