If you overtrain the model may include verbatim copies of your training material, and may be able to produce verbatim copies of the original in its output.
If Microsoft truly believes that the trained output doesn't violate copyright then it should be forced to prove that by training it on all its internal source code, including Windows.