Uhhhh the rest of the stuff in Concrete isn't great for human health, either, or as my cousin likes to say, "it sure ain't vitamins."
Quartz dust and silica sand are really bad for the lungs, likely carcinogens. Lime is caustic. Dust in general is bad to breathe.
These are well-known hazards in demolition and mitigation techniques already exist.