It is often argued that some of generally illegal substances like marijuana is only toxic to comparable extents as legal substances, but there are observations that it seem to trigger some types of megalomaniac schizophrenia, so the fence probably has reasons to be there, I think.
No. I feel QUITE certain that the distinction is based on whether or not the substance has a history of a few generations of widespread use among western Europeans ("white people").