But I have not tried making generative models with out-of-distribution data before. Distributions other than main training data.
There are several indie attempts that I am aware of. Mentioning them to the reply of this comment. (In case the comment gets deleted)
The first layers should be general. But the later layers should not behave well to porn images. As they are more specialist layers learning distribution specific visual patters.
Transfer learning is posssible.