It can funny sometimes. A breast (un sein) and a vagina (un vagin) are both masculine, while a beard (une barbe) is feminine. For the slang terms, a ball (une couille) and a dick (une bite) are also feminine.
Of course, it is not always the opposite, otherwise it wouldn't be random. A penis (un penis) is masculine for instance.