That could be relevant. Also the word "actor", with the same ending, is sometimes (by some newspapers, for example) reserved for men.
Sometimes a similar trick anecdote is told about a "German". There's a suspicion that the ending "man" in "German" primes the listener to imagine a man.