I wouldn't go that far. All the cases you cite are of products that definitely classify as substantially better than what they replaced.
Before Gmail took over the market from Hotmail there had been several other companies that failed due to only being slightly better.
Yes you can beat the "first mover", but doing so is hard and requires an almost revolutionizing better product.
Sure, but before that they generally make a lot more money than the second and third mover. When all is said and done, Atari and Yahoo did much better than Colecovision and Lycos.
The risk with being the first mover is that, having easily seen off competition from the second and third mover, you become complacent and stop moving.