Sure, but before that they generally make a lot more money than the second and third mover. When all is said and done, Atari and Yahoo did much better than Colecovision and Lycos.
The risk with being the first mover is that, having easily seen off competition from the second and third mover, you become complacent and stop moving.