So at least for some people, based on the fact that they stopped traveling, it is difficult :-)
It's ok - we knew what we were signing up for before having kids, but deciding at 3 o'clock to spend the weekend camping is a lot less practical now. Even a quick outing requires a solid 30+ minutes of prep.
Travel locally, by car. Trips of about 3-4-5 hours should be doable, for extended weekends or week long vacations.
You probably want school-aged kids if you really want to go far across different time zones.