Kinda hard to raise an army to fight the adjacent royal when one town's contingent hates some other town's contingent more than they hate the enemy.
But yeah, they mostly let the peasants do whatever so long as the particular whatever wasn't potentially bad for them.