If someone does not abode by the terms of the contract, they are not covered by it.
In other words, the intolerant are not following the rules of the social contract of mutual tolerance.
Since they have broken the terms of the contract, they are no longer covered by the contract, and their intolerance will NOT be tolerated.