By that method, you might claim that all terms of all licenses (Free Software, Open Source, or proprietary) aren't really important, as the copyright holder can always ignore any of them.
I mean, yes, that's technically correct. But I'm not sure how useful it is? What is it adding to the discussion?