You don't have to actually act on your conflict of interest to be conflicted. It's enough to have the conflict of interest in the first place and that should be reason enough to resign. In fact: most board of directors realize this without being told and in case that they don't realize it there is usually a nice and handy document that they signed upon becoming a member of the board that pointedly reminds them of this fact.