I can understand the justifications for culture fit, however, to me it sounds like you passed over someone because he was ambitious outside of work. That's fine if that's your culture, but you should consider that as a red flag.
And also like I said, it worked out in this case, the guy was a get-rich-quick type. He went to work for someone I know and didn’t last there. Sub par work, rushed and didn’t really care. That’s all besides the point.
The point that yes, your outside interests can possibly effect your hiring prospects.
Many see that as a sign that they won't be 100% focused on the task at hand.