Yep, that's what I would go with. I can't see a use case for a comma after the "but" in British nor American English.
> I guess people feel like they would speak the sentence with a pause after the conjunction
Even this feels off to me when I read up to the "but" and then pause (as opposed to pausing on the "you").