The big problem is transportation. Ideally we'd have lots more muxed-use walkable neighborhoods than we have. Roughly 50% of people want to live in walkable neighborhoods, but centralized planning has virtually banned this type of low-carbon living over the past 75 years.
Second, beef is proportionally MUCH worse than all other foods: we can't afford to leave a full 1/25th of our emissions on the table.
Third, you're ignoring land use, land degradation, water use, and negative health effects of beef production and consumption. To look solely at "US emissions" in a narrowly defined way misses many of the harms of beef.
Fourth, cows are mammalian species who endure great suffering and misery so that your mere 3% of emissions can lead to a relatively smaller number of calories consumed. Is it worth it to cause suffering on a mass scale for the least healthy, most emitting food source?
When it comes to climate (the topic here), banning beef is being used by climate inactivists as a cultural wedge issue to stop climate action. Michael Mann, a vegan, has strong opinions on not harping about beef out if its true importance in the climate policy fight:
https://theclimatepod.libsyn.com/dr-michael-mann-on-the-new-...
As for the non-climate concerns for beef, sure, but that's not the topic here.