The big problem is transportation. Ideally we'd have lots more muxed-use walkable neighborhoods than we have. Roughly 50% of people want to live in walkable neighborhoods, but centralized planning has virtually banned this type of low-carbon living over the past 75 years.
Second, beef is proportionally MUCH worse than all other foods: we can't afford to leave a full 1/25th of our emissions on the table.
Third, you're ignoring land use, land degradation, water use, and negative health effects of beef production and consumption. To look solely at "US emissions" in a narrowly defined way misses many of the harms of beef.
Fourth, cows are mammalian species who endure great suffering and misery so that your mere 3% of emissions can lead to a relatively smaller number of calories consumed. Is it worth it to cause suffering on a mass scale for the least healthy, most emitting food source?