Are you using Homebrew's `emacs-mac` (IIRC, the Homebrew packaging of "railwaycat Emacs", which you can also install directly)? It's holding up well on my M1.
Obviously, the other thing to say here is to share your emacs configuration, as is the tradition. But your call! :)