If your use case does not follow that pattern and you really care about performance, you have to pull out something like inline assembly.
Consider software like ffmpeg which have to do this for the sake of performance.