I had this issue a few years ago with certain applications and came to find out that it had to do specifically with them using GTK. I googled for it and found the fix, and after all the same apps started practically instantly. Could this be what you're running into?
(I haven't used ghostty so I wouldn't know whether it's actually fast to start up, but what you wrote reminded me about this particular issue.)