I built a small chrome extension that provides this functionality. Next to your name, the extension adds a mail icon that lights up whenever someone replies to one of your messages. It then takes you to a 'cleaned up' threads page that only shows new messages. Doesn't work for submissions though.
https://chrome.google.com/webstore/detail/notifications-for-...