It's not easy, and the value of an expert UX designer really shines when walking the tight-rope between informing and annoying your users.
Also, consider investing in reliable A/B testing infrastructure if you haven't already. One of the biggest mistakes I've seen is trying to grow a product while driving half-blind based on napkin sql queries as metrics. Understand who is using the site, how often, when they are experiencing errors, and which types of changes actually encourage growth KPIs - but be careful, loading up the site with 3rd party trackers and intrusive js will introduce bugs and kill site performance - another balancing act hehe.