But I can't figure out how to replace GSuite.
And I don't think it's for a lack of skills, I know my way around a Linux box - it's just that I save so much time. I'll occasionally build small projects in a VPS (sometimes cramming the db in there too!) but I don't feel I can do it for other more serious work projects.
Hetzner has basic load-balancing and security around the VPS and that's it, OVH has a bit more but it all looks quite green.
I had the same worries and then we moved to OVH and Hetzner and had no issues.
AWS RDS is about 10x more expensive than bare metal with maybe 1/4th the disk performance.
Regarding operations I simply setup a primary and read replica together with a PGBackRest continuous archiving and backup solution to a S3 compatible storage service.
Has worked like a charm in the last two years and recreating the database is a breeze.
Our database is ~8 TB large.