Something else to consider is Cloudflare tunnels. They are free and quite handy.
Essentially, it creates a secure wiregiard connection between you and cf so you don't need to open any ports or have a reverse proxy on your side. Then, cf becomes the end point and where dns points.
Cf essentially hosts your reverse proxy for you and you so all the config on their site once you get the tunnel setup. The Cloudflared docker is all that I had to set up.
Its essentially what you are doing with the vps, but purpose built and free.