Isn’t this how it already works? I’ve had watch history off for a few years now and the only thing that influences my recommendations are new subscriptions; which I’m totally fine with. (I don’t thumbs up videos)
I might not want to watch everything on my home page but it’s very spot on for me.