There is an extension called LibRedirect that does this. It’s customisable, as in, we can set if we want to redirect to piped or invidious, and which specific instances to use. Not only just YouTube but other services like GitHub to Gothub, Twitter to Nitter, reddit to libreddit etc. The default settings are already great.