lemmynsfw has implemented (or intends to) an interesting compromise, in that you can only downvote posts on that instance’s communities that you’re already subscribed to. Ideally, this means that downvotes are for the quality of the individual post, rather than as a reaction to the type of content.