No, because Lemmy doesn’t support Oauth2 yet. And even if it would support it, at most it could be a “login with lemmy.ml” or similar instance specific button as the protocol requires a specific endpoint.
Edit: see other comment in this thread. With the OIDC discovery extension to OAuth2 it might be possible, but I haven’t seen that feature being used this way in the wild yet.