Since you're registered on lemmy.ml, and thus probably viewing everything through that, I think you only see the subscribers on lemmy.ml. Most people and comms are now at lemmy.world.
E.g. "my" !starwarsmemes comm shows 2.52k subs (up from ~800 2 days ago), but through lemmy.ml it only shows... 38.