I totally get that! I think the specific answer they give in the episode is that he “played” at the edge of the universe by trying to hold off the Not Things with vampire rules. I’m not sure of the mechanics of it, but apparently playing at the edge of the universe lets in the Toymaker.
I don’t find this answer very satisfying myself, however, but I can’t seem to find a better one.