IDK chief. It seems like one of those things that are hard to do in theory as you said, but relatively easy in practice.
I mean just about any human who has played a bit with ChatGPT nowadays is able to identify ChatGPT generated paragraphs within a few words. I don’t suppose it would be much harder for a machine.