Garbage in, garbage out. The “math” doesn’t change that simple truism.
Also, the fact that chatGPT it’s prone to making shit up isn’t conjecture, it’s fact. It can be a super useful tool for some use cases, but getting medical advice? Yeah fuck no lol