so after running fine for about 3 hours with no GPU, I've gone out and bought a new... power supply.
yeah I don't think it's the GPU. And a flakey PSU could easily fail with the GPU and not without, since the power usage is way lower without a GPU in there