It’s possible he did and just cared more about how it affected him than how it affected his family.
I’ll be dealing with my dad’s wife in the same way inside of 15 years, and it’s not because he can’t see how she is. He just likes her money more than he likes his own family, I guess.