As someone who just bought a house this year. I think your case is an outlier. My wife and I make decent money, and didn’t want anything too big. But it still took 3+ years of saving and living in a sketchy part of town just to get a down payment. As rent was increasing and the market was increasing. It would be entirely impossible for someone who is barely scraping by to afford a down payment on a house in a metro or suburb.