If you keep building and prices go down, those actors leave the market with a loss in capital.
Building is a win win. Prices go down and rich people who have been fucking you lose money. They are only doing it because supply is constrained and it is east money.