Devil's advocate, I don't think we should keep building more housing insofar as it encourages population growth (which it does). Like highways, there will always be barely enough, no matter how many lanes/houses we build.
But population growth is the overwhelming factor in all of our sustainability issues.
The reason there will never be enough lanes is not population growth. It's that we generally don't provide people with alternatives to driving, and adding more lanes just makes even more people have to drive, since things get even farther apart.
So in response to the rapidly rising prices, we should not build any housing because it doesn't matter? Surely there is still a positive benefit since there must be less than one person wanting to move in per new unit otherwise they would have already moved in?
But population growth is the overwhelming factor in all of our sustainability issues.