People who have so much in assets that they can live (and support their family) with the interest they earn on those assets, and by a huge margin, not just comfortably retired people. Those are the people who get richer, at the expense of your kids. Inflationary housing expenses are a drop in the bucket when someone's assets are in the billions.

  I have a family of five. No matter how much my home value increases or how well the market does, I still need to pay to live.

Not to mention inflation increases the value of your house and your property tax bill gets higher. This is true in California.

This is true almost everywhere else but California because of prop 13. Your assessed value can only rise by at most 2% a year.