It doesn't really matter much if you have a million dollars or a million dollar house (+/- liquidity of assets but this is not really important for the discussion).

>>Gambling is seen as immoral because it's about extending your exchange value capabilities

Why would extending your exchange value capabilities would be seen as immoral? It sounds good to me. I think you are missing the point.