It appears the situation isn't static, thanks for the link! It would have been interesting to see older versions of Chrome and Firefox tested too - I'm wondering now if my recollections are faulty.
This site simulates a slow download of a progressive JPEG so you can test how your browser renders them. The page is from 2007 so its claim that IE doesn't render them progressively appears to be out of date.
