Isn't that correct though? The light gets redshifted away from the visible spectrum quite fast and after not very long there's nothing to see. Unlike when going forward where there's plenty of extreme red light that can be blueshifted into the visible spectrum (and eventually past it).