Right. "Time only moves in one direction" is not saying much more than "our consciousness experience time moving in one direction". The very idea that time "moves" is entirely related to our vantage point. If our perception were not bound to time, then the nature of cause and effect might look completely different.