No, you are correct. On any sort of low bandwidth or high latency connection, your remote X experience will be terrible.