Sometimes. A lot of SF assumes FTL travel, which we have no reason to think will ever be possible (and even less possible when you realize they also are assuming to time dilation effects).