USSR constitution did allow such unilateral exit declarations.

Of course, USSR constitution declared many things that were far from truth. But ultimately words on paper do make a difference, even in totalitarian regimes.