Proto-Baltic and Proto-Slavic have separated much, much earlier than various Slavic language families. Balto-Slavic is typically dated to somewhere between 3000-1000 BCE. On the other hand, the Common Slavic period is 600-1000 CE (and mutual intelligibility went on even longer). The degree of similarity between the languages is simply not comparable.