Slack isn't a bunch of chat rooms, it's a database disguised as a bunch of chat rooms. I've never had a problem pulling up some random conversation from three years ago as long as I remember the general topic.

In that regard it's no different than using email, everything is indexed and you're just searching a different database.