I don't know how they store phone numbers, but hopefully not hashed since the search space is trivially tiny.

The usernames thing does not address any interesting concern. I don't care to show my friends who I chat with my name and phone. They already know these after all.

What I care about is not having to give Signal (the company) my phone number. That's not something they should have.