Probably not. While any additional factor makes authentication more secure, a voice line allows anyone nearby (or farther away with a unidirectional mic) to compromise that factor. Further, the false negative rate would concern me. What is wrong with TOTP 2-factor?
Losing your phone effectively locks you out of all your 2-factor accounts. If it's stolen by the wrong people and unlocked/unencrypted, they'll get access to pretty much all of your accounts through a password reset. I'd say that's pretty bad and we have yet to find a good, secure way to authenticate users.
