I consistently find that people who are unhappy/unsuccessful and also identify as "smart" are generally very good at rationalizing why things don't work out for them in a manner that protects their ego.
I think those two can ironically often go hand-in-hand.
You over value your self-importance which gives you ego/arrogance. Yet at the same time that self-importance with self-criticism leads to low self-esteem.
I think this is something that I often demonstrate. I feel the need to prove that I'm smart (ego), and I have very high standards for myself (low self-esteem, but it's getting better).
I'm not necessarily saying this is you, just that those two traits aren't mutually exclusive.