Yeah, for most of us. But that's the thing about the guy in Memento - he can chose what to think and "remember" in the future since he trusts his own handwriting and pretty much forgets everything else.
"However I would be happier if I didn't know it existed"
If you could chose to forget, you wouldn't know it existed, and thus be happier. Souds like the logical thing to do :)
Really this just highlights that "choosing" to believe or not believe is sort of a silly concept.