I've paid attention over the last few years to what is being said about psilocybin in pop media. It seems that the problem isn't as you said but rather that it isn't being used in a clinical setting with a qualified therapist where a patient under the influence may break through barriers preventing recovery.