Hitler had absolutely no chance of long-term victory against UK and USSR, and Swiss also saved untold amounts of people who otherwise would have nowhere to go. They turned away plenty of refugees (IMO needlessly), but they saved plenty who otherwise would have no hope. And while they could make a stand, ultimately they wouldn't make that much on an offensive. Seriously, they were surrounded, the most they could do was make transport expensive. Which they did anyway, just without sacrificing a lot of people for some pompous reasons.
This is not to say all they did was right, and the fact that they still keep making and selling weapons is not exactly great as well, and a lot of Swiss were unhappy with sheltering any refugees, but the general idea of keeping neutrality and protecting as much as they could — which was, basically, people already there — was good. Remember, also, that Switzerland helped many troubled countries in later years.
This is not to say all they did was right, and the fact that they still keep making and selling weapons is not exactly great as well, and a lot of Swiss were unhappy with sheltering any refugees, but the general idea of keeping neutrality and protecting as much as they could — which was, basically, people already there — was good. Remember, also, that Switzerland helped many troubled countries in later years.