I've done that too, in the same situation. But I think it may backfire. Some investors may be nostalgic for their days in a startup. Others are still looking for that "startup edge" which differentiates from stagnant corporations.

If your clothing says "corporate", you may send the wrong message and drain some interest.

Obviously this varies by area and industry.