In theory, I absolutely agree; however, in reality I disagree unless you can show some data that indicates money being spent this way is more ethical than inhibition. Considering the competition for apparel, ample supply of workers, and what actually goes on in factories, if I have the option I will buy from a place that is more likely to uphold human rights.
If you would like a glimpse into my position and haven't already watched the PBS documentary China Blue, I recommend it.
I think there are opportunities for a company to do an incredible amount of good in other countries as well, like we hope to do locally. But at our stage, we don't have the leverage to vet or monitor contractors in a way we'd find acceptable. We aspire someday to make our apparel available outside the United States with manufacturing in the respective areas! We don't think transporting inputs/outputs across the globe multiple times is fair to our environment.
If you would like a glimpse into my position and haven't already watched the PBS documentary China Blue, I recommend it.