He has a lifetime appointment as a judge. Only 9 judges have ever been removed in the history of the country. It isn't likely that he will be removed. They can just appeal his decisions.
His appellate court has jurisdiction over the federal courts in Wisconsin, Illinois, and Indiana. The chief district judge assigns cases. The chief judge designation is based upon seniority, and all of the district judges have lifetime appointment as well.
