That is mostly a political decision. Remember that it is the Fed that controls the interest rates, especially for short-term lending.
For long-term lending, as long as the Fed doesn't change its stance, the rates will only go up if the economy recovers. If the economy recovers, government won't have to borrow that much anymore.
And if you were still unhappy about the interest payment of government, the government could just change the way its monetary policy is implemented and push down the yields of long-term bonds as well. After all, the government administrates the US$ monetary system. Operationally, they would just instruct the Fed to target long-term yields as well, and then the Fed would change them in the same way that it changes short-term yields (by doing open market operations).
For long-term lending, as long as the Fed doesn't change its stance, the rates will only go up if the economy recovers. If the economy recovers, government won't have to borrow that much anymore.
And if you were still unhappy about the interest payment of government, the government could just change the way its monetary policy is implemented and push down the yields of long-term bonds as well. After all, the government administrates the US$ monetary system. Operationally, they would just instruct the Fed to target long-term yields as well, and then the Fed would change them in the same way that it changes short-term yields (by doing open market operations).