The incoming president then says, no, no, please stay on until we have your replacement set up.

... which constitutes a rejection of the resignation. Later, when a replacement is confirmed, what happens if the offer to resign is not repeated? Do ambassadors get normal Civil Service protections?