For CPU, there is no another processor that can run all the abstraction software so it has to be done in hardware or in software in a way that is transparent to user (microcode, Transmeta-style JIT...).

That's an implementation detail: the manufacturer supplies the system software, and by this argument you're not supposed to care where it runs.