I'm currently working on a variation of this, specifically for accessing/controlling smartphones. My hunch is that even though a hardware-based KVM approach was meant for remote manual control, it could also be extremely useful for automation (and specifically test automation). But the big question is if anyone would agree with me about that. Hope to find out soon enough...