I suspect we're going to see more and more specialized hardware in this area before that happens, but what benefit exactly is there to having them on Linux anyway?

Most of that industry is highly opposed to being open in any sensible definition of that word, so what do they bring exactly?