Hah, neat. Had a similar idea long long ago. Wanted to run it against the show, Friends, to model the object interactions against text to speech results against a transcript. The idea was to create a speech to text slash plot generator using silly bayes stuff that latches onto accurate text to speech pairings over inaccurate pairings when compared against the transcript. Friends because it's such a popular show that has so much association and accessible transcripts.
I wish Friends was available dubbed in the language I'm learning (Hindi) - I know it well enough in English from repeated watching that I think it'd be the best thing I could do for my vocabulary and listening comprehension speed to watch it in Hindi.
There should be an app that pays people to dub popular shows in a broader way of language, charges viewers, and has some kind of sidebar or subtitle integration to hover/click and learn more, check what a word was and conjugation etc.
The focus on language learning would also allow the translators to make more appropriate choices for that use, whereas subtitles (and probably dubbing) for entertainment often has some variation that is confusing it to learn. I suppose that matters less if there's only one or the other, so no chance of conflict.
