"Goel plans to use Jill again in a class this fall, but will likely change its name so students have the challenge of guessing which teaching assistant isn't human."
This will be a fantastic Turing test, at least as far as basic question understanding and natural response formation.
"I am very busy, please stick to the course material."
I wonder if the professor has it configured to learn from the student's questions? Will the bot turn into a promiscuous neo-nazi a week into the class?
The software worked remarkably well in this instance because the system was well constrained, and the students weren't on the lookout for it. If they do start quizzing their new unseen TA (Dr Colin V Olutionalnet) on random trivia it could presumably deflect the query or have a few canards pre-programmed.
This will be a fantastic Turing test, at least as far as basic question understanding and natural response formation.