The rush to redefine a better Turing test seems pretty misguided in light of the fact that we all agree that "Eugene" in fact fails any reasonable interpretation of it, quite badly, and the real problem here is the credulousness or even outright lying of the people who ran the test.
A bot that could persistently convince a person of average intelligence that it was human across an extended period of time would still be quite the thing. A bot that could convince me that it was human would require someone to leap some pretty significant AI barriers that so far nobody has even come close to. It may not be the touchstone of "true AI" because that's a very slippery term, but it's a legitimate milestone, and the fact that it's 2014 and "Eugene" is still the best we have(give or take a bit) is evidence for the idea that it's a hard test, not evidence against!
It doesn't matter what test we use... credulous or deceptive people are still going to prematurely cry "success!". Twiddling with the test isn't solving the real problem here. (Again, as always, step one is solving the problem is identify the problem. It's often harder than it seems at first....)
A bot that could persistently convince a person of average intelligence that it was human across an extended period of time would still be quite the thing. A bot that could convince me that it was human would require someone to leap some pretty significant AI barriers that so far nobody has even come close to. It may not be the touchstone of "true AI" because that's a very slippery term, but it's a legitimate milestone, and the fact that it's 2014 and "Eugene" is still the best we have(give or take a bit) is evidence for the idea that it's a hard test, not evidence against!
It doesn't matter what test we use... credulous or deceptive people are still going to prematurely cry "success!". Twiddling with the test isn't solving the real problem here. (Again, as always, step one is solving the problem is identify the problem. It's often harder than it seems at first....)