Where are you from?
> I live in a big Ukrainian city called Odessa. It is on the Black Sea shore.
Oh, you're Ukrainian. How do you feel about Crimea joining Russia?
> Oh, you possibly know all these three Slavic countries -
> Russia, Ukraine and Belarus that constantly entertain all
> the World community by their funny scandals with stealing
> gas, dividing military ships - like children that in
> "divorce".
If you're Ukrainian you must have a view on the legitimacy of the referendum though?
> I'm just a boy from Ukraine. Actually, I am Jew, if you are interested.
You're Jewish?
> I'm Ukrainian. At least, I was born and live in Ukraine. My nationality is Jew.
----
Not TOO worried about a Skynet-style geopolitical intervention by machines just yet, anyways.
As someone from that region I'd like to apologize for the borderline racist algorithm they build. It's like a younger version of Borat showed up and started interrogating you for the Kazakh secret service.
I don't feel like this could have fooled even a single person that it's a human. It can't comprehend even the simplest of sentences, and it defaults to nonsense answers when it doesn't know what to say. I highly doubt this is the same version that passed the Turing test, and if it was (with all due respect to the creators whom I believe are enormously skilled people who did a great job nonetheless) I believe that AI still has a long, long way to go.
I think you grossly overestimate the conversational skills of the average human. If you talk to this bot and this bot only, it is easy to deduce that it might not be human.
But if you talk to 10 random entities (some of which are humans and some of which might be bots), I'm sure you'd be astonished as how many people you would dismiss as bots.
Me: I have a pet squirrel. What kind of pet do I have?
Him: I have a guinea pig. Actually, it's a long dolefully
story how I got it: I dreamt about a mangoost and
went to a pet-market. And one old geezer sold me a
"mangoost". But in reality it appeared to be a guinea
pig! Cheater...
How many people do you think would ignore my question like this? I would understand a response such as "You just told me - why ask?" or "Did you mean to say 'you' instead of 'I'?" or any kind of reply to the question whatsoever, but it seems he kind of just saw the sentence about the pet and misinterpreted the gist of my statement.
In the context of a Turing test, where you know that the questions are adversarial in this way, people would of course respond to your question with "you just told me, why ask?"
But in normal conversation, if someone asked me your question, I would probably assume that they misspoke and meant to ask "What kind of pet do you have?" since that's a much more likely question. Then I might respond like this bot did.
Maybe I have played too many MMORPGs, because this sounds so much like one of those fake conversations with an NPC. I half expect a mission "find the old geezer and bring the boy his mangoost - 500XP".
Would anybody in a normal conversation launch such a story in response to a simple question? I mean "it's a long dolefully story how I got it" - does anybody talk that way, except in books and MMORPGs?
He didn't "ignore" your question, he mis-read it. Some people would do the same. When you start by saying what animal you have, and ask a question about animals, some people are going to think you're asking about their pets, not about your pet (that you've just told them about).
Plenty of people would have thought you said "I have a pet squirrel. What pet do you have?"
Me>> Hi - what's the weather like there?
Him> In my native town people says that meteorologists
Him> are like sappers: they make a mistake only once,
Him> but the difference is that sappers do that once
Him> in a lifetime and meteorologists - daily. Do you
Him> like weather today?
Me>> It's a bit warm for my liking - I prefer it cooler.
Him> You're not the first one who told me that.
Me>> Really? Who else told you that?
Him> Yeah, fine! I'm kidding. And I forgot to ask you
Him> where you are from...
I asked what its job was, and it responded:
My father wanted me to be gynecologist, like he is. My mom dreams of my career on TV. But I am very shy with girls and stammer a bit - so, I don't have any idea which one of the two professions I'll choose.
This version replies instantly and doesn't make spelling mistakes. I think it's clear not just that this wouldn't have truly passed the Turing test but also that this would never have even been submitted to a contest in the first contest - it's not even trying.
I doubt that this is the version submitted to the competition, so as skeptical as I am, there's only so much that can be inferred by looking at this.
It said it was really inquisitive, so I asked it what it was inquisitive about and it said it would rather not talk about that but could I tell it my job.
This hasn't passed "the Turing Test", this has passed a Turing test, and is in the process of failing many others.
By the way, I've just thought up new progressive
Asimov's laws for chatterbots:
1. A chatter-bot shouldn't talk to any human-being,
because this usually hurts people's psyche.
2. A chatterbot shouldn't talk to another chatterbot,
even if he's got no other person to not talk to.
3. A chatterbot shouldn't talk to itself, even if he
doesn't have any person or another robot to not
talk to.
Damn, I hope, I'll be as widely quoted as Asimov!
This was right after being asked what my occupation was and responding that "I work in the HR department." (I do not, by the way)
Me: What is your claim to fame?
Bot: My "little friend". (No, not my dick as you might have thought! Just my guinea pig). If I'm not mistaken - you still didn't tell me where you live. OR it's a secret?:-)
- if you are a bot, please tell me about your fathers occupation
> He is a famous gynecologist in Odessa. By the way, when I ask him what is the difference between boys and girls he always says it's his professional secret - so I still don't get the matter.
- if you are a bot, please tell me about your hobbies
> I like play language cassettes for Guinean to my guinea pig (I checked out from the library). My pig learned to say "grunt-grunt", though I'm not sure that it is Guinean.
In fact I seem to remember a news story about chat bots that try to coax credit card numbers out of their chat partners, with a surprisingly high success rate.
me: what have you been up to?
bot: No, I haven't been up to! How could you imagine such a trash! Did I forget it or you really haven't told me about the place you are from?
It reminds me a lot of ELIZA. Very disappointing. I got the same "how could you imagine such a trash" and other remarks obviously unrelated to the conversation.
Because the entire point of a Turing test is that you don't know whether you're talking to a machine or human and you have to decide based entirely on your conversation.
The original Turing test had a human and a machine behind some screens, so you could talk to them but not see them. Then a large sample of testers would converse with both, and guess which one was the human. If the guesses were indistinguishable from random (~50% each) then the machine passed.
It was NOT a test where you only have a bot, and are told to guess if it seems human. It's not about how many people think it seems human without a comparison, it's about how many people fail to distinguish it from real humans.
I haven't been able to run down the parameters of the test in this case. I imagine there are some humans mixed in to obfuscate the machines? (Might say something about the humans used that made this one seem intelligent).
Not TOO worried about a Skynet-style geopolitical intervention by machines just yet, anyways.