Eli M. Dow · In this version a jury asks questions of a person and a computer through a teletype interface, and the role of the computer attempts to convince

» Turing Test

Eli M. Dow <[email protected]:>

© 2011 IBM Corporation

Overview:

» Turing Test Overview» Watson and the Test» Questions


What is the Turing Test?

» About Dr. Turing» The Imitation Game» The Turing Test


In order to determine if Watson might pass the Turing Test, we should first define what it is...


The test was first proposed by the very famous computer scientist,

Alan Turing Ph.D.


•


Turing's Contributions:

Turing Machine Definition

The Church-Turing Thesis

The Halting Problem

The Turing Test


Turing Machine Definition:

- A Turing machine is a theoretical device that manipulates symbols on a strip of tape according to a table of rules. This computer can provably compute anything that any modern computer can do with a sufficiently fast tape reader.


The Church-Turing Thesis

Stated Informally – thesis states that if some method (algorithm) exists to carry

out a calculation, then the same calculation can also be carried out by a

Turing machine (as well as by a recursively-definable function, and by a λ-

function).


The Halting Problem

- Given a description of a computer program, decide whether the program

finishes running or continues to run forever. This is equivalent to the problem

of deciding, given a program and an input, whether the program will eventually halt

when run with that input, or will run forever.


The Turing Test

During his later years, Turing examined problems outside of pure mathematics and

moved on to more abstract research.

Among that work, he addressed the problem of artificial intelligence and proposed an

experiment in a Published in a Paper Entitled: "Computing machinery and intelligence"

(Mind, October 1950)


This proposed experiment became known as the Turing test.

It was the first legitimate attempt to define a standard for a machine to be called

"intelligent".


Idea - A computer could be said to "think" if a human interrogator could not tell it apart,

through conversation, from a human being.


Provocative Indeed


Forward Thinking In the Age of the Univac...


“Instead of trying to produce a programme to simulate the adult mind, why not rather try to produce one which simulates the child's? If this were then subjected to an appropriate course of education one would obtain the adult brain.” - ALAN TURING, "Computing Machinery and Intelligence”


"The cocktail party has a simple function in modern society. It's basic purpose is to pay off social debts." -


The Turing Imitation Game

• 1 Host • 2 Contestants• Fabulous Cash Prizes*


The Imitation Game:We need a Judge/Host


The Imitation Game:We need a Judge/Host


The Imitation Game:Male Contestant Y


The Imitation Game:Female Contestant X


Fabulous Cash Prizes*!

[*] The IBM lawyers would like me to state that there is no actual fabulous cash prize for winning the imitation game or attending this talk.



The Curtain

The interviewer asks questions of X and Y through an intermediary (so that no auditory or vocal judgment can be made on the questioned).



The Imitation Game is not the same as what is now known as the Turing Test. The revised version of the Turing Test sets Y as a computer and X as a woman. Again, A and B must answer the interviewer’s as if they were both women.


The 3rd & Final modification to the Imitation Game (1952)

In this version a jury asks questions of a person and a computer through a teletype interface, and the role of the computer attempts to convince a significant proportion of the jury believe that said machine is really a human.


Turing believed that by approximately the year 2000:

“it will be possible to programme computers, with a storage capacity of

about 109, to make them play the imitation game so well that an average interrogator will not have more than 70

percent chance of making the right identification after five minutes of

questioning.”


The Turing Test is the Standard Litmus Test for referring to a machine as

“Intelligent”


•Watson and the Turing Test

» Shortcomings of the Turing Test Definition» How Watson Relates to the Turing Test


“There are no simple language tricks that would enable a computer to

pass a well-designed Turing test. A computer would need to actually

master human levels of understanding to pass this threshold.” - Ray Kurzweil


J: How do you define life?A: Life is the opposite of death.

J: So death is the absence of life?A: Take it easy. I try not to think about such things.

J: Why not?A: Ambiguous.

J: Yes!J: You seem fun.A: You think I am fun.A: : -) Awesome.

J: How old are you?A: I am 9 years old.

J: Nine? I don't believe you :).A: : -) I don't have any reason to deceive you.

J: Yes, you do, you're a woman.


Undefined Questions About the Turing Test:

Does all of human knowledge exist in language? How qualified does the human judge need to be? How do you interact with the participants? How long should the sessions be? What does a significant portion of the Jury mean?


Does all of human knowledge exist in language?

Is mastery over linguistics sufficient to describe intelligence?


How qualified does the judge need to be?

How many judges should there be?

What constitutes a significant portion of convinced judges?


How does a judge interact with the participants?


What about a Jeopardy variation of the Imitation Game?

Rather than have a computer attempt to convince a substantial portion of a panel of judges that it is human by answering any

question conversationally, we can restrict the questions have to be similar to what you would

expect on the quiz TV show Jeopardy!


Could Watson Pass our Jeopardy Imitation

Game?


Does Watson pass the Turing Test?




Concluding Remarks


Questions ?

Thank You


IBM Watson: Watson and the Turing Test

Eli M. Dow <[email protected]>

Eli M. Dow · In this version a jury asks questions of a person and a computer through a teletype interface, and the role of the computer attempts to convince

Documents