C463 / B551 Artificial Intelligence Dana Vrajitoru Introduction.

C463 / B551C463 / B551Artificial IntelligenceArtificial Intelligence

Dana VrajitoruDana Vrajitoru

IntroductionIntroduction

Artificial Intelligence – D. VrajitoruArtificial Intelligence – D. Vrajitoru

Course OutlineCourse Outline

Introduction, definition, philosophyIntroduction, definition, philosophyIntelligent agentsIntelligent agentsLogic, knowledge representation, reasoning Logic, knowledge representation, reasoning Fuzzy logic, probabilistic reasoningFuzzy logic, probabilistic reasoningPlanning, game playing, decision-makingPlanning, game playing, decision-makingExpert systemsExpert systemsMachine learningMachine learningGenetic algorithms, neural networks, SOMGenetic algorithms, neural networks, SOMElements of natural language processing.Elements of natural language processing.


Artificial IntelligenceArtificial Intelligence

DefinitionDefinition. The science of developing methods to . The science of developing methods to solve problems usually associated with human solve problems usually associated with human intelligence.intelligence.

Alternate definitions: Alternate definitions: building intelligent entities or agents;building intelligent entities or agents; making computers think or behave like humansmaking computers think or behave like humans studying the human thinking through computational studying the human thinking through computational

models;models; generating intelligent behavior, reasoning, learning.generating intelligent behavior, reasoning, learning.


QuestionsQuestions

What do we call intelligence?What do we call intelligence?

Examples of intelligent tasks.Examples of intelligent tasks.

Can an artificial being ever be considered Can an artificial being ever be considered "alive"? What does it mean to be "alive"?"alive"? What does it mean to be "alive"?


Natural IntelligenceNatural IntelligenceDefinition. Definition. IntelligenceIntelligence – inter ligare (Latin) – the capacity – inter ligare (Latin) – the capacity of creating connections between notions.of creating connections between notions.Wikipedia: the ability to solve problems. Wikipedia: the ability to solve problems. WordNet: the ability to comprehend; to understand and WordNet: the ability to comprehend; to understand and profit from experience. profit from experience. Complex use of creativity, talent, imagination.Complex use of creativity, talent, imagination.Biology - Intelligence is the ability to adapt to new Biology - Intelligence is the ability to adapt to new conditions and to successfully cope with life situations. conditions and to successfully cope with life situations. Psychology - a general term encompassing various Psychology - a general term encompassing various mental abilities, including the ability to remember and mental abilities, including the ability to remember and use what one has learned, in order to solve problems, use what one has learned, in order to solve problems, adapt to new situations, and understand and manipulate adapt to new situations, and understand and manipulate one’s reality. one’s reality. Nonlinear, non-predictable behavior.Nonlinear, non-predictable behavior.


Visions of AIVisions of AI

Systems that think like humans.Systems that think like humans.Systems that act like humans.Systems that act like humans.Systems that think rationally.Systems that think rationally.Systems that act rationally.Systems that act rationally.

A distinction between being intelligent and A distinction between being intelligent and acting intelligently, and being like a acting intelligently, and being like a human, or solving similar problems (not human, or solving similar problems (not necessarily the same way).necessarily the same way).


Thinking HumanlyThinking Humanly

Cognitive science: modeling the processes of Cognitive science: modeling the processes of human thought.human thought.Through a set of experiments and computational Through a set of experiments and computational models, trying to build good explanations of models, trying to build good explanations of what we do when we solve a particular task.what we do when we solve a particular task.Relevance to AI: to solve a problem that humans Relevance to AI: to solve a problem that humans (or other living being) are capable of, it's good to (or other living being) are capable of, it's good to know how we go about solving it.know how we go about solving it.Early approaches tried to solve any problem Early approaches tried to solve any problem exactly the way a human would do. Now we exactly the way a human would do. Now we know that it's not the best approach.know that it's not the best approach.


Acting HumanlyActing Humanly

How do you distinguish intelligent behavior from How do you distinguish intelligent behavior from intelligence?intelligence?Turing testTuring test, by A. Turing, 1950: determining if a , by A. Turing, 1950: determining if a program qualifies as artificially intelligent by program qualifies as artificially intelligent by subjecting it to an interrogation along with a subjecting it to an interrogation along with a human counterpart. human counterpart. The program passes the test if a human judge The program passes the test if a human judge cannot distinguish between the answers of the cannot distinguish between the answers of the program and the answers of the human subject.program and the answers of the human subject.It hasn't been passed yet.It hasn't been passed yet.http://www.loebner.net/Prizef/loebner-prize.htmlhttp://www.loebner.net/Prizef/loebner-prize.html


Thinking RationallyThinking Rationally

Systems capable of reasoning, capable of Systems capable of reasoning, capable of making logical deductions from a knowledge making logical deductions from a knowledge base.base.This requires some capacity to make logical This requires some capacity to make logical inferences, like "inferences, like "All humans are mortal; Socrates All humans are mortal; Socrates is a human; thus Socrates is mortalis a human; thus Socrates is mortal".".Good newsGood news: formal logic is easy to express as a : formal logic is easy to express as a program and its rules are clear.program and its rules are clear.Bad newsBad news: G: Göödel's incompleteness theorem and del's incompleteness theorem and SAT is NP-Complete.SAT is NP-Complete.


Gödel's TheoremGödel's Theorem

At some point it was believed that one could At some point it was believed that one could prove anything using only logic, building a formal prove anything using only logic, building a formal system to describe the knowledge - system to describe the knowledge - HilbertHilbert. . K. K. GödelGödel proved in his proved in his Incompleteness TheoremIncompleteness Theorem that within any formal system, some statements that within any formal system, some statements that are true could not be proven using only that are true could not be proven using only formal logic based on the axioms of that system.formal logic based on the axioms of that system.What this meansWhat this means: logic is a powerful and : logic is a powerful and necessary tool in automatic reasoning, but to necessary tool in automatic reasoning, but to make useful deductions one requires domain-make useful deductions one requires domain-specific knowledge.specific knowledge.


SAT – NP-CompleteSAT – NP-Complete

SATSAT – satisfiability problem. Given a logical – satisfiability problem. Given a logical formula involving a set of Boolean variables, is formula involving a set of Boolean variables, is there a set of values for these variables such there a set of values for these variables such that the formula is true?that the formula is true?Relevance to AI: the problem of deciding if Relevance to AI: the problem of deciding if something is true in a given system (making a something is true in a given system (making a deduction) comes down to solving a particular deduction) comes down to solving a particular SAT problem.SAT problem.NP-completeNP-complete: there is no known polynomial : there is no known polynomial algorithm to solve this problem, but if we find algorithm to solve this problem, but if we find one for it, then we can solve any other NP one for it, then we can solve any other NP problem. For now a guaranteed solution is problem. For now a guaranteed solution is exponentialexponential..


Acting RationallyActing Rationally

Many AI applications adopt the intelligent Many AI applications adopt the intelligent agentagent approach.approach.An An agentagent is an entity capable of generating is an entity capable of generating action.action.In AI a rational agent must be autonomous, In AI a rational agent must be autonomous, capable of perceiving its environment, capable of perceiving its environment, adaptable, with a given goal.adaptable, with a given goal.Most often the agents are small pieces of code Most often the agents are small pieces of code with a specific proficiency. The problem is solved with a specific proficiency. The problem is solved by combining the skills of several agents.by combining the skills of several agents.


History of AIHistory of AI

19431943 – W. McCulloch and W. Pitts designed the – W. McCulloch and W. Pitts designed the first neural network. M. Minsky and D. Edmonds first neural network. M. Minsky and D. Edmonds built the first one in 1951 at Princeton.built the first one in 1951 at Princeton.19501950 – A. Turing, "Computing Machinery and – A. Turing, "Computing Machinery and Intelligence".Intelligence".19561956 – J. McCarthy organized a workshop at – J. McCarthy organized a workshop at Darmouth where the name of AI was officially Darmouth where the name of AI was officially adopted for the field.adopted for the field.Early successes: the General Problem Solver Early successes: the General Problem Solver (puzzles), Geometry Theorem Prover, Samuel's (puzzles), Geometry Theorem Prover, Samuel's checkers player.checkers player.19581958 – McCarthy invented Lisp. – McCarthy invented Lisp.



The early systems were successful on small The early systems were successful on small problems but failed on larger ones.problems but failed on larger ones.19581958 – Friedberg's machine evolution (now – Friedberg's machine evolution (now better known as hill-climbing) using mutations; it better known as hill-climbing) using mutations; it failed to find good solutions.failed to find good solutions.19661966 – a commission reports on the failing of – a commission reports on the failing of machine translation and all funding to such machine translation and all funding to such projects is ceased.projects is ceased.19691969 – Minsky and Papert, Perceptrons, proved – Minsky and Papert, Perceptrons, proved that they could learn anything they could that they could learn anything they could represent, but there was not much they could represent, but there was not much they could represent.represent.



Knowledge-based systems – that contain Knowledge-based systems – that contain domain-specific knowledge giving them more domain-specific knowledge giving them more problem-solving power – problem-solving power – Expert SystemsExpert Systems. The . The industry adopted them on a relatively large industry adopted them on a relatively large scale, but many such projects failed.scale, but many such projects failed.

More recent developments combine AI methods More recent developments combine AI methods with strategies from other fields.with strategies from other fields.

Although the initial ambition of AI seems a Although the initial ambition of AI seems a distant goal at most, many methods have been distant goal at most, many methods have been developed that are used in most areas of CS.developed that are used in most areas of CS.

Successes in AISuccesses in AI

1975 – Meta-Dendral learning program finds new rules in 1975 – Meta-Dendral learning program finds new rules in spectral chemistry.spectral chemistry.

1978 – Herb Simon wins the Nobel Prize in Economics 1978 – Herb Simon wins the Nobel Prize in Economics for his theory of bounded rationality.for his theory of bounded rationality.

1979 - The Stanford Cart, built by Hans Moravec, the 1979 - The Stanford Cart, built by Hans Moravec, the first computer-controlled autonomous vehicle.first computer-controlled autonomous vehicle.

80s – neural networks with backpropagation algorithm 80s – neural networks with backpropagation algorithm become popular, evolutionary computationbecome popular, evolutionary computation

1997 – Deep Blue beats G. Kasparov, first Robo-Cup.1997 – Deep Blue beats G. Kasparov, first Robo-Cup.

2000 – Interactive robots commercially available, Kismet 2000 – Interactive robots commercially available, Kismet (MIT), robots used for real applications.(MIT), robots used for real applications.



Related FieldsRelated Fields

Philosophy – knowledge, mind, logicPhilosophy – knowledge, mind, logicMathematics - formal rules, logic, probability, Mathematics - formal rules, logic, probability, algorithmsalgorithmsEconomics – decision making, maximizing the Economics – decision making, maximizing the outcome, game theoryoutcome, game theoryNeuroscience – understanding how the brain Neuroscience – understanding how the brain worksworksPsychology – How do animals and humans think Psychology – How do animals and humans think and act?and act?Cybernetics – control theoryCybernetics – control theoryLinguistics – understanding the natural languageLinguistics – understanding the natural language


Main Areas of AIMain Areas of AI

Autonomous planning and schedulingAutonomous planning and scheduling

Decision makingDecision making

Machine learning, adaptive methodsMachine learning, adaptive methods

Biologically inspired algorithmsBiologically inspired algorithms

Game playingGame playing

Autonomous control, roboticsAutonomous control, robotics

Natural language processingNatural language processing

Relevant PublicationsRelevant Publications

Machine Learning – journal, Springer.– journal, Springer.

ACM SIGART special interest group, SIGEVO.ACM SIGART special interest group, SIGEVO.

AAAI society, annual conference, journal.AAAI society, annual conference, journal.

International Joint Conference on Artificial International Joint Conference on Artificial Intelligence (IJ-CAI), bi-annual.Intelligence (IJ-CAI), bi-annual.

GECCO – SIGEVO conference on evolutionary GECCO – SIGEVO conference on evolutionary computation.computation.

IEEE Transactions on Pattern Analysis and Machine Intelligence


C463 / B551 Artificial Intelligence Dana Vrajitoru Introduction.

Documents

human intelligence

biology intelligence

intelligent behavior

human thinking

intelligent entities

human judge

human counterpart

human subject