3. Course Learning Outcomes
At the end of this course:
ď Knowledge and understanding
You should have a knowledge and understanding of the basic concepts of Artificial
Intelligence including Search, Game Playing, KBS (including Uncertainty), Planning
and Machine Learning.
ď Intellectual skills
You should be able to use this knowledge and understanding of appropriate
principles and guidelines to synthesise solutions to tasks in AI and to critically
evaluate alternatives.
ď Practical skills
You should be able to use a well known language (Python) and to construct simple
AI systems.
ď Transferable Skills
You should be able to solve problems and evaluate outcomes and alternatives
4. Attendance
You are expected to attend all the lectures. The lecture notes (see below) cover all the topics
in the course, but these notes are concise, and do not contain much in the way of
discussion, motivation or examples. The lectures will consist of slides (Powerpoint ),
spoken material, and additional examples given on the whiteboard. In order to
understand the subject and the reasons for studying the material, you will need to attend
the lectures and take notes to supplement lecture slides. This is your responsibility. If
there is anything you do not understand during the lectures, then ask, either during or
after the lecture. If the lectures are covering the material too quickly, then say so. If there
is anything you do not understand in the slides, then ask.
In addition you are expected to supplement the lecture material by reading around the
subject; particularly the course text.
Must use text book and references.
6. What is Artificial Intelligence ?
ď making computers that think?
ď the automation of activities we associate with human thinking, like
decision making, learning ... ?
ď the art of creating machines that perform functions that require
intelligence when performed by people ?
ď the study of mental faculties through the use of computational models ?
7. What is Artificial Intelligence ?
ď the study of computations that make it possible to perceive, reason
and act ?
ď a field of study that seeks to explain and emulate intelligent
behaviour in terms of computational processes ?
ď a branch of computer science that is concerned with the
automation of intelligent behaviour ?
ď anything in Computing Science that we don't yet know how to do
properly ? (!)
8. Overview of Artificial Intelligence
ď Artificial
ď Produced by human art or effort, rather than originating
naturally.
ď Intelligence
ď is the ability to acquire knowledge and use it"
[Pigford and Baur]
ď So AI was defined as:
ď AI is the study of ideas that enable computers to be
intelligent.
ď AI is the part of computer science concerned with
design of computer systems that exhibit human
intelligence(From the Concise Oxford Dictionary)
9. Overview of Artificial Intelligence
ď What is AI ?
ď Artificial intelligence is the study of how to
make computers do things which, at the
moment people do better.
ď Some definitions of artificial intelligence,
organized into four categories
10. What is Artificial Intelligence ?
Definition -1
Systems that act
rationally
Systems that think
like humans
Systems that think
rationally
Systems that act
like humans
THOUGHT
BEHAVIOUR
HUMAN RATIONAL
1
2 3
4
Acting humanly
Thinking humanly Thinking rationally
Acting rationally
11. Systems that act like humans (Acting humanly)
(Turing Machine Test)
âThe Turing Test, proposed by (Alan Turing -1950)
ââThis test represent the art of creating machines
that perform functions that require intelligence
when performed by people.â (Kurzweil-1990)
ââThis test represent the study of how to make
computers do things at which, at the moment,
people are better.â (Rich and Knight-1991)
âThe inability to distinguish computer responses
from human responses is called the Turing
test
12. A
B
Systems that act like humans (Acting humanly)
(Turing Machine Test âŤŘŞŮŮŘąŮ؏⏠âŤ)ؼ؎تباعâŹ
13. Systems that act like humans
ď You enter a room which has a computer terminal.You
have a fixed period of time to type what you want into
the terminal, and study the replies.At the other end of
the line is either a human being or a computer system.
ď If it is a computer system, and at the end of the period
you cannot reliably determine whether it is a system or
a human, then the system is deemed to be intelligent.
?
14. Systems that act like humans
ď TheTuringTest approach
ď a human questioner cannot tell if
ď there is a computer or a human answering his question, via teletype
(remote communication)
ď The computer must behave intelligently
ď Intelligent behavior
ď to achieve human-level performance in all cognitive tasks
15. Systems that act like humans
ď These cognitive tasks include:
ď Natural language processing
ď for communication with human
ď Knowledge representation
ď to store information effectively & efficiently
ď Automated reasoning
ď to retrieve & answer questions using the stored information
ď Machine learning
ď to adapt to new circumstances
16. The total Turing Test
ďIncludes two more issues:
ď Computer vision
ďto perceive objects (seeing)
ď Robotics
ďto move objects (acting)
17. What is Artificial Intelligence ?
Systems that act
rationally
Systems that
think
like humans
Systems that
think
rationally
Systems that act
like humans
THOUGHT
BEHAVIOUR
HUMAN RATIONAL
18. Systems that think like humans (Thinking humanly)
(Cognitive Modeling)
âTo construct a machines program to think like a
human, it require two important things:
â˘first it requires the knowledge about the actual
workings of human mind i.e.Formulate a theory of
mind/brain.
⢠Express the theory in a computer program
â Two Approaches
⢠Cognitive Science and Psychology (testing/ predicting
responses of human subjects)
⢠Cognitive Neuroscience (observing neurological data)
19. â After completing the study about human mind, it is
possible to express the theory as a computer
program.
â If the programâs inputs/output and timing behavior
matched with the human behavior, then we can say
that the programâs mechanism is working like a
human mind.
Systems that think like humans (Thinking humanly)
(Cognitive Modeling)
20. âHumans are observed from âinsideâ
âHow humans think? Three ways to do this:
â˘Through Introspection âtrying to catch our own
thoughts as they go by.
â˘Through psychological experiments )(â observing a
person in action.
â˘Through brain imaging âobserving the brain in action.
Systems that think like humans (Thinking humanly)
(Cognitive Modeling)
21. â˘Cognitive Science
â˘âThe exciting new effort to make computers
think ⌠machines with minds in the full and
literal senseâ (Haugeland1985)
â˘â[The automation of] activities that we
associate with human thinking, activities
such as decision-making, problem solving,
learning , mental organizationâŚâ
(Bellman1978)
Systems that think like humans (Thinking humanly)
(Cognitive Modeling)
22. âExample: General Problem Solver (GPS) â A
problem solvers always keeps track of human mind
regardless of right answers.
âThe problem solver is contrast to other researchers,
because they are concentrating on getting the right
answers regardless of the human mind.
âAn Interdisciplinary field of cognitive science uses
computer models from AI and experimental
techniques from psychology to construct the theory
of the working of the human mind.
Systems that think like humans (Thinking humanly)
(Cognitive Modeling)
23. What is Artificial Intelligence ?
Systems that act
rationally
Systems that think
like humans
Systems that think
rationally
Systems that act
like humans
THOUGHT
BEHAVIOUR
HUMAN RATIONAL
24. Systems that think ârationallyâ
"laws of thought"
ď Humans are not alwaysârationalâ
ď Rational - defined in terms of logic?
ď Logic canât express everything (e.g. uncertainty)
ď Logical approach is often not feasible in terms of
computation time (needsâguidanceâ)
ď âThe study of mental facilities through the use of
computational modelsâ (Charniak and McDermott)
ď âThe study of the computations that make it possible to
perceive, reason, and actâ (Winston)
25. Systems that think rationally
âRational -> ideal intelligence
â˘(contrast with human intelligence)
âRational thinking governed by precise âlaws of
thoughtâ
â˘syllogisms
â˘notation and logic
âSystems (in theory) can solve problems using such
laws
26. What is Artificial Intelligence ?
Systems that act
rationally
Systems that think
like humans
Systems that think
rationally
Systems that act
like humans
THOUGHT
BEHAVIOUR
HUMAN RATIONAL
27. Systems that act rationally:
âRational agentâ
ď Rational behavior: doing the right thing
ď The right thing: that which is expected to maximize goal
achievement, given the available information
ď Giving answers to questions isâactingâ.
ď I don't care whether a system:
ďreplicates human thought processes
ďmakes the same decisions as humans
ďuses purely logical reasoning
28. Systems that act rationally
ď Logic â only part of a rational agent, not all of
rationality
ď Sometimes logic cannot reason a correct conclusion
ď At that time, some specific (in domain) human knowledge or
information is used
ď Thus, it covers more generally different situations of
problems
ď Compensate the incorrectly reasoned conclusion
29. Systems that act rationally
ď Study AI as rational agent â
2 advantages:
ď It is more general than using logic only
ď Because: LOGIC + Domain knowledge
ď It allows extension of the approach with more scientific
methodologies
30. ď An agent is an entity that perceives and acts
ď This course is about designing rational agents
ď Abstractly, an agent is a function from percept histories to actions:
ď
[f: P* âA]
ď For any given class of environments and tasks, we seek the agent
(or class of agents) with the best performance
ď Caveat: computational limitations make perfect rationality
unachievable
ď â design best program for given machine resources
ď
Systems that act rationally (Acting rationally)
âRational Agentâ
31. ď Artificial
ď Produced by human art or effort, rather than originating
naturally.
ď Intelligence
ď is the ability to acquire knowledge and use it" [Pigford
and Baur]
ď So,AI was defined as:
ď AI is the study of ideas that enable computers to be intelligent.
ď AI is the part of computer science concerned with design of
computer systems that exhibit human intelligence(From the
Concise Oxford Dictionary)
32. From the above two definitions, we can see that AI has two
major roles:
ď Study the intelligent part concerned with humans.
ď Represent those actions using computers.
33. Goals of AI
ď To make computers more useful by letting them take over
dangerous or tedious tasks from human
ď Understand principles of human intelligence
35. Academic Disciplines important to AI.
Philosophy
Mathematics
AI
Economics
Cognitive
Science
Psychology
Control
Theory
Linguistics
Neuroscience
Computer
Engineering
36. Academic Disciplines important to AI.
Philosophy ⢠Study of human intelligence began with no
formal expression
⢠Initiate the idea of mind as a machine and its
internal operations and processes
⢠Logic, methods of reasoning
⢠foundations of learning, language rationality.
Mathematics ⢠formalizes the three main area of AI: computation,
logic, and probability
⢠Computation leads to analysis of the problems
that can be computed (complexity theory)
Economics ⢠utility, decision theory
Neuroscience ⢠neurons as information processing units.
37. Academic Disciplines important to AI.
Psychology/
Cognitive
Science
â˘How do humans think and act?
â˘The study of human reasoning and acting
â˘Provides reasoning models for AI
â˘How do people behave, perceive, process
information, represent knowledge.
Computer
Engineering
â˘Building fast and efficient computers
â˘The power of computer makes computation of
large and difficult problems more easily
Control
Theory
â˘Design systems that maximize an objective
function over time
â˘How can artifacts operate under their own control?
â˘The artifacts adjust their actions
Linguistics â˘Knowledge representation, grammar
â˘For understanding natural languages
â˘Syntactic and semantic analysis
39. Typical problems to which AI methods are applied
âPattern recognition
âOptical character recognition
âHandwriting recognition
âSpeech recognition
â Face recognition
â Computer vision
â Virtual reality
âImage processing
âDiagnosis
40. Typical problems to which AI methods are applied
â Translation and Chatterboxes
â Nonlinear control and Robotics
â Artificial life
â Automated reasoning
â Automation
â Biologically inspired computing
â Concept mining
â Data mining
â Knowledge representation
41. Typical problems to which AI methods are applied
â Game theory and Strategic planning
â Natural Language Processing(NLP)
âSemantic Web
â E-mail spam filtering
âCognitive
âCybernetics
âHybrid intelligent system
âIntelligent agent
âIntelligent control
42. Search
ď Search is the fundamental technique of AI.
ď Possible answers, decisions or courses of action are structured into an abstract
space, which we then search.
ď Search is either "blind" or âuninformed":
ď blind
ď we move through the space without worrying about what is coming next, but
recognising the answer if we see it
ď informed
ď we guess what is ahead, and use that information to decide where to look
next.
ď We may want to search for the first answer that satisfies our goal, or we may want
to keep searching until we find the best answer.
43. Knowledge Representation & Reasoning
ď The second most important concept in AI
ď If we are going to act rationally in our environment, then we must have some way of
describing that environment and drawing inferences from that representation.
ď how do we describe what we know about the world ?
ď how do we describe it concisely ?
ď how do we describe it so that we can get hold of the right piece of knowledge
when we need it ?
ď how do we generate new pieces of knowledge ?
ď how do we deal with uncertain knowledge ?
44. Knowledge
Declarative Procedural
⢠Declarative knowledge deals with factoid questions
(what is the capital of India? Etc.)
⢠Procedural knowledge deals with âHowâ
⢠Procedural knowledge can be embedded in
declarative knowledge
45. Planning
Given a set of goals, construct a sequence of actions that achieves those goals:
ď often very large search space
ď but most parts of the world are independent of most other parts
ď often start with goals and connect them to actions
ď no necessary connection between order of planning and order of execution
ď what happens if the world changes as we execute the plan and/or our
actions donât produce the expected results?
46. Learning
ď If a system is going to act truly appropriately, then it must be
able to change its actions in the light of experience:
ďhow do we generate new facts from old ?
ďhow do we generate new concepts ?
ďhow do we learn to distinguish different situations
in new environments ?
47. Interacting with the Environment
ď In order to enable intelligent behaviour, we will have to
interact with our environment.
ď Properly intelligent systems may be expected to:
ď accept sensory input
ďvision, sound, âŚ
ď interact with humans
ďunderstand language, recognise speech,
generate text, speech and graphics, âŚ
ď modify the environment
ďrobotics
49. History of AI
The birth of
artificial
intelligence
(1943â56)
â˘McCulloch and Pitts, A Logical Calculus of the Ideas
Immanent in Nervous Activity, 1943
â˘Alan Turing, Computing Machinery and Intelligence, 1950
â˘The Electronic Numerical Integrator and Calculator
(ENIAC) project (Von Neumann)
â˘Shannon, Programming a Computer for Playing
Chess,1950
â˘The Dartmouth College summer workshop on machine
intelligence, artificial neural nets and automata theory,1956
The rise of
artificial
intelligence
(1956âlate
1960s)
⢠Invention of LISP (John McCarthy)
â˘The General Problem Solver (GPR) project (Newell and Simon)
â˘Gelertner: Geometry Theorem Prover
â˘Newell and Simon, Human Problem Solving, 1972
â˘Minsky, A Framework for Representing Knowledge, 1975
50. History of AI
Reality dawns
1966â73:
â˘Realization that many AI problems are intractable
â˘Limitations of existing neural network methods
identified
â˘Neural network research almost disappears
Adding domain
knowledge
1969â85:
⢠Development of knowledge-based systems
⢠Success of rule-based expert systems,
⢠E.g., DENDRAL, MYCIN
â˘But were brittle and did not scale well in practice
Rise of
machine
learning
1986--
⢠Neural Networks return to popularity
â˘Major advances in machine learning algorithms and
applications
51. History of AI
Role of
uncertainty
1990--
⢠Bayesian networks as a knowledge representation
framework
Major
advances
in all areas
of AI â
1990
â˘Significant demonstrations in machine learning
â˘Case-based reasoning
â˘Multi-agent planning
â˘Scheduling
â˘Data mining, Web Crawler
â˘natural language understanding and translation
â˘Vision, Virtual Reality
â˘Games
52. History of AI
AI as
Science
1995--
⢠Integration of learning, reasoning, knowledge
representation
â˘AI methods used in vision, language, data mining,
etc
1997 â˘The Deep Blue Chess Program beats the then world
chess champion, Garry Kasparov.
2000
â˘Interactive robot pets become commercially available.
MIT displays Kismet, a robot with a face that expresses
emotions. The robot Nomad explores remote regions
of Antarctica and locates meteorites.
53. First work in AI
1943
The name
âArtificial
Intelligenceâ
coined
1956
Development of
Lisp
1958
Microworlds
1963
Realization of
hurdles
AI becomes an
Industry
1981
Neural Networks
reinvented
1986
AI a booming
Industry TODAY
Paradigm Shift, GPS, People realized that all the
problems can NOT be solved with the same
approach
Paradigm Shift, Expert Systems, People
realized that software programs can act as
EXPERTS
Paradigm Shift, ANN, People realized that
software programs can LEARN
55. News Generation â Did you know that artificial intelligence
programs can write news stories? According to Wired, the AP,
Fox, and Yahoo! all use AI to write simple stories like
financial summaries, sports recaps, and fantasy sports
reports. AI isnât writing in-depth investigative articles, but it
has no problem with very simple articles that donât require a
lot of synthesis. Automated Insights, the company behind
the Wordsmith software, says that e-commerce, financial
services, real estate, and other âdata-drivenâ industries are
already benefitting from the app.
AI applications
60. â Speech Recognition â Some intelligent systems are
capable of hearing and comprehending the language in
terms of sentences and their meanings while a human talks
to it. It can handle different accents, slang words, noise in
the background, change in humanâs noise due to cold, etc.
â Intelligent Robots â Robots can perform the tasks given by
a human. They have sensors to detect physical data from
the real world such as light, heat, temperature, movement,
sound, bump, and pressure. They have efficient processors,
multiple sensors and huge memory, to exhibit intelligence. In
addition, they are capable of learning from their mistakes,
and they can adapt to the new environment
AI applications
61. AI Applications
ď Transportation:
ď Autonomous vehicle control:
â Smart Cars â You probably havenât seen someone reading
the newspaper while driving to work yet, but self-driving cars
are moving closer and closer to reality; Googleâs self-driving
car project and Teslaâs âautopilotâ feature are two examples
that have been in the news lately. Earlier this year,
the Washington Post reported on an algorithm developed by
Google that could potentially let self-driving cars learn to
drive in the same way that humans do: through experience.
63. AI Applications
Games: AI plays crucial role in strategic games such as chess,
poker, tic-tac-toe, etc., where machine can think of large number
of possible positions based on heuristic knowledge.
64. AI Applications
ď Robotic toys:
â Robotics for Heavy industry â have become common in many
industries and are often given jobs that are considered dangerous to
humans.
â Robots have proven effective in jobs that are very repetitive which may
lead to mistakes or accidents due to a lapse in concentration and other
jobs which humans may find degrading.
â In 2014, China, Japan, the United States, the Republic of Korea and
Germany together amounted to 70% of the total sales volume of robots.
â In the automotive industry, a sector with particularly high degree of
automation, Japan had the highest density of industrial robots in the world:
1,414 per 10,000 employees.
65. â Human Performance Modeling
(HPM) is a method of quantifying human behavior,
cognition, and processes; a tool used by human
factors researchers and practitioners for both the
analysis of human function and for the development
of systems designed for optimal user experience and
interaction .
â Data Mining and Data warehousing (Big âData)
AI applications
66. AI - (2017-2018) -Diaa Eldein Mustafa - Lecture (1)
-Introduction to Artificial Intelligence(2/2)
66
â Handwriting Recognition â The handwriting recognition
software reads the text written on paper by a pen or on
screen by a stylus. It can recognize the shapes of the letters
and convert it into editable text.
â Vision Systems â These systems understand, interpret, and
comprehend visual input on the computer. For example,
â A spying aero plane â takes photographs, which are used to
figure out spatial information or map of the areas.
â Clinical expert system â Doctors use it to diagnose the
patient.
â Face recognition â Police use computer software that can
recognize the face of criminal with the stored portrait made
by forensic artist.
AI applications
67. AI Applications
Other application areas:
ď Bioinformatics:
ď Gene expression data analysis
ď Prediction of protein structure
ď Text classification, document sorting:
ď Web pages, e-mails
ď Articles in the news
ď Video, image classification
ď Music composition, picture drawing
ď Natural Language Processing
70. Areas of AI and Some Dependencies
Machine
Learning
Computer
Vision
Expert
Systems
Robotics
NLP
Search Logic
Planning
Knowledge
Representation
71. Sub-fields of Artificial Intelligence
âNeural Networks â e.g. brain modeling, time series prediction,
classification
â Evolutionary Computation â e.g., genetic algorithms, genetic
programming
â Vision â e.g. object recognition, image understanding
â Robotics â e.g. intelligent control, autonomous exploration
â Expert Systems â e.g. decision support systems, teaching systems
â Speech Processingâ e.g. speech recognition and production
â Natural Language Processing â e.g. machine translation
â Planning â e.g. scheduling (air line systems, railways ), game
playing
âMachine Learning â e.g. decision tree learning, version space
learning
72. Importance of AI
âGame Playing
âSpeech Recognition
âUnderstanding Natural Language
âComputerVision
âExpert Systems
âHeuristic Classification
73. Advantages
âMore powerful and more useful computers
âNew and improved interfaces
âSolving new problems
âBetter handling of information
âRelieves information overload
âConversion of information into knowledge
Disadvantages
âIncreased costs
âDifficulty with software development - slow and expensive
âFew experienced programmers
âFew practical products have reached the market yet
Some Aspects of Artificial Intelligence