LECTURE 1
Introduction to AI
Instructor : Yousef Aburawi
Cs411 -Artificial Intelligence
Misurata University
Faculty of Information Technology
Spring 2022/2023
Basic Information
1-2
• References:
- Text Book: Artificial Intelligence: A Modern Approach, 4th edition,
by Stuart Russell and Peter Norvig. Prentice-Hall.
-Lecture Notes.
• Grading:
FTE FPE CW Final. P Final. E
20% 10% 10% 20% 40%
Introduction to Artificial Intelligence
Outline
I. What is AI?
II. A brief history
III. Subfields of AI
Google Class code
fth5szp
https://classroom.google.com/c/NTk5OD
Y3MzQ1OTEz?cjc=fth5szp
I. What Is Intelligence?
A wish-list of general characteristics of intelligence:
 Perception: manipulation & interpretation of data provided by sensors.
 Action: control and use of effectors to accomplish a variety of tasks.
 Reasoning: deductive (logical) inference, inductive inference.
 Learning: adapting behavior to better cope with changing environments,
discovery of patterns, learning to reason, plan, and act.
 Communication: with other intelligent agents including humans using
signals, signs, icons, …
 Planning: formulation of plans -- sequences or agenda of actions to
accomplish externally or internally determined goals.
What is AI?
Thinking Humanly Thinking Rationally
Acting Humanly Acting Rationally
“The exciting new effort to make computers think …
machines with minds, in the full and literal sense.”
(Haugeland, 1985)
“[The automation of] activities that we associate with
human thinking, activities such as decision-making,
problem solving, learning ....” (Bellman, 1978)
“The art of creating machines that perform
functions that require intelligence when performed
by people.” (Kurzweil, 1990)
“The study of how to make computers do things at
which, at the moment, people are better.” (Rich and
Knight, 1991)
“The study of mental faculties through the use of
computational models.” (Charniak and McDermott, 1985)
“The study of computations that make it possible to
perceive, reason, and act.” (Winston, 1992)
“Computational Intelligence is the study of the design
of intelligent agents.” (Poole et al, 1998)
“AI … is concerned with intelligent behavior in artifacts.”
(Nilsson, 1998)
Acting Humanly: Turing Test
Alan Turing (1950) : operational definition of intelligence
 A human interrogator poses some
written questions to another human
and a computer (or “robot”).
 The computer passes the test if
the interrogator cannot tell whether
the written responses come from
the human responder or the
computer.
Human interrogator
Human respondent Robot
Annual Loebner prize competition (since 1990): the first prize of $100,000 to be awarded
to the first program that passes the "unrestricted" Turing test.
Six Disciplines of AI
Natural language processing to communicate in a human language;
Knowledge representation to store what it knows;
Automated reasoning to answer questions and draw new conclusions;
Machine learning to adapt to new circumstances and to detect patterns.
Total Turing test requires interaction with the real world:
Computer vision & speech recognition to perceive the world;
Robotics to move around in the world and to manipulate objects.
To pass the Turing test, the following capabilities are required:
Thinking Humanly: Cognitive Modeling
To say a program thinks like a human, we must know humans think first.
Learn about human thought in three ways:
 introspection – catching thoughts as they go by;
 psychological experiments – observing a person in action;
 brain imaging – observing brain activities.
General problem solver (GPS) by Newell & Simon (1961)
Cognitive science constructs theories of the human mind by combining
 computer models from AI
 experimental techniques from psychology
Also compares reasoning steps to those in the human solution.
Thinking Rationally: “Laws of Thought”
Represent problems using logic and build programs to create intelligent systems.
Drawbacks:
 Not easy to state informal (and often uncertain) knowledge in the
formal logical notation.
 Big difference between solving a problem “in principle” and solving
it in practices.
Acting Rationally: Rational Agent
This course is about designing rational agents (Standrard Model).
Rational behavior: doing the right thing
expected to maximize goal achievement,
given the available information
 An agent is an entity that perceives and acts.
 A rational agent is one that acts to achieve the best outcome.
Foundations of AI
Philosophy
Mathematics
Economics
Neural science Psychology
Computer
Engineering
Control
Theory
Linguistics
AI
The Foundation of AI
12
Different fields have contributed to AI in the form of ideas, viewpoints and techniques:
Philosophy:
Logic, methods of reasoning, mind as physical system foundations of
learning, language, rationality.
Mathematics:
Formal representation and proof algorithms, computation,(in)tractability,
probability.
Economics: utility, decision theory.
Neuroscience: physical substrate for mental activity.
Psychology: phenomena of perception and motor experimental techniques.
Computer
engineering
building fast computers.
Control theory and
cybernetics:
design systems that maximize an objective function over time.
Linguistics: knowledge representation, grammar.
II. Brief History of AI
1943 McCulloh & Pitts: model of artificial neurons
1950 Turing’s “Computing Machinery and Intelligence”
1956
McCarthy, Minsky, Newell, Simon, Shannon, Nash et al. Dartmouth workshop:
birth of “Artificial Intelligence”
1952-69
Early enthusiasm, great expectations, optimism fueled by early success on some
problems thought to be hard.
1966-73
Collapse in AI research: Progress was slower than expected. Unrealistic
predictions, Herbert Simon (1957) AI discovers computational complexity.
Brief History of AI (cont’d)
1969-86 Expert systems
1980- I becomes an industry: expert systems booms, then busts (1988-93): AI Winter”.
1986- Neural networks regain popularity.
1987- Probabilistic reasoning and machine learning.
Brief History of AI (cont’d)
1995-
Emergence of intelligent agents.
AI technologies continue to find applications in:
 information retrieval.
 data mining and knowledge discovery.
 customizable software systems.
 smart devices (e.g., home, automobiles).
 agile manufacturing systems.
 autonomous vehicles.
 Bioinformatics.
 internet tools: search engines, recommender systems.
 …..
 Steady progress on fundamental AI research problems continues.
Brief History of AI (cont’d)
2001- Big data.
2011-
Deep learning: Successful large-scale real-world applications in:
 image recognition.
 natural language processing.
 speech recognition.
 machine translation.
 ….
Convolutional neural networks (CNNs)
Subfields of AI
Sub-fields of AI
 Problem solving
 Lots of early success here
 Solving puzzles, playing games such as chess and Go
 Constraint satisfaction problems
 Uses techniques like search and problem reduction
 Logical reasoning
 Prove things by manipulating database of facts (Logic Programing)
 Theorem proving
 Automatic Programming
 Writing computer programs given some sort of description or
specification
 Automatic code generation or recommendation
 Automatic program verification
Sub-fields of AI
 Language understanding and semantic modeling
 One of the earliest problems
 Huge advances in the past 5-6 years with deep learning
 Includes answering questions, information extraction, learning from
written text, and speech recognition
 Some aspects of language understanding:
 Understanding language forms, such as prefixes/suffixes/roots
 Syntax; how to form grammatically correct sentences
 Natural language translation
 Semantics; understanding meaning of words, phrases, sentences
 Finding/predicting related terms based on co-occurrence and contextual
relationships
 Conversation
Sub-fields of AI
 Machine Learning
 Supervised Machine Learning
 Classification, regression, ensemble methods
 By far the most prevalent applications of AI in the real world (image and speech recognition,
text categorization, recommender systems, medical diagnosis, ….)
 Unsupervised Machine Learning
 Clustering, topic modeling, PCA, learning encodings (auto encoder/decoders)
 Reinforcement learning
 Learning in dynamic domains
 Exploration/exploitation; Multi-armed bandits
Sub-fields of AI
 Pattern Recognition, Vision
 Computer-aided identification of objects/shapes/sounds
 Needed for speech and image understanding
 Requires signal acquisition, feature extraction, feature embeddings, …
 Again, lots of advances in recent years with deep learning methods such as
Convolutional Neural Networks
 Planning, Robotics and Vision
 Planning how to perform actions
 Recognizing, and manipulating objects
 Handling unexpected obstacles in dynamic environments
AI in Everyday Life?
 AI techniques are used in many common applications
 Intelligent user interfaces
 Spell/grammar checkers
 Context sensitive help systems
 Medical diagnosis systems
 Regulating/Controlling hardware devices and processes (e.g., in smart devices / homes)
 Voice/image recognition (more generally, pattern recognition)
 Scheduling systems (airlines, hotels, manufacturing)
 Error detection/ correction in electronic communication
 Program verification / compiler and programming language design
 Web search engines / Web spiders
 Recommender systems (collaborative/content-based filtering)
 Personal agents and assistants
 Intelligent CRM and business Intelligence
 Credit card verification / fraud detection
 Computer games
 Autonomous vehicles
Readings
 Chapters 1 of Textbox.
 https://en.wikipedia.org/wiki/History_of_artificial_intelligence
 https://plato.stanford.edu/entries/artificial-intelligence/
 http://plato.stanford.edu/entries/turing-test/
1-23
The End

AI_01_introduction.pptx

  • 1.
    LECTURE 1 Introduction toAI Instructor : Yousef Aburawi Cs411 -Artificial Intelligence Misurata University Faculty of Information Technology Spring 2022/2023
  • 2.
    Basic Information 1-2 • References: -Text Book: Artificial Intelligence: A Modern Approach, 4th edition, by Stuart Russell and Peter Norvig. Prentice-Hall. -Lecture Notes. • Grading: FTE FPE CW Final. P Final. E 20% 10% 10% 20% 40%
  • 3.
    Introduction to ArtificialIntelligence Outline I. What is AI? II. A brief history III. Subfields of AI Google Class code fth5szp https://classroom.google.com/c/NTk5OD Y3MzQ1OTEz?cjc=fth5szp
  • 4.
    I. What IsIntelligence? A wish-list of general characteristics of intelligence:  Perception: manipulation & interpretation of data provided by sensors.  Action: control and use of effectors to accomplish a variety of tasks.  Reasoning: deductive (logical) inference, inductive inference.  Learning: adapting behavior to better cope with changing environments, discovery of patterns, learning to reason, plan, and act.  Communication: with other intelligent agents including humans using signals, signs, icons, …  Planning: formulation of plans -- sequences or agenda of actions to accomplish externally or internally determined goals.
  • 5.
    What is AI? ThinkingHumanly Thinking Rationally Acting Humanly Acting Rationally “The exciting new effort to make computers think … machines with minds, in the full and literal sense.” (Haugeland, 1985) “[The automation of] activities that we associate with human thinking, activities such as decision-making, problem solving, learning ....” (Bellman, 1978) “The art of creating machines that perform functions that require intelligence when performed by people.” (Kurzweil, 1990) “The study of how to make computers do things at which, at the moment, people are better.” (Rich and Knight, 1991) “The study of mental faculties through the use of computational models.” (Charniak and McDermott, 1985) “The study of computations that make it possible to perceive, reason, and act.” (Winston, 1992) “Computational Intelligence is the study of the design of intelligent agents.” (Poole et al, 1998) “AI … is concerned with intelligent behavior in artifacts.” (Nilsson, 1998)
  • 6.
    Acting Humanly: TuringTest Alan Turing (1950) : operational definition of intelligence  A human interrogator poses some written questions to another human and a computer (or “robot”).  The computer passes the test if the interrogator cannot tell whether the written responses come from the human responder or the computer. Human interrogator Human respondent Robot Annual Loebner prize competition (since 1990): the first prize of $100,000 to be awarded to the first program that passes the "unrestricted" Turing test.
  • 7.
    Six Disciplines ofAI Natural language processing to communicate in a human language; Knowledge representation to store what it knows; Automated reasoning to answer questions and draw new conclusions; Machine learning to adapt to new circumstances and to detect patterns. Total Turing test requires interaction with the real world: Computer vision & speech recognition to perceive the world; Robotics to move around in the world and to manipulate objects. To pass the Turing test, the following capabilities are required:
  • 8.
    Thinking Humanly: CognitiveModeling To say a program thinks like a human, we must know humans think first. Learn about human thought in three ways:  introspection – catching thoughts as they go by;  psychological experiments – observing a person in action;  brain imaging – observing brain activities. General problem solver (GPS) by Newell & Simon (1961) Cognitive science constructs theories of the human mind by combining  computer models from AI  experimental techniques from psychology Also compares reasoning steps to those in the human solution.
  • 9.
    Thinking Rationally: “Lawsof Thought” Represent problems using logic and build programs to create intelligent systems. Drawbacks:  Not easy to state informal (and often uncertain) knowledge in the formal logical notation.  Big difference between solving a problem “in principle” and solving it in practices.
  • 10.
    Acting Rationally: RationalAgent This course is about designing rational agents (Standrard Model). Rational behavior: doing the right thing expected to maximize goal achievement, given the available information  An agent is an entity that perceives and acts.  A rational agent is one that acts to achieve the best outcome.
  • 11.
    Foundations of AI Philosophy Mathematics Economics Neuralscience Psychology Computer Engineering Control Theory Linguistics AI
  • 12.
    The Foundation ofAI 12 Different fields have contributed to AI in the form of ideas, viewpoints and techniques: Philosophy: Logic, methods of reasoning, mind as physical system foundations of learning, language, rationality. Mathematics: Formal representation and proof algorithms, computation,(in)tractability, probability. Economics: utility, decision theory. Neuroscience: physical substrate for mental activity. Psychology: phenomena of perception and motor experimental techniques. Computer engineering building fast computers. Control theory and cybernetics: design systems that maximize an objective function over time. Linguistics: knowledge representation, grammar.
  • 13.
    II. Brief Historyof AI 1943 McCulloh & Pitts: model of artificial neurons 1950 Turing’s “Computing Machinery and Intelligence” 1956 McCarthy, Minsky, Newell, Simon, Shannon, Nash et al. Dartmouth workshop: birth of “Artificial Intelligence” 1952-69 Early enthusiasm, great expectations, optimism fueled by early success on some problems thought to be hard. 1966-73 Collapse in AI research: Progress was slower than expected. Unrealistic predictions, Herbert Simon (1957) AI discovers computational complexity.
  • 14.
    Brief History ofAI (cont’d) 1969-86 Expert systems 1980- I becomes an industry: expert systems booms, then busts (1988-93): AI Winter”. 1986- Neural networks regain popularity. 1987- Probabilistic reasoning and machine learning.
  • 15.
    Brief History ofAI (cont’d) 1995- Emergence of intelligent agents. AI technologies continue to find applications in:  information retrieval.  data mining and knowledge discovery.  customizable software systems.  smart devices (e.g., home, automobiles).  agile manufacturing systems.  autonomous vehicles.  Bioinformatics.  internet tools: search engines, recommender systems.  …..  Steady progress on fundamental AI research problems continues.
  • 16.
    Brief History ofAI (cont’d) 2001- Big data. 2011- Deep learning: Successful large-scale real-world applications in:  image recognition.  natural language processing.  speech recognition.  machine translation.  …. Convolutional neural networks (CNNs)
  • 17.
  • 18.
    Sub-fields of AI Problem solving  Lots of early success here  Solving puzzles, playing games such as chess and Go  Constraint satisfaction problems  Uses techniques like search and problem reduction  Logical reasoning  Prove things by manipulating database of facts (Logic Programing)  Theorem proving  Automatic Programming  Writing computer programs given some sort of description or specification  Automatic code generation or recommendation  Automatic program verification
  • 19.
    Sub-fields of AI Language understanding and semantic modeling  One of the earliest problems  Huge advances in the past 5-6 years with deep learning  Includes answering questions, information extraction, learning from written text, and speech recognition  Some aspects of language understanding:  Understanding language forms, such as prefixes/suffixes/roots  Syntax; how to form grammatically correct sentences  Natural language translation  Semantics; understanding meaning of words, phrases, sentences  Finding/predicting related terms based on co-occurrence and contextual relationships  Conversation
  • 20.
    Sub-fields of AI Machine Learning  Supervised Machine Learning  Classification, regression, ensemble methods  By far the most prevalent applications of AI in the real world (image and speech recognition, text categorization, recommender systems, medical diagnosis, ….)  Unsupervised Machine Learning  Clustering, topic modeling, PCA, learning encodings (auto encoder/decoders)  Reinforcement learning  Learning in dynamic domains  Exploration/exploitation; Multi-armed bandits
  • 21.
    Sub-fields of AI Pattern Recognition, Vision  Computer-aided identification of objects/shapes/sounds  Needed for speech and image understanding  Requires signal acquisition, feature extraction, feature embeddings, …  Again, lots of advances in recent years with deep learning methods such as Convolutional Neural Networks  Planning, Robotics and Vision  Planning how to perform actions  Recognizing, and manipulating objects  Handling unexpected obstacles in dynamic environments
  • 22.
    AI in EverydayLife?  AI techniques are used in many common applications  Intelligent user interfaces  Spell/grammar checkers  Context sensitive help systems  Medical diagnosis systems  Regulating/Controlling hardware devices and processes (e.g., in smart devices / homes)  Voice/image recognition (more generally, pattern recognition)  Scheduling systems (airlines, hotels, manufacturing)  Error detection/ correction in electronic communication  Program verification / compiler and programming language design  Web search engines / Web spiders  Recommender systems (collaborative/content-based filtering)  Personal agents and assistants  Intelligent CRM and business Intelligence  Credit card verification / fraud detection  Computer games  Autonomous vehicles
  • 23.
    Readings  Chapters 1of Textbox.  https://en.wikipedia.org/wiki/History_of_artificial_intelligence  https://plato.stanford.edu/entries/artificial-intelligence/  http://plato.stanford.edu/entries/turing-test/ 1-23
  • 24.