SlideShare a Scribd company logo
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
Problem Solving by Searching
Search Methods :
Local Search for
Optimization Problems
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
2
Traveling Salesman Person
 Find the shortest Tour traversing all cities once.
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
Local Search Algorithms
2. Informed Search Strategies (Heuristic Search):
 A search strategy which searches the most promising branches of the
state-space first can: (1) find a solution more quickly, (2) find solutions
even when there is limited time available, (3) often find a better
solution, since more profitable parts of the state-space can be examined,
while ignoring the unprofitable parts.
 A search strategy which is better than another at identifying the most
promising branches of a search-space is said to be more informed.
I. Hill climbing, Simulated Annealing, Tabu search.
II. Best first search.
III. Greedy search.
IV. A* search.
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
Local Search Algorithms
 Hill Climbing,
 Simulated Annealing,
 Tabu Search
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
5
Hill Climbing
• Hill climbing search algorithm
(also known as greedy local
search) uses a loop that
continually moves in the direction
of increasing values (that is
uphill).
• It terminates when it reaches a
peak where no neighbor has a
higher value.
• "Like climbing Everest in thick fog with amnesia"
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
Hill Climbing Search
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
7
Hill Climbing
states
evaluation
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
8
Hill Climbing in Action …
Cost
States
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
9
Hill Climbing
Current
Solution
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
10
Hill Climbing
Current
Solution
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
11
Hill Climbing
Current
Solution
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
12
Hill Climbing
Current
Solution
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
13
Hill Climbing
Best
Local Minimum
Global Minimum
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
14
Issues
The Goal is to find GLOBAL optimum.
1. How to avoid LOCAL optima?
2. When to stop?
3. Climb downhill? When?
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
15
Simulated Annealing
 Key Idea: escape local maxima by allowing some "bad"
moves but gradually decrease their frequency
 Take some uphill steps to escape the local minimum
 Instead of picking the best move, it picks a random move
 If the move improves the situation, it is executed.
Otherwise, move with some probability less than 1.
 Physical analogy with the annealing process:
 Allowing liquid to gradually cool until it freezes
 The heuristic value is the energy, E
 Temperature parameter, T, controls speed of convergence.
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
16
Simulated Annealing
 Basic inspiration: What is annealing?
In metallurgy, annealing is the physical process used to
temperature or harden metals or glass by heating them to a
high temperature and then gradually cooling them, thus
allowing the material to coalesce into a low energy
crystalline state.
Heating then slowly cooling a substance to obtain a strong
crystalline structure.
 Key idea: Simulated Annealing combines Hill Climbing with
a random walk in some way that yields both efficiency and
completeness.
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
17
Simulated Annealing in Action …
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
18
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
19
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
20
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
21
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
22
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
23
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
24
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
25
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
26
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
27
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
28
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
29
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
30
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
31
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
32
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
33
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
34
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
35
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
36
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
37
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
38
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
39
Simulated Annealing
Cost
States
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
40
Tabu Search Algorithm
 Start with an initial feasible solution
 Initialize Tabu list
 Generate a subset of neighborhood and find the best
solution from the generated ones
 If move is not in Tabu list then accept
 Repeat from 3 until terminating condition
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
41
Tabu Search: TS in Action …
Cost
States
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
42
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
43
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
44
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
45
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
46
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
47
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
48
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
49
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
50
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
51
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
52
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
53
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
54
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
55
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
56
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
57
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
58
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
59
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
60
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
61
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
62
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
63
Tabu Search: TS
Best
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
64
Summary
 Local search methods keep small number of nodes
in memory. They are suitable for problems where
the solution is the goal state itself and not the path.
 Hill climbing and simulated annealing are examples
of local search algorithms.
Renas R. Rekany Artificial Intelligence Nawroz University
Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016
65
References
Russell, S. J., Norvig, P., Canny, J. F., Malik, J. M., &
Edwards, D. D. (2003). Artificial intelligence: a modern
approach (Vol. 2). Upper Saddle River: Prentice hall.

More Related Content

What's hot

I.BEST FIRST SEARCH IN AI
I.BEST FIRST SEARCH IN AII.BEST FIRST SEARCH IN AI
I.BEST FIRST SEARCH IN AI
vikas dhakane
 
State Space Representation and Search
State Space Representation and SearchState Space Representation and Search
State Space Representation and Search
Hitesh Mohapatra
 
Artificial Intelligence Searching Techniques
Artificial Intelligence Searching TechniquesArtificial Intelligence Searching Techniques
Artificial Intelligence Searching Techniques
Dr. C.V. Suresh Babu
 
Unit3:Informed and Uninformed search
Unit3:Informed and Uninformed searchUnit3:Informed and Uninformed search
Unit3:Informed and Uninformed search
Tekendra Nath Yogi
 
Local search algorithms
Local search algorithmsLocal search algorithms
Local search algorithms
bambangsueb
 
Game Playing in Artificial Intelligence
Game Playing in Artificial IntelligenceGame Playing in Artificial Intelligence
Game Playing in Artificial Intelligence
lordmwesh
 
Natural Language Processing with Python
Natural Language Processing with PythonNatural Language Processing with Python
Natural Language Processing with Python
Benjamin Bengfort
 
Artificial Intelligence- TicTacToe game
Artificial Intelligence- TicTacToe gameArtificial Intelligence- TicTacToe game
Artificial Intelligence- TicTacToe game
manika kumari
 
AI_Session 7 Greedy Best first search algorithm.pptx
AI_Session 7 Greedy Best first search algorithm.pptxAI_Session 7 Greedy Best first search algorithm.pptx
AI_Session 7 Greedy Best first search algorithm.pptx
Asst.prof M.Gokilavani
 
Ch 7 Knowledge Representation.pdf
Ch 7 Knowledge Representation.pdfCh 7 Knowledge Representation.pdf
Ch 7 Knowledge Representation.pdf
KrishnaMadala1
 
Local search algorithm
Local search algorithmLocal search algorithm
Local search algorithm
Megha Sharma
 
AI 7 | Constraint Satisfaction Problem
AI 7 | Constraint Satisfaction ProblemAI 7 | Constraint Satisfaction Problem
AI 7 | Constraint Satisfaction Problem
Mohammad Imam Hossain
 
01 knapsack using backtracking
01 knapsack using backtracking01 knapsack using backtracking
01 knapsack using backtrackingmandlapure
 
Run time storage
Run time storageRun time storage
Run time storage
Rasineni Madhan Mohan Naidu
 
First order logic
First order logicFirst order logic
First order logic
Megha Sharma
 
Informed search
Informed searchInformed search
Informed search
Amit Kumar Rathi
 
A* Search Algorithm
A* Search AlgorithmA* Search Algorithm
A* Search Algorithm
vikas dhakane
 

What's hot (20)

convex hull
convex hullconvex hull
convex hull
 
I.BEST FIRST SEARCH IN AI
I.BEST FIRST SEARCH IN AII.BEST FIRST SEARCH IN AI
I.BEST FIRST SEARCH IN AI
 
State Space Representation and Search
State Space Representation and SearchState Space Representation and Search
State Space Representation and Search
 
Artificial Intelligence Searching Techniques
Artificial Intelligence Searching TechniquesArtificial Intelligence Searching Techniques
Artificial Intelligence Searching Techniques
 
Unit3:Informed and Uninformed search
Unit3:Informed and Uninformed searchUnit3:Informed and Uninformed search
Unit3:Informed and Uninformed search
 
Local search algorithms
Local search algorithmsLocal search algorithms
Local search algorithms
 
Game Playing in Artificial Intelligence
Game Playing in Artificial IntelligenceGame Playing in Artificial Intelligence
Game Playing in Artificial Intelligence
 
Natural Language Processing with Python
Natural Language Processing with PythonNatural Language Processing with Python
Natural Language Processing with Python
 
Rule Based System
Rule Based SystemRule Based System
Rule Based System
 
First order logic
First order logicFirst order logic
First order logic
 
Artificial Intelligence- TicTacToe game
Artificial Intelligence- TicTacToe gameArtificial Intelligence- TicTacToe game
Artificial Intelligence- TicTacToe game
 
AI_Session 7 Greedy Best first search algorithm.pptx
AI_Session 7 Greedy Best first search algorithm.pptxAI_Session 7 Greedy Best first search algorithm.pptx
AI_Session 7 Greedy Best first search algorithm.pptx
 
Ch 7 Knowledge Representation.pdf
Ch 7 Knowledge Representation.pdfCh 7 Knowledge Representation.pdf
Ch 7 Knowledge Representation.pdf
 
Local search algorithm
Local search algorithmLocal search algorithm
Local search algorithm
 
AI 7 | Constraint Satisfaction Problem
AI 7 | Constraint Satisfaction ProblemAI 7 | Constraint Satisfaction Problem
AI 7 | Constraint Satisfaction Problem
 
01 knapsack using backtracking
01 knapsack using backtracking01 knapsack using backtracking
01 knapsack using backtracking
 
Run time storage
Run time storageRun time storage
Run time storage
 
First order logic
First order logicFirst order logic
First order logic
 
Informed search
Informed searchInformed search
Informed search
 
A* Search Algorithm
A* Search AlgorithmA* Search Algorithm
A* Search Algorithm
 

More from Renas Rekany

decision making
decision makingdecision making
decision making
Renas Rekany
 
Artificial Neural Network
Artificial Neural NetworkArtificial Neural Network
Artificial Neural Network
Renas Rekany
 
AI heuristic search
AI heuristic searchAI heuristic search
AI heuristic search
Renas Rekany
 
AI simple search strategies
AI simple search strategiesAI simple search strategies
AI simple search strategies
Renas Rekany
 
C# p9
C# p9C# p9
C# p8
C# p8C# p8
C# p7
C# p7C# p7
C# p6
C# p6C# p6
C# p5
C# p5C# p5
C# p4
C# p4C# p4
C# p3
C# p3C# p3
C# p2
C# p2C# p2
C# p1
C# p1C# p1
C# with Renas
C# with RenasC# with Renas
C# with Renas
Renas Rekany
 
Object oriented programming inheritance
Object oriented programming inheritanceObject oriented programming inheritance
Object oriented programming inheritance
Renas Rekany
 
Object oriented programming
Object oriented programmingObject oriented programming
Object oriented programming
Renas Rekany
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
Renas Rekany
 
Renas Rajab Asaad
Renas Rajab AsaadRenas Rajab Asaad
Renas Rajab Asaad
Renas Rekany
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
Renas Rekany
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
Renas Rekany
 

More from Renas Rekany (20)

decision making
decision makingdecision making
decision making
 
Artificial Neural Network
Artificial Neural NetworkArtificial Neural Network
Artificial Neural Network
 
AI heuristic search
AI heuristic searchAI heuristic search
AI heuristic search
 
AI simple search strategies
AI simple search strategiesAI simple search strategies
AI simple search strategies
 
C# p9
C# p9C# p9
C# p9
 
C# p8
C# p8C# p8
C# p8
 
C# p7
C# p7C# p7
C# p7
 
C# p6
C# p6C# p6
C# p6
 
C# p5
C# p5C# p5
C# p5
 
C# p4
C# p4C# p4
C# p4
 
C# p3
C# p3C# p3
C# p3
 
C# p2
C# p2C# p2
C# p2
 
C# p1
C# p1C# p1
C# p1
 
C# with Renas
C# with RenasC# with Renas
C# with Renas
 
Object oriented programming inheritance
Object oriented programming inheritanceObject oriented programming inheritance
Object oriented programming inheritance
 
Object oriented programming
Object oriented programmingObject oriented programming
Object oriented programming
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
 
Renas Rajab Asaad
Renas Rajab AsaadRenas Rajab Asaad
Renas Rajab Asaad
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
 
Renas Rajab Asaad
Renas Rajab Asaad Renas Rajab Asaad
Renas Rajab Asaad
 

Recently uploaded

Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Atul Kumar Singh
 

Recently uploaded (20)

Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Guidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th SemesterGuidance_and_Counselling.pdf B.Ed. 4th Semester
Guidance_and_Counselling.pdf B.Ed. 4th Semester
 

AI local search

  • 1. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 Problem Solving by Searching Search Methods : Local Search for Optimization Problems
  • 2. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 2 Traveling Salesman Person  Find the shortest Tour traversing all cities once.
  • 3. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 Local Search Algorithms 2. Informed Search Strategies (Heuristic Search):  A search strategy which searches the most promising branches of the state-space first can: (1) find a solution more quickly, (2) find solutions even when there is limited time available, (3) often find a better solution, since more profitable parts of the state-space can be examined, while ignoring the unprofitable parts.  A search strategy which is better than another at identifying the most promising branches of a search-space is said to be more informed. I. Hill climbing, Simulated Annealing, Tabu search. II. Best first search. III. Greedy search. IV. A* search.
  • 4. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 Local Search Algorithms  Hill Climbing,  Simulated Annealing,  Tabu Search
  • 5. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 5 Hill Climbing • Hill climbing search algorithm (also known as greedy local search) uses a loop that continually moves in the direction of increasing values (that is uphill). • It terminates when it reaches a peak where no neighbor has a higher value. • "Like climbing Everest in thick fog with amnesia"
  • 6. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 Hill Climbing Search
  • 7. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 7 Hill Climbing states evaluation
  • 8. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 8 Hill Climbing in Action … Cost States
  • 9. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 9 Hill Climbing Current Solution
  • 10. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 10 Hill Climbing Current Solution
  • 11. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 11 Hill Climbing Current Solution
  • 12. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 12 Hill Climbing Current Solution
  • 13. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 13 Hill Climbing Best Local Minimum Global Minimum
  • 14. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 14 Issues The Goal is to find GLOBAL optimum. 1. How to avoid LOCAL optima? 2. When to stop? 3. Climb downhill? When?
  • 15. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 15 Simulated Annealing  Key Idea: escape local maxima by allowing some "bad" moves but gradually decrease their frequency  Take some uphill steps to escape the local minimum  Instead of picking the best move, it picks a random move  If the move improves the situation, it is executed. Otherwise, move with some probability less than 1.  Physical analogy with the annealing process:  Allowing liquid to gradually cool until it freezes  The heuristic value is the energy, E  Temperature parameter, T, controls speed of convergence.
  • 16. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 16 Simulated Annealing  Basic inspiration: What is annealing? In metallurgy, annealing is the physical process used to temperature or harden metals or glass by heating them to a high temperature and then gradually cooling them, thus allowing the material to coalesce into a low energy crystalline state. Heating then slowly cooling a substance to obtain a strong crystalline structure.  Key idea: Simulated Annealing combines Hill Climbing with a random walk in some way that yields both efficiency and completeness.
  • 17. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 17 Simulated Annealing in Action … Cost States Best
  • 18. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 18 Simulated Annealing Cost States Best
  • 19. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 19 Simulated Annealing Cost States Best
  • 20. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 20 Simulated Annealing Cost States Best
  • 21. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 21 Simulated Annealing Cost States Best
  • 22. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 22 Simulated Annealing Cost States Best
  • 23. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 23 Simulated Annealing Cost States Best
  • 24. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 24 Simulated Annealing Cost States Best
  • 25. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 25 Simulated Annealing Cost States Best
  • 26. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 26 Simulated Annealing Cost States Best
  • 27. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 27 Simulated Annealing Cost States Best
  • 28. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 28 Simulated Annealing Cost States Best
  • 29. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 29 Simulated Annealing Cost States Best
  • 30. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 30 Simulated Annealing Cost States Best
  • 31. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 31 Simulated Annealing Cost States Best
  • 32. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 32 Simulated Annealing Cost States Best
  • 33. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 33 Simulated Annealing Cost States Best
  • 34. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 34 Simulated Annealing Cost States Best
  • 35. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 35 Simulated Annealing Cost States Best
  • 36. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 36 Simulated Annealing Cost States Best
  • 37. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 37 Simulated Annealing Cost States Best
  • 38. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 38 Simulated Annealing Cost States Best
  • 39. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 39 Simulated Annealing Cost States Best
  • 40. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 40 Tabu Search Algorithm  Start with an initial feasible solution  Initialize Tabu list  Generate a subset of neighborhood and find the best solution from the generated ones  If move is not in Tabu list then accept  Repeat from 3 until terminating condition
  • 41. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 41 Tabu Search: TS in Action … Cost States
  • 42. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 42 Tabu Search: TS Best
  • 43. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 43 Tabu Search: TS Best
  • 44. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 44 Tabu Search: TS Best
  • 45. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 45 Tabu Search: TS Best
  • 46. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 46 Tabu Search: TS Best
  • 47. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 47 Tabu Search: TS Best
  • 48. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 48 Tabu Search: TS Best
  • 49. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 49 Tabu Search: TS Best
  • 50. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 50 Tabu Search: TS Best
  • 51. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 51 Tabu Search: TS Best
  • 52. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 52 Tabu Search: TS Best
  • 53. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 53 Tabu Search: TS Best
  • 54. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 54 Tabu Search: TS Best
  • 55. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 55 Tabu Search: TS Best
  • 56. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 56 Tabu Search: TS Best
  • 57. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 57 Tabu Search: TS Best
  • 58. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 58 Tabu Search: TS Best
  • 59. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 59 Tabu Search: TS Best
  • 60. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 60 Tabu Search: TS Best
  • 61. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 61 Tabu Search: TS Best
  • 62. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 62 Tabu Search: TS Best
  • 63. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 63 Tabu Search: TS Best
  • 64. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 64 Summary  Local search methods keep small number of nodes in memory. They are suitable for problems where the solution is the goal state itself and not the path.  Hill climbing and simulated annealing are examples of local search algorithms.
  • 65. Renas R. Rekany Artificial Intelligence Nawroz University Keep Reading as long as you breathComSci: Renas R. Rekany Oct2016 65 References Russell, S. J., Norvig, P., Canny, J. F., Malik, J. M., & Edwards, D. D. (2003). Artificial intelligence: a modern approach (Vol. 2). Upper Saddle River: Prentice hall.