SlideShare a Scribd company logo
1 of 16
Download to read offline
Evolution’s strategies

Genetic algorithms and game theory models
Steven Hamblin and Peter L. Hurd
Department of Psychology, University of Alberta
What I’ll be discussing…
1. 

Extensive form games and
alternatives to ESS.

2. 

Solving game theory models using
genetic algorithms.
ESS - Evolutionarily stable strategy
!  An

uninvadable strategy: if every
member of a population plays that one
strategy, then no mutant can invade.
(Maynard Smith, 1982)

!  An

ESS is a mathematical description of
a population equilibrium.
Extensive form game - usually
Payoff matrix (normal form)
better for biological games.
A common - all information sets reached with
Pervasive problem with more complex games
is strategies that are not pervasive.
non-zero probability.
Here, it never pays for player 1 to choose the
last branch, so player 2’s choice at that branch
is moot.
ES set
!  A

set of strategies that would,
individually, be ESSs except that they
all invade each other. (Thomas, 1985;
Cressman, 1992)
The ESS formalism is not enough for
games with realistic complexity.
Solving them another way…
An alternative tool: Genetic algorithms.
! 

Algorithms that simulate evolution to solve
optimization problems.

! 

Heuristic search as opposed to analytical
solutions.

! 

Scales more effectively to larger games
(greater biological realism).
The e85 model (Enquist, 1985)

If we add another state variable or signal, we
can end up with over ten million strategies!
324 pure strategies with a
pervasive ESS.
Strategies split into two halves: when ego
strong and when ego weak.

Graph shows strategy evolution over time.

18 colours for each half: 18 * 18 = 324 total
0

500
As the mutation rate goes higher, it becomes harder and
harder (or impossible) for the GA to find the ESS.
Pink/Red - A previously unknown ES set
The ESS goes extinct very quickly.
solution to the e85 game.

0

500
Results
!  A

set of strategies whose end move is
always “attack”, is a previously
unknown ES set solution to the e85
game.

!  The

ES set has much greater attractive
power than the ESS.
Take home message…
! 

ESS is useful intuitively, but
limited practically.

! 

Most games with temporal
sequence / underlying state / etc.,
won’t have an ESS.

! 

Even more useful solution tools
(e.g. ES sets) are too complicated
to calculate for larger, more
realistic games.

! 

Genetic algorithms are a sensible
choice to solve complex game
theory models.
Acknowledgements
! 

Pete Hurd, for … well, just about everything.

! 

Eldridge Adams, for valuable discussion on the
inability of GAs to find the e85 ESS.

! 

The members of the Hurd lab for feedback and
advice.

! 

Brandy Williams, for design input.

More Related Content

Similar to ABS 2006

Game theory
Game theoryGame theory
Game theoryamaroks
 
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docx
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docxLecture OverviewSolving the prisoner’s dilemmaInstrumental r.docx
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docxSHIVA101531
 
An experiment on multiple games environment
An experiment on multiple games environmentAn experiment on multiple games environment
An experiment on multiple games environmentAshmayar_asif
 
navingameppt-191018085333.pdf
navingameppt-191018085333.pdfnavingameppt-191018085333.pdf
navingameppt-191018085333.pdfDebadattaPanda4
 

Similar to ABS 2006 (8)

Game theory
Game theoryGame theory
Game theory
 
Game theory
Game theoryGame theory
Game theory
 
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docx
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docxLecture OverviewSolving the prisoner’s dilemmaInstrumental r.docx
Lecture OverviewSolving the prisoner’s dilemmaInstrumental r.docx
 
gt_2007
gt_2007gt_2007
gt_2007
 
An experiment on multiple games environment
An experiment on multiple games environmentAn experiment on multiple games environment
An experiment on multiple games environment
 
Econ
EconEcon
Econ
 
navingameppt-191018085333.pdf
navingameppt-191018085333.pdfnavingameppt-191018085333.pdf
navingameppt-191018085333.pdf
 
game THEORY ppt
game THEORY pptgame THEORY ppt
game THEORY ppt
 

More from Steven Hamblin

Ideal freeducks coolshittalk1-sh-nov14-2014
Ideal freeducks coolshittalk1-sh-nov14-2014Ideal freeducks coolshittalk1-sh-nov14-2014
Ideal freeducks coolshittalk1-sh-nov14-2014Steven Hamblin
 
Git introduction workshop for scientists
Git introduction workshop for scientists Git introduction workshop for scientists
Git introduction workshop for scientists Steven Hamblin
 
Pecha Kucha: Visual design in science
Pecha Kucha: Visual design in sciencePecha Kucha: Visual design in science
Pecha Kucha: Visual design in scienceSteven Hamblin
 
Giving scientific talks
Giving scientific talksGiving scientific talks
Giving scientific talksSteven Hamblin
 
Academics and social media (GSA 2013 Talk)
Academics and social media (GSA 2013 Talk)Academics and social media (GSA 2013 Talk)
Academics and social media (GSA 2013 Talk)Steven Hamblin
 
Viral evolution, some economic approaches
Viral evolution, some economic approachesViral evolution, some economic approaches
Viral evolution, some economic approachesSteven Hamblin
 

More from Steven Hamblin (16)

Ideal freeducks coolshittalk1-sh-nov14-2014
Ideal freeducks coolshittalk1-sh-nov14-2014Ideal freeducks coolshittalk1-sh-nov14-2014
Ideal freeducks coolshittalk1-sh-nov14-2014
 
Git introduction workshop for scientists
Git introduction workshop for scientists Git introduction workshop for scientists
Git introduction workshop for scientists
 
Oxford Job Talk
Oxford Job TalkOxford Job Talk
Oxford Job Talk
 
Animals in the zoo
Animals in the zooAnimals in the zoo
Animals in the zoo
 
ISBE 2012
ISBE 2012ISBE 2012
ISBE 2012
 
Phd Defence talk
Phd Defence talkPhd Defence talk
Phd Defence talk
 
Seminar talk, 2008
Seminar talk, 2008Seminar talk, 2008
Seminar talk, 2008
 
Phd Proposal
Phd ProposalPhd Proposal
Phd Proposal
 
GRECA talk
GRECA talkGRECA talk
GRECA talk
 
MSc Thesis
MSc ThesisMSc Thesis
MSc Thesis
 
Cog Sem 2007
Cog Sem 2007Cog Sem 2007
Cog Sem 2007
 
Pecha Kucha: Visual design in science
Pecha Kucha: Visual design in sciencePecha Kucha: Visual design in science
Pecha Kucha: Visual design in science
 
Giving scientific talks
Giving scientific talksGiving scientific talks
Giving scientific talks
 
Academics and social media (GSA 2013 Talk)
Academics and social media (GSA 2013 Talk)Academics and social media (GSA 2013 Talk)
Academics and social media (GSA 2013 Talk)
 
Human Evolution Talk
Human Evolution TalkHuman Evolution Talk
Human Evolution Talk
 
Viral evolution, some economic approaches
Viral evolution, some economic approachesViral evolution, some economic approaches
Viral evolution, some economic approaches
 

Recently uploaded

AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4JOYLYNSAMANIEGO
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxJanEmmanBrigoli
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
TEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxTEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxruthvilladarez
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 

Recently uploaded (20)

AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Millenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptxMillenials and Fillennials (Ethical Challenge and Responses).pptx
Millenials and Fillennials (Ethical Challenge and Responses).pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
TEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxTEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docx
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 

ABS 2006

  • 1. Evolution’s strategies Genetic algorithms and game theory models Steven Hamblin and Peter L. Hurd Department of Psychology, University of Alberta
  • 2. What I’ll be discussing… 1.  Extensive form games and alternatives to ESS. 2.  Solving game theory models using genetic algorithms.
  • 3. ESS - Evolutionarily stable strategy !  An uninvadable strategy: if every member of a population plays that one strategy, then no mutant can invade. (Maynard Smith, 1982) !  An ESS is a mathematical description of a population equilibrium.
  • 4. Extensive form game - usually Payoff matrix (normal form) better for biological games.
  • 5. A common - all information sets reached with Pervasive problem with more complex games is strategies that are not pervasive. non-zero probability. Here, it never pays for player 1 to choose the last branch, so player 2’s choice at that branch is moot.
  • 6. ES set !  A set of strategies that would, individually, be ESSs except that they all invade each other. (Thomas, 1985; Cressman, 1992)
  • 7. The ESS formalism is not enough for games with realistic complexity.
  • 9. An alternative tool: Genetic algorithms. !  Algorithms that simulate evolution to solve optimization problems. !  Heuristic search as opposed to analytical solutions. !  Scales more effectively to larger games (greater biological realism).
  • 10. The e85 model (Enquist, 1985) If we add another state variable or signal, we can end up with over ten million strategies! 324 pure strategies with a pervasive ESS.
  • 11. Strategies split into two halves: when ego strong and when ego weak. Graph shows strategy evolution over time. 18 colours for each half: 18 * 18 = 324 total 0 500
  • 12. As the mutation rate goes higher, it becomes harder and harder (or impossible) for the GA to find the ESS.
  • 13. Pink/Red - A previously unknown ES set The ESS goes extinct very quickly. solution to the e85 game. 0 500
  • 14. Results !  A set of strategies whose end move is always “attack”, is a previously unknown ES set solution to the e85 game. !  The ES set has much greater attractive power than the ESS.
  • 15. Take home message… !  ESS is useful intuitively, but limited practically. !  Most games with temporal sequence / underlying state / etc., won’t have an ESS. !  Even more useful solution tools (e.g. ES sets) are too complicated to calculate for larger, more realistic games. !  Genetic algorithms are a sensible choice to solve complex game theory models.
  • 16. Acknowledgements !  Pete Hurd, for … well, just about everything. !  Eldridge Adams, for valuable discussion on the inability of GAs to find the e85 ESS. !  The members of the Hurd lab for feedback and advice. !  Brandy Williams, for design input.