SlideShare a Scribd company logo
1 of 15
GAMES AGAINST NATURE
Topic #3
Games Against Nature
• In game theory, for reasons that will be explained later, the
alternatives (e.g., LEFT and RIGHT) that each player chooses
from are usually called strategies,
– but they may also be called choices, actions, etc.
• A Game Against Nature is
– a 1-player game, in which a single rational self-interested player must
choose a strategy, and
– the outcome and the player’s payoff depends on both his chosen
strategy and the “choice” made by a totally disinterested nature.
• A Game Against Nature part of what is generally called
decision theory (rather than game theory) because there is
only one player who
– makes a rational choice, and
– is interested in (gets a payoff, i.e., a gain or loss, from) the outcome.
A Decision Problem without Risk or Uncertainty
Choices for P1 => Outcomes => Preferences/Payoffs/Utility
s1
x u1
(x) = 4
s2
y u2
(y) = 5
s3
z u3
(z) = 3
s4
v u4
(v) = 4
s5
w u5
(w) = 3
• In this case, Nature makes no choice, so
– the decision problem is conceptually trivial, i.e.,
– P1 should choose the strategy that gives him the best outcome,
– in this case s2.
• However, such decision problems are often difficult in practice,
because the decision maker may not know how to predict or
evaluate the payoffs from the different outcomes,
– but this problem is essentially one of information and research, not
strategic choice.
• But decision/game theory focus on the problem of strategic
choice, and assumes that all players know their payoffs.
A Literal Game Against Nature
• A payoff matrix is set up as a crosstabulation of P1’s strategies
and Nature’s contingencies (or another player’s strategies).
– This is the simplest possible non-trivial matrix , with two rows and two
columns.
• Numbers in each cell of a payoff matrix indicate the payoff (or
at least rank the payoffs) to each player given by the resulting
outcome.
– In this case, there is only one number in each cell because there is only
one player, and
– nature is indifferent among outcome and has no payoffs.
The Maximax Principle
• We now identify several different decision principles (some
of which may be poor principles) that player P1 might use in
order to pick his strategy.
• The Maximax Principle (informally, “aim for the best”):
– choose the strategy that can give you the best outcome.
– In this case, maximax says “choose s2.”
• Note however that s2 can also give you your worst outcome,
– so maximax can mean “aim for the best --- but get the worst.”
The Maximin Principle
• Maximin Principle (informally, “avoid the worst”):
– For each strategy, determine the worst outcome (minimum payoff)
you could possibly get if you select that strategy;
• this is called the security level for each strategy.
– In this case ,
• the security level of s1 is 2, while
• the security level of s2 is 1.
– Then choose the strategy that gives you the highest security level,
• i.e., “the maximum of the minimums” or “maximin.”
– In this case, s1 is P1’s maximin strategy, and by using it P1 can
guarantee a payoff of at least 2, regardless of what Nature does.
Maximax
vs.
Maximin
• For reasons that will
be made evident
later, the term
‘minimax’ is used
more commonly
than ‘maximin.’
The Principle of Insufficient Reason
• The Principle of Insufficient Reason (informally, “maximize the
average payoff”):
– choose the strategy the gives you the highest average payoff
(averaged across contingencies).
– In this case, s1 and s2 have the same average value (2.5).
• This principle has two big problems:
– It assumes that the payoffs are cardinal [or interval], whereas
• the payoffs displayed in the matrix above are probably just ordinal.
– It also in effect assumes that all contingencies are equally probable.
Decision Making (cont.)
• In general, Nature’s choice of contingencies may be made
– by an objective and known (to the player) random mechanism
(e.g., at a Las Vegas gaming table);
• This is called decision making under (objective) risk;
– or by some process concerning which the player has subjective
probability estimates (e.g., whether it will rain or shine);
• This is called decision making under (subjective) uncertainty.
• In either event, it is unlikely that all of nature’s contingencies are
equally probable.
Principle of Expected Utility Maximization
• Principle of Expected Utility (or Payoff) Maximization:
– The payoff matrix has been modified to show cardinal (or interval), rather
than merely ordinal, payoffs.
• Choose the strategy that gives you the highest expected payoffs, weighting
each contingency by its (objective or subjective) probability.
– This requires that
• payoffs are cardinal (or interval) in nature and
• the decision maker knows the probability over nature’s
contingencies .
– Given p1 = p2 = .5, the expected payoff from s1 = 6 and from s2 is 5, so P1
should choose S1.
– If p1 = .25 and p2 = .75, the expected payoff from s1 is 7 and from s2 is 7.5,
so P1 should choose s2.
Expected Utility Maximization (cont.)
• If rain is certain, P1 definitely should take his umbrella
• If shine is certain, P1 definitely should not take his umbrella
• How probable does rain have to be so that P1 (if he is maximizing
expected payoffs) should choose to take his umbrella?
• Put otherwise, what is the probability rain that leaves P1 indifferent between his two
strategies (because they have the same expected payoffs)?
• Let p (0 < p < 1)be the probability of rain, so the probability of shine is
(1-p).
Expected Payoff from S1 = Expected Payoff from S2
4p + 8(1-p) = 0p + 10(1-p)
6p = 2
p = 1/3 (and p = 2/3)
• In which case the expected payoff from s1 = 4/3 + 16/3 = 20/3 = 7.333 ,
• The expected payoff from s2 = 0/3 = 20/3 = 7.333
Eisenhower Before D-Day
• D-Day weather decision made by Supreme Allied Commander.
– D-Day June 5 was postponed due to a storm in the channel and another
storm was predicted to arrive shortly after the first.
– RAF Meteorologist James Martin Stagg predicted there would be a brief
window on June 6 with a break in weather.
• Eisenhower: “OK – let’s go.”
– Marginal weather predicted for June 6 may have been advantageous in
terms the (Zero-Sum) Game Against the Germans (as opposed to the Game
Against Nature).
– To invade only with favorable tides and full moon entailed disadvantages in
terms of the Game Again the Germans but evidently more than
compensating advantages in terms of the Game Against Nature.
• The Game Against the Germans was, in this respect, “strictly
determined” (as defined in Topic #5).
Eisenhower Before D-Day (cont.)
GFA GAME
Eisenhower Before D-Day (cont.)
Cardinal Payoffs ≈ $$
• Generally, you can think of cardinal payoffs as being essentially equivalent to
money, but not always.
• Consider a game with two players plus Nature:
– P1 is you, deciding whether to buy home-owner’s (fire) insurance;
– P2 is an insurance company, deciding whether to sell you a policy;
– Nature decides whether your home will burn down in the next year.
• If you and the insurance company have the same beliefs about the probability that
your house will burn down in the year, is there a premium price such that you will
buy and they will sell
– Not if payoffs = expected $$$.
– You probably are not risk-neutral but rather risk-averse.
– But the insurance company, insuring millions of widely dispersed house, can afford to be
risk neutral.
• Ditto in a game between you, a Las Vegas gaming house, and Nature.
• If you win the state lottery, are you indifferent between these two prizes?
– Prize 1: $1,000,000
– Prize 2: Another lottery ticket, which gives you a .5 chance of winning $2,000,000 and a .
5 chance of winning $0.

More Related Content

Recently uploaded

Development Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of appsDevelopment Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of appscristianmanaila2
 
Production 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptxProduction 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptxChloeMeadows1
 
I’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 ShirtI’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 Shirtrahman018755
 
Cyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital PresenceCyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital PresencePC Doctors NET
 
The Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case StudyThe Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case StudyDamar Juniarto
 
How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?Linksys Velop Login
 
Premier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdfPremier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdfappinfoedgeca
 
Bug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's GuideBug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's GuideVarun Mithran
 
Free scottie t shirts Free scottie t shirts
Free scottie t shirts Free scottie t shirtsFree scottie t shirts Free scottie t shirts
Free scottie t shirts Free scottie t shirtsrahman018755
 
Thank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirtsThank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirtsrahman018755
 
iThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWebiThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWebJie Liau
 
Reggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirtsrahman018755
 
Pvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdfPvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdfPvtaan
 
Statistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdfStatistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdfOndejSur
 
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.Tortogel
 
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkkaudience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkklolsDocherty
 

Recently uploaded (17)

Development Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of appsDevelopment Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of apps
 
Production 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptxProduction 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptx
 
GOOGLE Io 2024 At takes center stage.pdf
GOOGLE Io 2024 At takes center stage.pdfGOOGLE Io 2024 At takes center stage.pdf
GOOGLE Io 2024 At takes center stage.pdf
 
I’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 ShirtI’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 Shirt
 
Cyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital PresenceCyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital Presence
 
The Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case StudyThe Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case Study
 
How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?
 
Premier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdfPremier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdf
 
Bug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's GuideBug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's Guide
 
Free scottie t shirts Free scottie t shirts
Free scottie t shirts Free scottie t shirtsFree scottie t shirts Free scottie t shirts
Free scottie t shirts Free scottie t shirts
 
Thank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirtsThank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirts
 
iThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWebiThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWeb
 
Reggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirts
 
Pvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdfPvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdf
 
Statistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdfStatistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdf
 
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
 
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkkaudience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
 

Featured

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 

Featured (20)

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 

World Class Tools Make GRANDFUCKAUTO Push Button Easy

  • 2. Games Against Nature • In game theory, for reasons that will be explained later, the alternatives (e.g., LEFT and RIGHT) that each player chooses from are usually called strategies, – but they may also be called choices, actions, etc. • A Game Against Nature is – a 1-player game, in which a single rational self-interested player must choose a strategy, and – the outcome and the player’s payoff depends on both his chosen strategy and the “choice” made by a totally disinterested nature. • A Game Against Nature part of what is generally called decision theory (rather than game theory) because there is only one player who – makes a rational choice, and – is interested in (gets a payoff, i.e., a gain or loss, from) the outcome.
  • 3. A Decision Problem without Risk or Uncertainty Choices for P1 => Outcomes => Preferences/Payoffs/Utility s1 x u1 (x) = 4 s2 y u2 (y) = 5 s3 z u3 (z) = 3 s4 v u4 (v) = 4 s5 w u5 (w) = 3 • In this case, Nature makes no choice, so – the decision problem is conceptually trivial, i.e., – P1 should choose the strategy that gives him the best outcome, – in this case s2. • However, such decision problems are often difficult in practice, because the decision maker may not know how to predict or evaluate the payoffs from the different outcomes, – but this problem is essentially one of information and research, not strategic choice. • But decision/game theory focus on the problem of strategic choice, and assumes that all players know their payoffs.
  • 4. A Literal Game Against Nature • A payoff matrix is set up as a crosstabulation of P1’s strategies and Nature’s contingencies (or another player’s strategies). – This is the simplest possible non-trivial matrix , with two rows and two columns. • Numbers in each cell of a payoff matrix indicate the payoff (or at least rank the payoffs) to each player given by the resulting outcome. – In this case, there is only one number in each cell because there is only one player, and – nature is indifferent among outcome and has no payoffs.
  • 5. The Maximax Principle • We now identify several different decision principles (some of which may be poor principles) that player P1 might use in order to pick his strategy. • The Maximax Principle (informally, “aim for the best”): – choose the strategy that can give you the best outcome. – In this case, maximax says “choose s2.” • Note however that s2 can also give you your worst outcome, – so maximax can mean “aim for the best --- but get the worst.”
  • 6. The Maximin Principle • Maximin Principle (informally, “avoid the worst”): – For each strategy, determine the worst outcome (minimum payoff) you could possibly get if you select that strategy; • this is called the security level for each strategy. – In this case , • the security level of s1 is 2, while • the security level of s2 is 1. – Then choose the strategy that gives you the highest security level, • i.e., “the maximum of the minimums” or “maximin.” – In this case, s1 is P1’s maximin strategy, and by using it P1 can guarantee a payoff of at least 2, regardless of what Nature does.
  • 7. Maximax vs. Maximin • For reasons that will be made evident later, the term ‘minimax’ is used more commonly than ‘maximin.’
  • 8. The Principle of Insufficient Reason • The Principle of Insufficient Reason (informally, “maximize the average payoff”): – choose the strategy the gives you the highest average payoff (averaged across contingencies). – In this case, s1 and s2 have the same average value (2.5). • This principle has two big problems: – It assumes that the payoffs are cardinal [or interval], whereas • the payoffs displayed in the matrix above are probably just ordinal. – It also in effect assumes that all contingencies are equally probable.
  • 9. Decision Making (cont.) • In general, Nature’s choice of contingencies may be made – by an objective and known (to the player) random mechanism (e.g., at a Las Vegas gaming table); • This is called decision making under (objective) risk; – or by some process concerning which the player has subjective probability estimates (e.g., whether it will rain or shine); • This is called decision making under (subjective) uncertainty. • In either event, it is unlikely that all of nature’s contingencies are equally probable.
  • 10. Principle of Expected Utility Maximization • Principle of Expected Utility (or Payoff) Maximization: – The payoff matrix has been modified to show cardinal (or interval), rather than merely ordinal, payoffs. • Choose the strategy that gives you the highest expected payoffs, weighting each contingency by its (objective or subjective) probability. – This requires that • payoffs are cardinal (or interval) in nature and • the decision maker knows the probability over nature’s contingencies . – Given p1 = p2 = .5, the expected payoff from s1 = 6 and from s2 is 5, so P1 should choose S1. – If p1 = .25 and p2 = .75, the expected payoff from s1 is 7 and from s2 is 7.5, so P1 should choose s2.
  • 11. Expected Utility Maximization (cont.) • If rain is certain, P1 definitely should take his umbrella • If shine is certain, P1 definitely should not take his umbrella • How probable does rain have to be so that P1 (if he is maximizing expected payoffs) should choose to take his umbrella? • Put otherwise, what is the probability rain that leaves P1 indifferent between his two strategies (because they have the same expected payoffs)? • Let p (0 < p < 1)be the probability of rain, so the probability of shine is (1-p). Expected Payoff from S1 = Expected Payoff from S2 4p + 8(1-p) = 0p + 10(1-p) 6p = 2 p = 1/3 (and p = 2/3) • In which case the expected payoff from s1 = 4/3 + 16/3 = 20/3 = 7.333 , • The expected payoff from s2 = 0/3 = 20/3 = 7.333
  • 12. Eisenhower Before D-Day • D-Day weather decision made by Supreme Allied Commander. – D-Day June 5 was postponed due to a storm in the channel and another storm was predicted to arrive shortly after the first. – RAF Meteorologist James Martin Stagg predicted there would be a brief window on June 6 with a break in weather. • Eisenhower: “OK – let’s go.” – Marginal weather predicted for June 6 may have been advantageous in terms the (Zero-Sum) Game Against the Germans (as opposed to the Game Against Nature). – To invade only with favorable tides and full moon entailed disadvantages in terms of the Game Again the Germans but evidently more than compensating advantages in terms of the Game Against Nature. • The Game Against the Germans was, in this respect, “strictly determined” (as defined in Topic #5).
  • 13. Eisenhower Before D-Day (cont.) GFA GAME
  • 15. Cardinal Payoffs ≈ $$ • Generally, you can think of cardinal payoffs as being essentially equivalent to money, but not always. • Consider a game with two players plus Nature: – P1 is you, deciding whether to buy home-owner’s (fire) insurance; – P2 is an insurance company, deciding whether to sell you a policy; – Nature decides whether your home will burn down in the next year. • If you and the insurance company have the same beliefs about the probability that your house will burn down in the year, is there a premium price such that you will buy and they will sell – Not if payoffs = expected $$$. – You probably are not risk-neutral but rather risk-averse. – But the insurance company, insuring millions of widely dispersed house, can afford to be risk neutral. • Ditto in a game between you, a Las Vegas gaming house, and Nature. • If you win the state lottery, are you indifferent between these two prizes? – Prize 1: $1,000,000 – Prize 2: Another lottery ticket, which gives you a .5 chance of winning $2,000,000 and a . 5 chance of winning $0.