SlideShare a Scribd company logo
1 of 30
Download to read offline
Against Naive
Effective Altruism
Lucius Caviola

15 October 2017
Overview
• Argument

• Examples

• Disregard of interpersonal values

• Bad life choices

• Unbalanced views
Argument
• Effective altruism: “Doing the most good by using reason
and evidence”

• An explicit attempt of following this simple principle can
sometimes result in systematic mistakes
Why?
• Methods and moral theories associated with EA such as
expected value theory, Bayesian probability theory,
utilitarianism

• It’s easy to make a mistake when running on corrupted
hardware (human brains)

• Paradoxical: new knowledge about rationality can in
some cases lead to worse decisions compared to no
such knowledge
Yudkowsky, E. (2007) Knowing About Biases Can Hurt People.
Disregard of
interpersonal values
• Dismissing interpersonal virtues and social rules such as
honesty, integrity, friendship, kindness

• Lying/stealing to save money to donate

• Behaving arrogantly

→ Being perceived as unfriendly, rude, untrustworthy,
manipulative

Sources
• Short-sightedness (not taking into account long-term
effects and unintended consequences)

• Ignorance or disregard of human psychology in social
contexts

• Not integrating reasonable aspects of other moral views
Instrumental harm
• Impartial altruism and instrumental harm are psychologically dissociated
(Oxford Utilitarianism Scale; Kahane et al., 2017)

• Impartial altruism is central for EA:

willingness to give personal resources to help impartially

• Instrumental harm not relevant for EA:

willingness to harm a few for the greater good

• Associated with psychopathic tendencies (Kahane et al., 2015)

• Signals untrustworthiness (Everett et al., 2016)
Kahane, G., Everett, J. A. C., Earp, B.D., Caviola, L., Faber, N.S., Crockett, M.J., Savulescu, J. (2017). Beyond Sacrificial Harm: Positive and
Negative Dimensions of Everyday Utilitarian Decision-Making. Psychological Review.
Kahane, G., Everett, J. A. C., Earp, B. D., Farias, M., & Savulescu, J. (2015). ‘Utilitarian’ judgments in sacrificial moral dilemmas do not reflect
impartial concern for the greater good. Cognition, 134, 193-209.
Everett, J. A. C., Pizarro, D. A., & Crockett, M. J. (2016). Inference of trustworthiness from intuitive moral judgments. Journal of Experimental
Psychology: General, 145(6), 772.
Countermeasures
• Follow virtue ethical and deontological standards in
everyday life

• Be honest, trustworthy, cooperative, friendly, kind

• Don’t push people from footbridges
Schubert, S., Garfinkel, B. & Cotton-Barratt, O. (2017) Considering Considerateness: Why communities of do-gooders should be exceptionally
considerate
Christiano, P. (2016) Integrity for consequentialists.
Tomasik, B. (2013) Why honesty is a good policy.
Bad life choices
Examples
• Working too much (burnout)

• Working on something you don’t enjoy (not sustainable)

• Hastily giving up your current career 

• Hastily giving away all your money 

• Not allowing yourself to live a normal life (hobbies,
friends, family)

• Giving up on old friendships (interpersonal virtues)
Sources
• Over-enthusiasm

• Dedication signalling (to others and yourself)

• Short-sightedness

• Ignorance or disregard of human psychology, its needs
and limitations

• Disregard of common-sensical lifestyle and life choices
Countermeasures
• Don’t be less dedicated! But don’t let
your dedication drive epistemic/
instrumental mistakes

• Make important life decisions very
carefully

• Take outside view

• Take the needs and limitations of human
psychology seriously

• Take common sense seriously and adopt
some moderation (e.g. working hours)
Unbalanced views
• Unreflective endorsement of anti-commonsensical views

• Fragile conclusions

• Conclusions implying that everything else is unimportant
and everyone else is wrong

• Conclusions considered unethical by other reasonable
perspectives

• Too strong belief oscillations
Sources
• Sequence thinking

• Explicit Expected Value and Bayesian

• Signalling contrarianism
Sequence thinking
• Considering only one view

• Not considering plausible alternative
assumptions

• Easy to make a mistake somewhere
Karnofsky, H. (2014) Sequence thinking vs. cluster thinking.
Explicit EVT and Bayes
• Underestimating complexity and uncertainty

• Overestimating the discrepancies between different
options’ expected value

• Hastily identifying unjustified Pascalian scenarios 

• Updating too strongly on new weak evidence
Signalling contrarianism
• Appearing cool and wise by holding weird beliefs

• Bias against common sense

Alexander, S. (2010) Intellectual Hipsters and Meta-Contrarianism.
Countermeasures
• Be epistemically modest

• Integrate many plausible views

• Consider the opposite view

• Apply some “cluster thinking”

• Identify convergences between different views

• Take common sense and outside view seriously
Karnofsky, H. (2014) Sequence thinking vs. cluster thinking.
Beckstead, N. (2013) Common sense as a prior.
How can progress still occur?
• If a conclusion is extremely anti-commonsensical, a red flag should be raised

• But the conclusion can still be justified if

• the case for it is extremely strong

• it is robust, i.e. many perspectives converge towards it

• there is agreement among experts

• there is reason to assume disagreers (e.g. general public) are wrong, biased

• Examples: far future, anti-speciesism, but not: steal-to-give

• Weird and anti-commonsensical ideas are important and should be encouraged

• New ideas will sometimes justifiably result in anti-commonsensical conclusions
Conclusion
• Doing the most good is a simple principle but difficult to
implement

• Given our limited cognitive abilities, it’s easy to make
mistakes when attempting to follow the principle

• Let’s identify and avoid these mistakes!
Questions?
Opposite
• Unwillingness to change the status quo (e.g. career)

• e.g. due to low dedication or self-serving reasons (maybe
with rationalizations)

• Probably more people in the latter category, but the
former is more harmful on an individual level
Groupthink
• Groupthink within EA community

• “Groupthink is a psychological phenomenon that
occurs within a group of people in which the desire for
harmony or conformity in the group results in an
irrational or dysfunctional decision-making outcome. “
Fanaticism
Fanaticism
Extreme version and combination of above points

• Too extreme views

• Anti-commonsensical views and behavior

• Violation of prevailing social norms

• Behavior considered unethical by others

• Obsessive enthusiasm

• Uncritical zeal

• Little tolerance for other views
Fanaticism
• If a set of ideas has the potential of being interpreted the
wrong way, be careful. historically, lots of harm has been
caused by fanatics

More Related Content

What's hot

PSY 239 401 Chapter 14 SLIDES
PSY 239 401 Chapter 14 SLIDESPSY 239 401 Chapter 14 SLIDES
PSY 239 401 Chapter 14 SLIDES
kimappel
 
PSY 239 401 Chapter 1 SLIDES
PSY 239 401 Chapter 1 SLIDESPSY 239 401 Chapter 1 SLIDES
PSY 239 401 Chapter 1 SLIDES
kimappel
 
An Introduction to Critical Thinking
An Introduction to Critical ThinkingAn Introduction to Critical Thinking
An Introduction to Critical Thinking
Damian T. Gordon
 
The benefits of critical thinking
The benefits of critical thinkingThe benefits of critical thinking
The benefits of critical thinking
sarahjosh143
 
Critical thinking powerpoint
Critical thinking powerpointCritical thinking powerpoint
Critical thinking powerpoint
Barbara Bali
 
PSY 239 401 Chapter 7 SLIDES
PSY 239 401 Chapter 7 SLIDESPSY 239 401 Chapter 7 SLIDES
PSY 239 401 Chapter 7 SLIDES
kimappel
 

What's hot (18)

PSY 239 401 Chapter 14 SLIDES
PSY 239 401 Chapter 14 SLIDESPSY 239 401 Chapter 14 SLIDES
PSY 239 401 Chapter 14 SLIDES
 
Social Psychology
Social PsychologySocial Psychology
Social Psychology
 
PSY 239 401 Chapter 1 SLIDES
PSY 239 401 Chapter 1 SLIDESPSY 239 401 Chapter 1 SLIDES
PSY 239 401 Chapter 1 SLIDES
 
THE CONCEPT OF CRITICAL THINKING
THE CONCEPT OF CRITICAL THINKINGTHE CONCEPT OF CRITICAL THINKING
THE CONCEPT OF CRITICAL THINKING
 
An introduction to principles of critical thinking
An introduction to principles of critical thinkingAn introduction to principles of critical thinking
An introduction to principles of critical thinking
 
Critical Thinking
Critical ThinkingCritical Thinking
Critical Thinking
 
Causality insocialscience
Causality insocialscienceCausality insocialscience
Causality insocialscience
 
Critical Thinking, by Dr. Shadia Yousef Banjar.pptx
Critical Thinking, by Dr. Shadia Yousef Banjar.pptxCritical Thinking, by Dr. Shadia Yousef Banjar.pptx
Critical Thinking, by Dr. Shadia Yousef Banjar.pptx
 
An Introduction to Critical Thinking
An Introduction to Critical ThinkingAn Introduction to Critical Thinking
An Introduction to Critical Thinking
 
Critical thinking and teaching critical thinking
Critical thinking and teaching critical thinkingCritical thinking and teaching critical thinking
Critical thinking and teaching critical thinking
 
Critical Thinking
Critical ThinkingCritical Thinking
Critical Thinking
 
The benefits of critical thinking
The benefits of critical thinkingThe benefits of critical thinking
The benefits of critical thinking
 
What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?
 
Developing a critical thinking framework
Developing a critical thinking frameworkDeveloping a critical thinking framework
Developing a critical thinking framework
 
Critical thinking powerpoint
Critical thinking powerpointCritical thinking powerpoint
Critical thinking powerpoint
 
Lecture 1 intro and concepts(critical thinking)
Lecture 1 intro and concepts(critical thinking)Lecture 1 intro and concepts(critical thinking)
Lecture 1 intro and concepts(critical thinking)
 
Attitude
AttitudeAttitude
Attitude
 
PSY 239 401 Chapter 7 SLIDES
PSY 239 401 Chapter 7 SLIDESPSY 239 401 Chapter 7 SLIDES
PSY 239 401 Chapter 7 SLIDES
 

Similar to Against Naive Effective Altruism

Exploring Fatalism in Adolescents psyssa 2014 (ed)
Exploring Fatalism in Adolescents psyssa 2014 (ed)Exploring Fatalism in Adolescents psyssa 2014 (ed)
Exploring Fatalism in Adolescents psyssa 2014 (ed)
Ryk Brink
 
Ob slides - personality
Ob slides  - personalityOb slides  - personality
Ob slides - personality
stuitstrain2
 
Lecture 2 defining stereotypes, prejudice & discrimination
Lecture 2   defining stereotypes, prejudice & discriminationLecture 2   defining stereotypes, prejudice & discrimination
Lecture 2 defining stereotypes, prejudice & discrimination
Mark Felvus
 

Similar to Against Naive Effective Altruism (20)

Critical thinking ny_hospital_10_may2011
Critical thinking ny_hospital_10_may2011Critical thinking ny_hospital_10_may2011
Critical thinking ny_hospital_10_may2011
 
Exploring Fatalism in Adolescents psyssa 2014 (ed)
Exploring Fatalism in Adolescents psyssa 2014 (ed)Exploring Fatalism in Adolescents psyssa 2014 (ed)
Exploring Fatalism in Adolescents psyssa 2014 (ed)
 
Adaptive leadership for communities of faith
Adaptive leadership for communities of faithAdaptive leadership for communities of faith
Adaptive leadership for communities of faith
 
Technical Writing Belief Velue Attitude and Virtue
Technical Writing Belief Velue Attitude and VirtueTechnical Writing Belief Velue Attitude and Virtue
Technical Writing Belief Velue Attitude and Virtue
 
Cultivating a rapport based practice
Cultivating a rapport based practiceCultivating a rapport based practice
Cultivating a rapport based practice
 
Topic 1
Topic 1Topic 1
Topic 1
 
Critical-Thinking---Return-to-Learning.ppt
Critical-Thinking---Return-to-Learning.pptCritical-Thinking---Return-to-Learning.ppt
Critical-Thinking---Return-to-Learning.ppt
 
Critical-Thinking---Return-to-Learning (1).ppt
Critical-Thinking---Return-to-Learning (1).pptCritical-Thinking---Return-to-Learning (1).ppt
Critical-Thinking---Return-to-Learning (1).ppt
 
Critical-Thinking---Return-to-Learning.ppt
Critical-Thinking---Return-to-Learning.pptCritical-Thinking---Return-to-Learning.ppt
Critical-Thinking---Return-to-Learning.ppt
 
BUS 301 Week 7
BUS 301 Week 7BUS 301 Week 7
BUS 301 Week 7
 
Presentation sydney
Presentation sydneyPresentation sydney
Presentation sydney
 
Psychology as a Science
Psychology as a SciencePsychology as a Science
Psychology as a Science
 
Uncertainty: recognizing uncertainty and responding constructively in teachin...
Uncertainty: recognizing uncertainty and responding constructively in teachin...Uncertainty: recognizing uncertainty and responding constructively in teachin...
Uncertainty: recognizing uncertainty and responding constructively in teachin...
 
Uncertainty ncre presentation 2018
Uncertainty ncre presentation 2018Uncertainty ncre presentation 2018
Uncertainty ncre presentation 2018
 
Critical Thinking University Success1.pptx
Critical Thinking University Success1.pptxCritical Thinking University Success1.pptx
Critical Thinking University Success1.pptx
 
Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2
Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2
Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2
 
Ob slides - personality
Ob slides  - personalityOb slides  - personality
Ob slides - personality
 
Lecture 2 defining stereotypes, prejudice & discrimination
Lecture 2   defining stereotypes, prejudice & discriminationLecture 2   defining stereotypes, prejudice & discrimination
Lecture 2 defining stereotypes, prejudice & discrimination
 
Chapter12
Chapter12Chapter12
Chapter12
 
an overview of Critical thinking
an overview of Critical thinkingan overview of Critical thinking
an overview of Critical thinking
 

More from Effective Altruism Foundation

More from Effective Altruism Foundation (20)

Current Status of the EA Movement
Current Status of the EA MovementCurrent Status of the EA Movement
Current Status of the EA Movement
 
Nationale Volksinitiative zur Abschaffung der Massen­tierhaltung
Nationale Volksinitiative zur Abschaffung der Massen­tierhaltungNationale Volksinitiative zur Abschaffung der Massen­tierhaltung
Nationale Volksinitiative zur Abschaffung der Massen­tierhaltung
 
The New Meat
The New MeatThe New Meat
The New Meat
 
Lessons from Building an EA Charity: New Incentives
Lessons from Building an EA Charity: New IncentivesLessons from Building an EA Charity: New Incentives
Lessons from Building an EA Charity: New Incentives
 
What Does (and Doesn't) AI Mean for Effective Altruism?
What Does (and Doesn't) AI Mean for Effective Altruism?What Does (and Doesn't) AI Mean for Effective Altruism?
What Does (and Doesn't) AI Mean for Effective Altruism?
 
Delivering Development Impact at Scale
Delivering Development Impact at ScaleDelivering Development Impact at Scale
Delivering Development Impact at Scale
 
Using Evidence to Fight Poverty
Using Evidence to Fight PovertyUsing Evidence to Fight Poverty
Using Evidence to Fight Poverty
 
Toward a #FutureFortified: How Food Fortification Can Help End Micronutrient ...
Toward a #FutureFortified: How Food Fortification Can Help End Micronutrient ...Toward a #FutureFortified: How Food Fortification Can Help End Micronutrient ...
Toward a #FutureFortified: How Food Fortification Can Help End Micronutrient ...
 
Raising the Stakes: When Poker Meets EA
Raising the Stakes: When Poker Meets EARaising the Stakes: When Poker Meets EA
Raising the Stakes: When Poker Meets EA
 
Decision Theory Research at FRI
Decision Theory Research at FRIDecision Theory Research at FRI
Decision Theory Research at FRI
 
Wild-Animal Suffering Movement Building Through Research
Wild-Animal Suffering Movement Building Through ResearchWild-Animal Suffering Movement Building Through Research
Wild-Animal Suffering Movement Building Through Research
 
S-risks: Why they are the worst existential risks, and how to prevent them
S-risks: Why they are the worst existential risks, and how to prevent themS-risks: Why they are the worst existential risks, and how to prevent them
S-risks: Why they are the worst existential risks, and how to prevent them
 
Ethische Berufswahl – Mit 80.000 Stunden die Welt retten
Ethische Berufswahl – Mit 80.000 Stunden die Welt rettenEthische Berufswahl – Mit 80.000 Stunden die Welt retten
Ethische Berufswahl – Mit 80.000 Stunden die Welt retten
 
Effektiver Altruismus: Minimaldefinition und Begründung
Effektiver Altruismus: Minimaldefinition und BegründungEffektiver Altruismus: Minimaldefinition und Begründung
Effektiver Altruismus: Minimaldefinition und Begründung
 
Effektiver Altruismus: Einwände und Erwiderungen
Effektiver Altruismus: Einwände und ErwiderungenEffektiver Altruismus: Einwände und Erwiderungen
Effektiver Altruismus: Einwände und Erwiderungen
 
Rationaler Altruismus – eine Begründung moralischen Engagements
Rationaler Altruismus – eine Begründung moralischen EngagementsRationaler Altruismus – eine Begründung moralischen Engagements
Rationaler Altruismus – eine Begründung moralischen Engagements
 
Meta­-Strategien: Investitionen in die EA­-Bewegung
Meta­-Strategien: Investitionen in die EA­-BewegungMeta­-Strategien: Investitionen in die EA­-Bewegung
Meta­-Strategien: Investitionen in die EA­-Bewegung
 
Dysrationalia — The IQ­-RQ gap and what to do about it
Dysrationalia — The IQ­-RQ gap and what to do about itDysrationalia — The IQ­-RQ gap and what to do about it
Dysrationalia — The IQ­-RQ gap and what to do about it
 
Political and legal activism for all sentient beings
Political and legal activism for all sentient beingsPolitical and legal activism for all sentient beings
Political and legal activism for all sentient beings
 
Künstliche Intelligenz und Effektiver Altruismus
Künstliche Intelligenz und Effektiver AltruismusKünstliche Intelligenz und Effektiver Altruismus
Künstliche Intelligenz und Effektiver Altruismus
 

Recently uploaded

Program Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptxProgram Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptx
ScottMeyers35
 
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
suryaaamsyah
 
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Harm Kiezebrink
 

Recently uploaded (20)

Topical Guide for RID 3830 Public Image Training Series.ppsx
Topical Guide for RID 3830 Public Image Training Series.ppsxTopical Guide for RID 3830 Public Image Training Series.ppsx
Topical Guide for RID 3830 Public Image Training Series.ppsx
 
“Bee engaged with Youth”. World Bee Day 2024; May. 20th.
“Bee engaged with Youth”. World Bee Day 2024; May. 20th.“Bee engaged with Youth”. World Bee Day 2024; May. 20th.
“Bee engaged with Youth”. World Bee Day 2024; May. 20th.
 
Effective governance in the modern charity
Effective governance in the modern charityEffective governance in the modern charity
Effective governance in the modern charity
 
Sponsoring a Girl Child's Education in kurnool
Sponsoring a Girl Child's Education in kurnoolSponsoring a Girl Child's Education in kurnool
Sponsoring a Girl Child's Education in kurnool
 
The 2024 World Wildlife Crime Report tracks all these issues, trends and more...
The 2024 World Wildlife Crime Report tracks all these issues, trends and more...The 2024 World Wildlife Crime Report tracks all these issues, trends and more...
The 2024 World Wildlife Crime Report tracks all these issues, trends and more...
 
Program Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptxProgram Kickoff- Cohort......_4 (1).pptx
Program Kickoff- Cohort......_4 (1).pptx
 
bee engaged with youth - World Bee Day 2024
bee engaged with youth - World Bee Day 2024bee engaged with youth - World Bee Day 2024
bee engaged with youth - World Bee Day 2024
 
How to Save a Place: Get the Word Out Far And Wide
How to Save a Place: Get the Word Out Far And WideHow to Save a Place: Get the Word Out Far And Wide
How to Save a Place: Get the Word Out Far And Wide
 
Everything you need to know about your Parish or Town council website & .gov....
Everything you need to know about your Parish or Town council website & .gov....Everything you need to know about your Parish or Town council website & .gov....
Everything you need to know about your Parish or Town council website & .gov....
 
Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...Ghana High Commission on list of diplomats including US & China who owe £143m...
Ghana High Commission on list of diplomats including US & China who owe £143m...
 
The impact and warm of wildlife crime - 2024 World Wildlife Crime Report.
The impact and warm of wildlife crime - 2024 World Wildlife Crime Report.The impact and warm of wildlife crime - 2024 World Wildlife Crime Report.
The impact and warm of wildlife crime - 2024 World Wildlife Crime Report.
 
RPO America Peer Exchange: Rural Transportation Planning Programs
RPO America Peer Exchange: Rural Transportation Planning ProgramsRPO America Peer Exchange: Rural Transportation Planning Programs
RPO America Peer Exchange: Rural Transportation Planning Programs
 
Happy International Day of light - SPIE.
Happy International Day of light - SPIE.Happy International Day of light - SPIE.
Happy International Day of light - SPIE.
 
WhenWomenTakeControl.pdf Yale Historical Review
WhenWomenTakeControl.pdf Yale Historical ReviewWhenWomenTakeControl.pdf Yale Historical Review
WhenWomenTakeControl.pdf Yale Historical Review
 
Vip ℂall Girls New Delhi Phone No 9999965857 High Profile ℂall Girl Delhi No ...
Vip ℂall Girls New Delhi Phone No 9999965857 High Profile ℂall Girl Delhi No ...Vip ℂall Girls New Delhi Phone No 9999965857 High Profile ℂall Girl Delhi No ...
Vip ℂall Girls New Delhi Phone No 9999965857 High Profile ℂall Girl Delhi No ...
 
A House is not a Home Yale Historical Reivew
A House is not a Home Yale Historical ReivewA House is not a Home Yale Historical Reivew
A House is not a Home Yale Historical Reivew
 
Families and Climate Change - iyf30 - IDF.2024 AGENDA PROGRAMME.
Families and Climate Change - iyf30 - IDF.2024 AGENDA PROGRAMME.Families and Climate Change - iyf30 - IDF.2024 AGENDA PROGRAMME.
Families and Climate Change - iyf30 - IDF.2024 AGENDA PROGRAMME.
 
International Day of Families - 15 May 2024 - UNDESA.
International Day of Families - 15 May 2024 - UNDESA.International Day of Families - 15 May 2024 - UNDESA.
International Day of Families - 15 May 2024 - UNDESA.
 
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
Daftar Rumpun, Pohon, dan Cabang Ilmu (2024) - Daftar Rumpun, Pohon, dan Caba...
 
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
Low Atmospheric Pressure Stunning is not a humane alternative to Carbon Dioxi...
 

Against Naive Effective Altruism

  • 1. Against Naive Effective Altruism Lucius Caviola
 15 October 2017
  • 2. Overview • Argument • Examples • Disregard of interpersonal values • Bad life choices • Unbalanced views
  • 3. Argument • Effective altruism: “Doing the most good by using reason and evidence” • An explicit attempt of following this simple principle can sometimes result in systematic mistakes
  • 4. Why? • Methods and moral theories associated with EA such as expected value theory, Bayesian probability theory, utilitarianism • It’s easy to make a mistake when running on corrupted hardware (human brains) • Paradoxical: new knowledge about rationality can in some cases lead to worse decisions compared to no such knowledge Yudkowsky, E. (2007) Knowing About Biases Can Hurt People.
  • 6. • Dismissing interpersonal virtues and social rules such as honesty, integrity, friendship, kindness • Lying/stealing to save money to donate • Behaving arrogantly → Being perceived as unfriendly, rude, untrustworthy, manipulative

  • 7. Sources • Short-sightedness (not taking into account long-term effects and unintended consequences) • Ignorance or disregard of human psychology in social contexts • Not integrating reasonable aspects of other moral views
  • 8. Instrumental harm • Impartial altruism and instrumental harm are psychologically dissociated (Oxford Utilitarianism Scale; Kahane et al., 2017) • Impartial altruism is central for EA:
 willingness to give personal resources to help impartially • Instrumental harm not relevant for EA:
 willingness to harm a few for the greater good • Associated with psychopathic tendencies (Kahane et al., 2015) • Signals untrustworthiness (Everett et al., 2016) Kahane, G., Everett, J. A. C., Earp, B.D., Caviola, L., Faber, N.S., Crockett, M.J., Savulescu, J. (2017). Beyond Sacrificial Harm: Positive and Negative Dimensions of Everyday Utilitarian Decision-Making. Psychological Review. Kahane, G., Everett, J. A. C., Earp, B. D., Farias, M., & Savulescu, J. (2015). ‘Utilitarian’ judgments in sacrificial moral dilemmas do not reflect impartial concern for the greater good. Cognition, 134, 193-209. Everett, J. A. C., Pizarro, D. A., & Crockett, M. J. (2016). Inference of trustworthiness from intuitive moral judgments. Journal of Experimental Psychology: General, 145(6), 772.
  • 9. Countermeasures • Follow virtue ethical and deontological standards in everyday life • Be honest, trustworthy, cooperative, friendly, kind • Don’t push people from footbridges Schubert, S., Garfinkel, B. & Cotton-Barratt, O. (2017) Considering Considerateness: Why communities of do-gooders should be exceptionally considerate Christiano, P. (2016) Integrity for consequentialists. Tomasik, B. (2013) Why honesty is a good policy.
  • 11. Examples • Working too much (burnout) • Working on something you don’t enjoy (not sustainable) • Hastily giving up your current career • Hastily giving away all your money • Not allowing yourself to live a normal life (hobbies, friends, family) • Giving up on old friendships (interpersonal virtues)
  • 12. Sources • Over-enthusiasm • Dedication signalling (to others and yourself) • Short-sightedness • Ignorance or disregard of human psychology, its needs and limitations • Disregard of common-sensical lifestyle and life choices
  • 13. Countermeasures • Don’t be less dedicated! But don’t let your dedication drive epistemic/ instrumental mistakes • Make important life decisions very carefully • Take outside view • Take the needs and limitations of human psychology seriously • Take common sense seriously and adopt some moderation (e.g. working hours)
  • 15. • Unreflective endorsement of anti-commonsensical views • Fragile conclusions • Conclusions implying that everything else is unimportant and everyone else is wrong • Conclusions considered unethical by other reasonable perspectives • Too strong belief oscillations
  • 16. Sources • Sequence thinking • Explicit Expected Value and Bayesian • Signalling contrarianism
  • 17. Sequence thinking • Considering only one view • Not considering plausible alternative assumptions • Easy to make a mistake somewhere Karnofsky, H. (2014) Sequence thinking vs. cluster thinking.
  • 18. Explicit EVT and Bayes • Underestimating complexity and uncertainty • Overestimating the discrepancies between different options’ expected value • Hastily identifying unjustified Pascalian scenarios • Updating too strongly on new weak evidence
  • 19. Signalling contrarianism • Appearing cool and wise by holding weird beliefs • Bias against common sense Alexander, S. (2010) Intellectual Hipsters and Meta-Contrarianism.
  • 20. Countermeasures • Be epistemically modest • Integrate many plausible views • Consider the opposite view • Apply some “cluster thinking” • Identify convergences between different views • Take common sense and outside view seriously Karnofsky, H. (2014) Sequence thinking vs. cluster thinking. Beckstead, N. (2013) Common sense as a prior.
  • 21. How can progress still occur? • If a conclusion is extremely anti-commonsensical, a red flag should be raised • But the conclusion can still be justified if • the case for it is extremely strong • it is robust, i.e. many perspectives converge towards it • there is agreement among experts • there is reason to assume disagreers (e.g. general public) are wrong, biased • Examples: far future, anti-speciesism, but not: steal-to-give • Weird and anti-commonsensical ideas are important and should be encouraged • New ideas will sometimes justifiably result in anti-commonsensical conclusions
  • 22. Conclusion • Doing the most good is a simple principle but difficult to implement • Given our limited cognitive abilities, it’s easy to make mistakes when attempting to follow the principle • Let’s identify and avoid these mistakes!
  • 24.
  • 25.
  • 26. Opposite • Unwillingness to change the status quo (e.g. career) • e.g. due to low dedication or self-serving reasons (maybe with rationalizations) • Probably more people in the latter category, but the former is more harmful on an individual level
  • 27. Groupthink • Groupthink within EA community • “Groupthink is a psychological phenomenon that occurs within a group of people in which the desire for harmony or conformity in the group results in an irrational or dysfunctional decision-making outcome. “
  • 29. Fanaticism Extreme version and combination of above points • Too extreme views • Anti-commonsensical views and behavior • Violation of prevailing social norms • Behavior considered unethical by others • Obsessive enthusiasm • Uncritical zeal • Little tolerance for other views
  • 30. Fanaticism • If a set of ideas has the potential of being interpreted the wrong way, be careful. historically, lots of harm has been caused by fanatics