SlideShare a Scribd company logo
The Rise of Emotion-aware
Conversational Agents:
Threats in Digital Emotions
Martino Mensio
Giuseppe Rizzo
Maurizio Morisio
#RCBlackMirror2018 @ WWW2018
24 April 2018
Lyon, FR
Objective
- analyze theoretical advances enabling
Conversational Agents
- analyze emotional side-effects of user-centricity
Considering similarities with Black Mirror episodes and
other real-world examples
2
Main episode of inspiration
s02e01 Be Right Back: a person “reconstructed” from digital traces
- different interaction channels
- emotional attachment to bots
- free will, autonomy and ethics [1]
3
[1] Moor, J. (2009). Four kinds of ethical robots. Philosophy Now, 72, 12-14.
Background:
Conversational Agents
4
Background: three stages
5
text voice embodied
Background: stage #1 Textual interaction
6
[2] Serban, I. V., Sordoni, A., Bengio, Y., Courville, A. C., & Pineau, J. (2016, February). Building End-To-End
Dialogue Systems Using Generative Hierarchical Neural Network Models. In AAAI (Vol. 16, pp. 3776-3784).
Background: stage #2 Voice interaction
7
speech-to-text and
text to speech
voice imitation
capabilities
tonal features in
input/output
Background: stage #3 Embodied agent
8
body movements facial expression humanoid
robots:
Sophia [3]
Nadine [4]
[3] http://www.hansonrobotics.com/robot/sophia/
[4] http://bit.ly/telegraph_knapton_nadine
Background: additional ingredients
- topic focus [5]
- persona-based generation[6]
- emotions (recognise, process, simulate) [7]
- channel specific features
9
[5] Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, and Wei-Ying Ma. 2017. Topic Aware Neural
Response Generation.. In AAAI, Vol. 17. 3351–3357.
[6] Jiwei Li, Michel Galley, Chris Brockett, Georgios P Spithourakis, Jianfeng Gao, and Bill Dolan. 2016. A persona-based
neural conversation model. The 54th Annual Meeting of the Association for Computational Linguistics 1, 994–1003. CL
Lisetti. 1998. Affective computing. (1998).
[7] https://cakechat.replika.ai/
Background: Replika example
[8] https://www.youtube.com/watch?v=yQGqMVuAk04 10
Effects
11
Short-term therapeutic effect
12
Someone who:
- always listens to you
- always agrees
- never complains
- available on-demand
Provides:
- relief
- self-consciousness
Addiction
- “race for attention” [9]
- escape from reality
13
[9] http://bit.ly/ted_harris_talk
Isolation
14
- side effects of tools that should enable more connections
- hikikomori
- virtual friends can make the situation worse
Personality change
15
Big Five Personality Traits [10]
- openness reduction ← “filter bubble”
- extraversion reduction ← isolation
Could be measured specifically for
Conversational Agents
[10] Goldberg, L. R. (1993). The structure of phenotypic personality traits. American psychologist, 48(1), 26.
Societal implication
inability to connect with other people
16
Conclusions
- Conversational Agents should be tools, not
substitute human relationships
- need for regulation on the emotional field
17
Let’s keep emotions for humans
https://www.slideshare.net/MartinoMensio
https://twitter.com/MartinoMensio
18

More Related Content

Similar to The Rise of Emotion-aware Conversational Agents: Threats in Digital Emotions

Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Eirini Ntoutsi
 
Eddie Turner - PCMA Convene (June 2010)
Eddie Turner - PCMA Convene (June 2010)Eddie Turner - PCMA Convene (June 2010)
Eddie Turner - PCMA Convene (June 2010)
Eddie Turner
 
Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Joe McCarthy
 
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
Codemotion
 
Communication between open source developers
Communication between open source developersCommunication between open source developers
Communication between open source developers
Alexander Serebrenik
 
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
Massimiliano Dibitonto
 
計算社會科學初探- 當電腦科學家遇上社會科學
計算社會科學初探-當電腦科學家遇上社會科學計算社會科學初探-當電腦科學家遇上社會科學
計算社會科學初探- 當電腦科學家遇上社會科學
Sheng-Wei (Kuan-Ta) Chen
 
Proactive Displays IIIA 20080627
Proactive Displays IIIA 20080627Proactive Displays IIIA 20080627
Proactive Displays IIIA 20080627
Joe McCarthy
 
Printable Fairy Tale Writing Paper
Printable Fairy Tale Writing PaperPrintable Fairy Tale Writing Paper
Printable Fairy Tale Writing Paper
Rhonda Cetnar
 
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
Sambit Praharaj
 
Empathic Mixed Reality
Empathic Mixed RealityEmpathic Mixed Reality
Empathic Mixed Reality
Thammathip Piumsomboon
 
Affective computing
Affective computingAffective computing
Affective computingAnkit Moonka
 
The (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software EngineeringThe (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software Engineering
Margaret-Anne Storey
 
Activity Systems Analysis in Design Research
Activity Systems Analysis in Design ResearchActivity Systems Analysis in Design Research
Activity Systems Analysis in Design Research
Lisa Yamagata-Lynch
 
Redes Sociales Online ¿Por qué compartimos?
Redes Sociales Online ¿Por qué compartimos?Redes Sociales Online ¿Por qué compartimos?
Redes Sociales Online ¿Por qué compartimos?Javier Velasco, PhD
 
Web Science Session 2: Social Media
Web Science Session 2: Social MediaWeb Science Session 2: Social Media
Web Science Session 2: Social Media
Stefanie Panke
 
Mediating Personal Relationships with Robotic Pets for Fostering Human-Human...
Mediating Personal Relationships with Robotic Pets  for Fostering Human-Human...Mediating Personal Relationships with Robotic Pets  for Fostering Human-Human...
Mediating Personal Relationships with Robotic Pets for Fostering Human-Human...
Delong Du
 
New research articles 2020 december issue- international journal of compute...
New research articles   2020 december issue- international journal of compute...New research articles   2020 december issue- international journal of compute...
New research articles 2020 december issue- international journal of compute...
AIRCC Publishing Corporation
 
inclusive networks
inclusive networksinclusive networks
inclusive networks
Joe Gerstandt
 
Human Robot Interaction
Human Robot InteractionHuman Robot Interaction
Human Robot Interaction
ijtsrd
 

Similar to The Rise of Emotion-aware Conversational Agents: Threats in Digital Emotions (20)

Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
Sentiment Analysis of Social Media Content: A multi-tool for listening to you...
 
Eddie Turner - PCMA Convene (June 2010)
Eddie Turner - PCMA Convene (June 2010)Eddie Turner - PCMA Convene (June 2010)
Eddie Turner - PCMA Convene (June 2010)
 
Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008
 
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
Simone Scardapane - The dark side of deep learning - Codemotion Milan 2017
 
Communication between open source developers
Communication between open source developersCommunication between open source developers
Communication between open source developers
 
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
Chatbot in a Campus Enviroment: Design of LiSA, a Virtual Assistant To Help S...
 
計算社會科學初探- 當電腦科學家遇上社會科學
計算社會科學初探-當電腦科學家遇上社會科學計算社會科學初探-當電腦科學家遇上社會科學
計算社會科學初探- 當電腦科學家遇上社會科學
 
Proactive Displays IIIA 20080627
Proactive Displays IIIA 20080627Proactive Displays IIIA 20080627
Proactive Displays IIIA 20080627
 
Printable Fairy Tale Writing Paper
Printable Fairy Tale Writing PaperPrintable Fairy Tale Writing Paper
Printable Fairy Tale Writing Paper
 
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
Multimodal Analytics for Real-time Feedback in Co-located Collaboration, EC-T...
 
Empathic Mixed Reality
Empathic Mixed RealityEmpathic Mixed Reality
Empathic Mixed Reality
 
Affective computing
Affective computingAffective computing
Affective computing
 
The (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software EngineeringThe (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software Engineering
 
Activity Systems Analysis in Design Research
Activity Systems Analysis in Design ResearchActivity Systems Analysis in Design Research
Activity Systems Analysis in Design Research
 
Redes Sociales Online ¿Por qué compartimos?
Redes Sociales Online ¿Por qué compartimos?Redes Sociales Online ¿Por qué compartimos?
Redes Sociales Online ¿Por qué compartimos?
 
Web Science Session 2: Social Media
Web Science Session 2: Social MediaWeb Science Session 2: Social Media
Web Science Session 2: Social Media
 
Mediating Personal Relationships with Robotic Pets for Fostering Human-Human...
Mediating Personal Relationships with Robotic Pets  for Fostering Human-Human...Mediating Personal Relationships with Robotic Pets  for Fostering Human-Human...
Mediating Personal Relationships with Robotic Pets for Fostering Human-Human...
 
New research articles 2020 december issue- international journal of compute...
New research articles   2020 december issue- international journal of compute...New research articles   2020 december issue- international journal of compute...
New research articles 2020 december issue- international journal of compute...
 
inclusive networks
inclusive networksinclusive networks
inclusive networks
 
Human Robot Interaction
Human Robot InteractionHuman Robot Interaction
Human Robot Interaction
 

More from Martino Mensio

Towards a Cross-Article Narrative Comparison of News
Towards a Cross-Article Narrative Comparison of NewsTowards a Cross-Article Narrative Comparison of News
Towards a Cross-Article Narrative Comparison of News
Martino Mensio
 
Detecting subtle text manipulations
Detecting subtle text manipulationsDetecting subtle text manipulations
Detecting subtle text manipulations
Martino Mensio
 
News Source Credibility in the Eyes of Different Assessors
News Source Credibility in the Eyes of Different AssessorsNews Source Credibility in the Eyes of Different Assessors
News Source Credibility in the Eyes of Different Assessors
Martino Mensio
 
A Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
A Multi-layer LSTM-based Approach for Robot Command Interaction ModelingA Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
A Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
Martino Mensio
 
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
Martino Mensio
 
Deep Semantic Learning for Conversational Agents
Deep Semantic Learning for Conversational AgentsDeep Semantic Learning for Conversational Agents
Deep Semantic Learning for Conversational Agents
Martino Mensio
 
Deep Learning per la Comprensione del Linguaggio Naturale - HKN
Deep Learning per la Comprensione del Linguaggio Naturale - HKNDeep Learning per la Comprensione del Linguaggio Naturale - HKN
Deep Learning per la Comprensione del Linguaggio Naturale - HKN
Martino Mensio
 

More from Martino Mensio (7)

Towards a Cross-Article Narrative Comparison of News
Towards a Cross-Article Narrative Comparison of NewsTowards a Cross-Article Narrative Comparison of News
Towards a Cross-Article Narrative Comparison of News
 
Detecting subtle text manipulations
Detecting subtle text manipulationsDetecting subtle text manipulations
Detecting subtle text manipulations
 
News Source Credibility in the Eyes of Different Assessors
News Source Credibility in the Eyes of Different AssessorsNews Source Credibility in the Eyes of Different Assessors
News Source Credibility in the Eyes of Different Assessors
 
A Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
A Multi-layer LSTM-based Approach for Robot Command Interaction ModelingA Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
A Multi-layer LSTM-based Approach for Robot Command Interaction Modeling
 
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-or...
 
Deep Semantic Learning for Conversational Agents
Deep Semantic Learning for Conversational AgentsDeep Semantic Learning for Conversational Agents
Deep Semantic Learning for Conversational Agents
 
Deep Learning per la Comprensione del Linguaggio Naturale - HKN
Deep Learning per la Comprensione del Linguaggio Naturale - HKNDeep Learning per la Comprensione del Linguaggio Naturale - HKN
Deep Learning per la Comprensione del Linguaggio Naturale - HKN
 

Recently uploaded

DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
Wasswaderrick3
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
ChetanK57
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
muralinath2
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
tonzsalvador2222
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
IshaGoswami9
 
ISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
ISI 2024: Application Form (Extended), Exam Date (Out), EligibilityISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
ISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
SciAstra
 
Nutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technologyNutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technology
Lokesh Patil
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
fafyfskhan251kmf
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
frank0071
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Erdal Coalmaker
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
AlaminAfendy1
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
zeex60
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
Abdul Wali Khan University Mardan,kP,Pakistan
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
SAMIR PANDA
 
bordetella pertussis.................................ppt
bordetella pertussis.................................pptbordetella pertussis.................................ppt
bordetella pertussis.................................ppt
kejapriya1
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Sérgio Sacani
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
RenuJangid3
 

Recently uploaded (20)

DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
 
ISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
ISI 2024: Application Form (Extended), Exam Date (Out), EligibilityISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
ISI 2024: Application Form (Extended), Exam Date (Out), Eligibility
 
Nutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technologyNutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technology
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
 
bordetella pertussis.................................ppt
bordetella pertussis.................................pptbordetella pertussis.................................ppt
bordetella pertussis.................................ppt
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
 

The Rise of Emotion-aware Conversational Agents: Threats in Digital Emotions

  • 1. The Rise of Emotion-aware Conversational Agents: Threats in Digital Emotions Martino Mensio Giuseppe Rizzo Maurizio Morisio #RCBlackMirror2018 @ WWW2018 24 April 2018 Lyon, FR
  • 2. Objective - analyze theoretical advances enabling Conversational Agents - analyze emotional side-effects of user-centricity Considering similarities with Black Mirror episodes and other real-world examples 2
  • 3. Main episode of inspiration s02e01 Be Right Back: a person “reconstructed” from digital traces - different interaction channels - emotional attachment to bots - free will, autonomy and ethics [1] 3 [1] Moor, J. (2009). Four kinds of ethical robots. Philosophy Now, 72, 12-14.
  • 6. Background: stage #1 Textual interaction 6 [2] Serban, I. V., Sordoni, A., Bengio, Y., Courville, A. C., & Pineau, J. (2016, February). Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models. In AAAI (Vol. 16, pp. 3776-3784).
  • 7. Background: stage #2 Voice interaction 7 speech-to-text and text to speech voice imitation capabilities tonal features in input/output
  • 8. Background: stage #3 Embodied agent 8 body movements facial expression humanoid robots: Sophia [3] Nadine [4] [3] http://www.hansonrobotics.com/robot/sophia/ [4] http://bit.ly/telegraph_knapton_nadine
  • 9. Background: additional ingredients - topic focus [5] - persona-based generation[6] - emotions (recognise, process, simulate) [7] - channel specific features 9 [5] Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, and Wei-Ying Ma. 2017. Topic Aware Neural Response Generation.. In AAAI, Vol. 17. 3351–3357. [6] Jiwei Li, Michel Galley, Chris Brockett, Georgios P Spithourakis, Jianfeng Gao, and Bill Dolan. 2016. A persona-based neural conversation model. The 54th Annual Meeting of the Association for Computational Linguistics 1, 994–1003. CL Lisetti. 1998. Affective computing. (1998). [7] https://cakechat.replika.ai/
  • 10. Background: Replika example [8] https://www.youtube.com/watch?v=yQGqMVuAk04 10
  • 12. Short-term therapeutic effect 12 Someone who: - always listens to you - always agrees - never complains - available on-demand Provides: - relief - self-consciousness
  • 13. Addiction - “race for attention” [9] - escape from reality 13 [9] http://bit.ly/ted_harris_talk
  • 14. Isolation 14 - side effects of tools that should enable more connections - hikikomori - virtual friends can make the situation worse
  • 15. Personality change 15 Big Five Personality Traits [10] - openness reduction ← “filter bubble” - extraversion reduction ← isolation Could be measured specifically for Conversational Agents [10] Goldberg, L. R. (1993). The structure of phenotypic personality traits. American psychologist, 48(1), 26.
  • 16. Societal implication inability to connect with other people 16
  • 17. Conclusions - Conversational Agents should be tools, not substitute human relationships - need for regulation on the emotional field 17
  • 18. Let’s keep emotions for humans https://www.slideshare.net/MartinoMensio https://twitter.com/MartinoMensio 18