SlideShare a Scribd company logo
Building Systems to
{Capture | Measure | Use}
Emotions and Personality
@neal_lathia
cambridge computer lab, uk
#umap2013 rome, italy. june 2013
----- disclaimer -----
affective computing:
“relates to, arises from, or influences emotions” …
user modeling:
“systems that adapt […] based on an internal
representation of the user”
affective computing:
“relates to, arises from, or influences emotions” …
user modeling:
“systems that adapt […] based on an internal
representation of the user”
1. what role do emotions play in personalised, user-
model based systems?
2. can we measure emotion accurately?
3. what can we compute using (representations of)
emotion and personality?
1. what role do emotions play in personalised, user-
model based systems?
recommender systems
PhD: “does our research match deployed reality?”
(user modeling)
research: (mostly) driven by off-line studies
practice: (definitely) driven for recurring interaction
research: simulate recurring interaction with one of
three surveys. note: one survey did not change its
recommendations.
result (expected): people prefer those
recommendations that are diverse and change over
time.
research: let's build this into recsys & see how it
affects quantitative metrics.
N. Lathia, S. Hailes, L. Capra, X. Amatriain. “Temporal Diversity in
Recommender Systems.” in ACM SIGIR 2010, Geneva, Switzerland.
result (unexpected):
“there is a bug in your system.. it sux […]”
“i used to work for [famous recsys company];
building a recommender system is not hard...”
– angry, frustrated; low ratings may encode
“punishing” a system (beyond preference)
lesson?
personalized systems and users' emotions will
never be mutually exclusive
… or even uni-directional (more ahead)
2. can we measure emotion accurately?
what are we measuring? how do we measure it?
“people might be said to have an implicit theory of
emotions […] laymen's cognitive representation of
emotion is presumably implicit in the sense that few
if any could explicitly state their conceptual
framework...”
- Russel (1980)
J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social
Psychology. Vol 39, No. 6. 1980.
“...investigators who have factor analyzed self-
reported affective states have typically concluded
that there are between six and twelve independent
monopolar factors of affect...”
- Russel (1980)
J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social
Psychology. Vol 39, No. 6. 1980.
users are being asked to perform two separate
tasks: (1) estimate, based on self-knowledge, and
(2) translate onto a rating scale... and this
sometimes causes problems*
* X. Amatriain, J. Pujol, N. Oliver. “I Like It.. I Like It Not... Measuring Users Ratings
Noise in Recommender Systems.” In UMAP 2009, Trento, Italy
2. can we measure emotion accurately solicit quick,
meaningful representations of emotions?
angry anxious lonely
relaxedenthusiasticcalm
early results: consistent, highly correlated usage of
the affect grid.
but.. not everyone is using it correctly;
predictions of r (adjective) ~ (x, y, ….) ongoing
and, more importantly...
an earlier study (22 participants, 4 weeks)
experimented with the question “when do we ask
users how they feel?”.
N. Lathia, K. Rachuri, C. Mascolo, P. Rentfrow. Contextual Dissonance: Design Bias in
Sensor-Based Experience Sampling Methods. To appear, ACM Ubicomp 2013, Zurich,
Switzerland.
[…] negative affect ratings [...] were significantly
different from one another with at least 90%
confidence […] we observe that our design
parameters influence the outcome...
lesson?
the emotion and behaviours you measure ~ how
you measure them
3. what can we compute using (representations of)
emotion and personality?
affect classification: how is the user feeling?
rating prediction: what rating would the user give?
affect classification ~ rating prediction
fun research task, but how useful?
what about recommending stuff?
users items
preferences
searching for “context” ...
“...the specifics of the context surrounding people’s
day-to-day living are much more subtle, fluid and
idiosyncratic than theories of context have led us to
believe...”
- Y. Rogers
Y. Rogers. Moving on from Weiser's Vision of Calm Computing: Engaging Ubicomp
Experiences. In ACM Ubicomp 2006. Orange County, USA
users items
preferences
trait
state
users
preferences?
state
trait
preferences?
items
users
preferences?
state
trait
preferences?
items
data we have (not Emotion Sense!):
personality scores, music listening histories
early results: augmenting music recommendation
algorithms with personality data improves average
ranking by more than 10%
but.. this still doesn't seem to outperform just
“working harder” with the rating data
1. what role do emotions play in personalised, user-
model based systems?
2. can we measure emotion accurately?
3. what can we compute using (representations of)
emotion and personality?
References
1. R. W. Picard. Affective Computing. M.I.T Media Laboratory Perceptual Computing
Section Technical Report No. 321
2. N. Lathia, S. Hailes, L. Capra, X. Amatriain. Temporal Diversity in Recommender
Systems. In ACM SIGIR 2010, Geneva, Switzerland.
3. J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social
Psychology. Vol 39, No. 6. 1980.
4. X. Amatriain, J. Pujol, N. Oliver. “I Like It.. I Like It Not... Measuring Users Ratings
Noise in Recommender Systems.” In UMAP 2009, Trento, Italy
5. N. Lathia, K. Rachuri, C. Mascolo, P. Rentfrow. Contextual Dissonance: Design
Bias in Sensor-Enhanced Experience Sampling Methods. To appear, ACM Ubicomp
2013. Zurich, Switzerland.
6. Y. Rogers. Moving on from Weiser's Vision of Calm Computing: Engaging
Ubicomp Experiences. In ACM Ubicomp 2006. Orange County, USA

More Related Content

Similar to Building Systems to Capture, Measure, and Use Emotions and Personality

Applied game design 2 analysis
Applied game design 2 analysisApplied game design 2 analysis
Applied game design 2 analysisharlequinade
 
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious GamesPeggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
SeriousGamesAssoc
 
Agent-Based Modeling for Sociologists
Agent-Based Modeling for SociologistsAgent-Based Modeling for Sociologists
Agent-Based Modeling for Sociologists
Simone Gabbriellini
 
Affective computing in modelling human emotions
Affective computing in modelling human emotionsAffective computing in modelling human emotions
Affective computing in modelling human emotions
AnannyaS
 
Sentiment Analysis on Amazon Movie Reviews Dataset
Sentiment Analysis on Amazon Movie Reviews DatasetSentiment Analysis on Amazon Movie Reviews Dataset
Sentiment Analysis on Amazon Movie Reviews Dataset
Maham F'Rajput
 
ZMET Technique In Marketing Research
ZMET Technique In Marketing ResearchZMET Technique In Marketing Research
ZMET Technique In Marketing ResearchTaylan Demirkaya
 
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
IJMER
 
How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men
Matthijs Pontier
 
Social responses to computers
Social responses to computersSocial responses to computers
Social responses to computers
Stanford University
 
Can abstraction lead to intelligence?
Can abstraction lead to intelligence?Can abstraction lead to intelligence?
Can abstraction lead to intelligence?
Dr Janet Bastiman
 
Can we predict your sentiments by listening to your peers?
Can we predict your sentiments by listening to your peers?Can we predict your sentiments by listening to your peers?
Can we predict your sentiments by listening to your peers?
International Federation for Information Technologies in Travel and Tourism (IFITT)
 
Patterns based information systems organization (@ InFuture 2015)
Patterns based information systems organization (@ InFuture 2015) Patterns based information systems organization (@ InFuture 2015)
Patterns based information systems organization (@ InFuture 2015)
Sergej Lugovic
 
The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauni
Mirjam Eladhari
 
IRJET- Deep Neural Network based Mechanism to Compute Depression in Socia...
IRJET-  	  Deep Neural Network based Mechanism to Compute Depression in Socia...IRJET-  	  Deep Neural Network based Mechanism to Compute Depression in Socia...
IRJET- Deep Neural Network based Mechanism to Compute Depression in Socia...
IRJET Journal
 
Bpra1751
Bpra1751Bpra1751
Bpra1751
ericprabu
 
Bpra1751
Bpra1751Bpra1751
Bpra1751
ericprabu
 
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
YONG ZHENG
 
Believable virtual social interactions 2
Believable virtual social interactions 2Believable virtual social interactions 2
Believable virtual social interactions 2
UCL Interaction Centre
 

Similar to Building Systems to Capture, Measure, and Use Emotions and Personality (20)

Applied game design 2 analysis
Applied game design 2 analysisApplied game design 2 analysis
Applied game design 2 analysis
 
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious GamesPeggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
Peggy Wu - Incorporating Psychology Theories into Simulations & Serious Games
 
Agent-Based Modeling for Sociologists
Agent-Based Modeling for SociologistsAgent-Based Modeling for Sociologists
Agent-Based Modeling for Sociologists
 
Affective computing in modelling human emotions
Affective computing in modelling human emotionsAffective computing in modelling human emotions
Affective computing in modelling human emotions
 
Sentiment Analysis on Amazon Movie Reviews Dataset
Sentiment Analysis on Amazon Movie Reviews DatasetSentiment Analysis on Amazon Movie Reviews Dataset
Sentiment Analysis on Amazon Movie Reviews Dataset
 
ZMET Technique In Marketing Research
ZMET Technique In Marketing ResearchZMET Technique In Marketing Research
ZMET Technique In Marketing Research
 
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
 
How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men
 
Social responses to computers
Social responses to computersSocial responses to computers
Social responses to computers
 
Can abstraction lead to intelligence?
Can abstraction lead to intelligence?Can abstraction lead to intelligence?
Can abstraction lead to intelligence?
 
Can we predict your sentiments by listening to your peers?
Can we predict your sentiments by listening to your peers?Can we predict your sentiments by listening to your peers?
Can we predict your sentiments by listening to your peers?
 
Patterns based information systems organization (@ InFuture 2015)
Patterns based information systems organization (@ InFuture 2015) Patterns based information systems organization (@ InFuture 2015)
Patterns based information systems organization (@ InFuture 2015)
 
Blue eye
Blue eyeBlue eye
Blue eye
 
The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauni
 
IRJET- Deep Neural Network based Mechanism to Compute Depression in Socia...
IRJET-  	  Deep Neural Network based Mechanism to Compute Depression in Socia...IRJET-  	  Deep Neural Network based Mechanism to Compute Depression in Socia...
IRJET- Deep Neural Network based Mechanism to Compute Depression in Socia...
 
Bpra1751
Bpra1751Bpra1751
Bpra1751
 
Mind reading ppt
Mind reading pptMind reading ppt
Mind reading ppt
 
Bpra1751
Bpra1751Bpra1751
Bpra1751
 
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
 
Believable virtual social interactions 2
Believable virtual social interactions 2Believable virtual social interactions 2
Believable virtual social interactions 2
 

More from Neal Lathia

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)
Neal Lathia
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)
Neal Lathia
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer support
Neal Lathia
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions Faster
Neal Lathia
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, Faster
Neal Lathia
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised Experiences
Neal Lathia
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised Travel
Neal Lathia
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation Engine
Neal Lathia
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product Managers
Neal Lathia
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital Health
Neal Lathia
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily Life
Neal Lathia
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone Data
Neal Lathia
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self Meetup
Neal Lathia
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealth
Neal Lathia
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport
Neal Lathia
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to Deployment
Neal Lathia
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Neal Lathia
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeNeal Lathia
 
The Ubhave Framework
The Ubhave FrameworkThe Ubhave Framework
The Ubhave Framework
Neal Lathia
 
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling MethodsContextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
Neal Lathia
 

More from Neal Lathia (20)

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer support
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions Faster
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, Faster
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised Experiences
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised Travel
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation Engine
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product Managers
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital Health
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily Life
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone Data
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self Meetup
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealth
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to Deployment
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily Life
 
The Ubhave Framework
The Ubhave FrameworkThe Ubhave Framework
The Ubhave Framework
 
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling MethodsContextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods
 

Recently uploaded

GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 

Recently uploaded (20)

GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 

Building Systems to Capture, Measure, and Use Emotions and Personality

  • 1. Building Systems to {Capture | Measure | Use} Emotions and Personality @neal_lathia cambridge computer lab, uk #umap2013 rome, italy. june 2013
  • 3. affective computing: “relates to, arises from, or influences emotions” … user modeling: “systems that adapt […] based on an internal representation of the user”
  • 4. affective computing: “relates to, arises from, or influences emotions” … user modeling: “systems that adapt […] based on an internal representation of the user”
  • 5. 1. what role do emotions play in personalised, user- model based systems? 2. can we measure emotion accurately? 3. what can we compute using (representations of) emotion and personality?
  • 6. 1. what role do emotions play in personalised, user- model based systems?
  • 7. recommender systems PhD: “does our research match deployed reality?” (user modeling)
  • 8. research: (mostly) driven by off-line studies practice: (definitely) driven for recurring interaction
  • 9. research: simulate recurring interaction with one of three surveys. note: one survey did not change its recommendations.
  • 10. result (expected): people prefer those recommendations that are diverse and change over time. research: let's build this into recsys & see how it affects quantitative metrics. N. Lathia, S. Hailes, L. Capra, X. Amatriain. “Temporal Diversity in Recommender Systems.” in ACM SIGIR 2010, Geneva, Switzerland.
  • 11. result (unexpected): “there is a bug in your system.. it sux […]” “i used to work for [famous recsys company]; building a recommender system is not hard...” – angry, frustrated; low ratings may encode “punishing” a system (beyond preference)
  • 12. lesson? personalized systems and users' emotions will never be mutually exclusive … or even uni-directional (more ahead)
  • 13. 2. can we measure emotion accurately? what are we measuring? how do we measure it?
  • 14. “people might be said to have an implicit theory of emotions […] laymen's cognitive representation of emotion is presumably implicit in the sense that few if any could explicitly state their conceptual framework...” - Russel (1980) J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social Psychology. Vol 39, No. 6. 1980.
  • 15. “...investigators who have factor analyzed self- reported affective states have typically concluded that there are between six and twelve independent monopolar factors of affect...” - Russel (1980) J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social Psychology. Vol 39, No. 6. 1980.
  • 16. users are being asked to perform two separate tasks: (1) estimate, based on self-knowledge, and (2) translate onto a rating scale... and this sometimes causes problems* * X. Amatriain, J. Pujol, N. Oliver. “I Like It.. I Like It Not... Measuring Users Ratings Noise in Recommender Systems.” In UMAP 2009, Trento, Italy
  • 17. 2. can we measure emotion accurately solicit quick, meaningful representations of emotions?
  • 18.
  • 19.
  • 20.
  • 21.
  • 23. early results: consistent, highly correlated usage of the affect grid. but.. not everyone is using it correctly; predictions of r (adjective) ~ (x, y, ….) ongoing and, more importantly...
  • 24. an earlier study (22 participants, 4 weeks) experimented with the question “when do we ask users how they feel?”.
  • 25. N. Lathia, K. Rachuri, C. Mascolo, P. Rentfrow. Contextual Dissonance: Design Bias in Sensor-Based Experience Sampling Methods. To appear, ACM Ubicomp 2013, Zurich, Switzerland. […] negative affect ratings [...] were significantly different from one another with at least 90% confidence […] we observe that our design parameters influence the outcome...
  • 26. lesson? the emotion and behaviours you measure ~ how you measure them
  • 27. 3. what can we compute using (representations of) emotion and personality?
  • 28. affect classification: how is the user feeling? rating prediction: what rating would the user give?
  • 29. affect classification ~ rating prediction fun research task, but how useful? what about recommending stuff?
  • 31. “...the specifics of the context surrounding people’s day-to-day living are much more subtle, fluid and idiosyncratic than theories of context have led us to believe...” - Y. Rogers Y. Rogers. Moving on from Weiser's Vision of Calm Computing: Engaging Ubicomp Experiences. In ACM Ubicomp 2006. Orange County, USA
  • 34. users preferences? state trait preferences? items data we have (not Emotion Sense!): personality scores, music listening histories
  • 35. early results: augmenting music recommendation algorithms with personality data improves average ranking by more than 10% but.. this still doesn't seem to outperform just “working harder” with the rating data
  • 36. 1. what role do emotions play in personalised, user- model based systems? 2. can we measure emotion accurately? 3. what can we compute using (representations of) emotion and personality?
  • 37. References 1. R. W. Picard. Affective Computing. M.I.T Media Laboratory Perceptual Computing Section Technical Report No. 321 2. N. Lathia, S. Hailes, L. Capra, X. Amatriain. Temporal Diversity in Recommender Systems. In ACM SIGIR 2010, Geneva, Switzerland. 3. J. A. Russel. A Circumplex Model of Affect. Journal of Personality and Social Psychology. Vol 39, No. 6. 1980. 4. X. Amatriain, J. Pujol, N. Oliver. “I Like It.. I Like It Not... Measuring Users Ratings Noise in Recommender Systems.” In UMAP 2009, Trento, Italy 5. N. Lathia, K. Rachuri, C. Mascolo, P. Rentfrow. Contextual Dissonance: Design Bias in Sensor-Enhanced Experience Sampling Methods. To appear, ACM Ubicomp 2013. Zurich, Switzerland. 6. Y. Rogers. Moving on from Weiser's Vision of Calm Computing: Engaging Ubicomp Experiences. In ACM Ubicomp 2006. Orange County, USA