SlideShare a Scribd company logo
1 of 63
The Challenges of Affect Detection
in the Social Programmer
Ecosystem
Nicole NOVIELLI
COLLAB, Collaborative Development Group
Dipartimento di Informatica
Università degli Studi di Bari ‘Aldo Moro’
Outline
• Motivation
• Studying Affect in SE
• A preliminary investigation
• Open Challenges
University of Bari
• Since 1924
• 2nd largest university of South Italy
•  60,000 students,  1,500 professors,  1,400 employees
• 4 main campuses: Science and Engineering, Economics, Law and
Humanities, Medicine
People at Collab
• Faculty
– Filippo Lanubile
– Fabio Calefato
– Nicole Novielli
• Research Assistants
– Alessandro Natilla
• Graduate Students
• Final-year undergraduate students
Collaborative Development Group
Department of Computer Science - collab.di.uniba.it
Research at COLLAB
• Distributed Development
– Addressing the problem of distance in distributed
workgroups
• Collaborative / Global / Social Software
Engineering
– Special focus on software development as an intense
collaborative process
• Programmers cooperate, directly or indirectly
• Massive adoption of social media and rise of the ‘social programmer’ (Storey, ‘12)
and the surrounding ecosystem
From: A. Begel, T. Zimmermann. Analyze This! 145 Questions for Data Scientists in Software Engineering, ICSE 2014
Microsoft’s Top 10 Questions Essential
Essential +
Worthwhile
1. How do users typically use my application? 80.0% 99.2%
2. What parts of a software product are most used and/or
loved by customers?
72.0% 98.5%
3. How effective are the quality gates we run at checkin? 62.4% 96.6%
4. How can we improve collaboration and sharing
between teams?
54.5% 96.4%
5. What are the best key performance indicators (KPIs) for
monitoring services?
53.2% 93.6%
6. What is the impact of a code change or requirements
change to the project and its tests?
52.1% 94.0%
7. What is the impact of tools on productivity? 50.5% 97.2%
8. How do I avoid reinventing the wheel by sharing and/or
searching for code?
50.0% 90.9%
9. What are the common patterns of execution in my application? 48.7% 96.6%
10. How well does test coverage correspond to actual code
usage by our customers?
48.7% 92.0%
The Role of Affect
• Emotion Awareness in Social Software
Engineering
– Do emotions affect the outcome of collaboration?
– How to deal with troubles in emotion communication
in computer-mediated interaction?
– How to appropriately convey sentiment through text?
Studying Emotions in Software
Engineering
Studying Emotions in Software Engineering
MSR‘15
Mining Successful
Answers in Stack
Overflow (Calefato et al.)
Peer J ‘13
Happy software
developers solve
problems better
Peer J
(Graziotin et al.)
ESEC/FSE ‘13
Towards
emotional
awareness in
software
development
teams.
(Guzman and Bruegge)
ICSE‘15
Stuck and
Frustrated or In
Flow and Happy:
Sensing
Developers’
Emotions and
Progress.
(Muller and Fritz)
MSR ‘14
Sentiment analysis of commit
comments in GitHub: an
empirical study (Guzman et al.)
RE‘14
How Do Users
Like this
Feature? A Fine
Grained
Sentiment
Analysis of App
Reviews
(Guzman and Maalej)
Security and emotion: sentiment
analysis of security discussions
on GitHub (Pletea et al.)
CHASE ‘15
Exploring Causes of
Frustration for Software
Developers.
(Ford and Parnin)
Towards emotion-based
collaborative software
engineering
(Dewan)
Do developers feel emotions?
(Murgia et al.)
Are Bullies More
Productive? Empirical
Study of Affectiveness
vs. Issue Fixing Time
(Ortu et al.)
SCAM‘15
Recommending
insightful comments
for source code using
crowdsourced
knowledge. Source
Code Analysis and
Manipulation
(Rahman et al.)
2013 2014 2015
• Annotation study on the Apache Software
Foundation issue tracking system
– Wide range of both positive and negative emotions
Murgia et al., 2014 – Do developers feel emotions? An exploratiory analysis of emotions in software artifacts. MSR 2014.
Do Developers Feel
Emotions?
Thanks for your input! You're, like, awesome.
I'm happy with the approach and the code looks good
I will come over to your work and slap you
Sorry for the delay Stephen
• Survey of 45 software developers
– For 67% frustration is a severe problem
• Learning barriers are a major cause of
frustration
– New programming tools and languages
– New projects
– Unavailability of resources
• High cognitive complexity and time pressure
– Misinterpretation of the task
– Size of task, high cognitive complexity
– Limited time, task less simple than expected
Ford and Parnin, 2015. Exploring Causes of Frustration for Software Developers. CHASE ’15.
Exploring Causes of
Frustration for Developers
Do emotions affect
performance? (1/3)
• Positive mood improves debugging
performance
• Positive mood induced through physical
exercises
Khan et al. 2011 - Do moods affect programmers’ debug performance? Cognition, Technology & Work
Do emotions affect
performance? (2/3)
• Emotions is associated to issue tracking
activity
– More comments and watchers for issue where
Sadness is expressed
– Higher fixing time when negative emotions are
expressed
Murgia et al., 2014 – Do developers feel emotions? An exploratiory analysis of emotions in software artifacts. MSR 2014.
• Emotion and cognition
– Developers constantly face problem-solving tasks
– Analysis and creativity skills are required
– Emotions and moods deeply influence cognitive
processing abilities and performance
Do emotions affect
performance? (3/3)
Graziotin et al., 2013 - Happy software developers solve problems better: psychological measurements in
empirical software engineering. Peer J
- Google Careers - http://www.google.com/about/careers/lifeatgoogle/benefits/ Last accessed: Jan 2016.
Affective Computing as a New Method
for Empirical Software Engineering
Multimodal recognition of
affective states
• Biometric measurements
- Empatica – www.empatica.com
- Bos, EEG-based Emotion Recognition - Human Media Interaction
Need for individual training for
each user
Multimodal recognition of
affective states
• Biometric measurements
• Facial expression analysis
Multimodal recognition of
affective states
• Biometric measurements
• Facial expression analysis
• Affective natural language processing
Multimodal recognition of
affective states
• Biometric measurements
• Facial expression analysis
• Affective natural language processing
• Social signal processing (multimodal)
A.Vinciarelli, M.Pantic, D.Heylen, C.Pelachaud, I.Poggi, F.D’Errico and M.Schroeder, 2012. “Bridging the Gap Between
Social Animal and Unsocial Machine: A Survey of Social Signal Processing“, IEEE Transactions on Affective Computing.
F.D’Errico, I.Poggi, A.Vinciarelli and L.Vincze (eds.), 2015. Conflict and Multimodal Communication
- Negotiation and conflicts
- Communication effectiveness
- Role recognition
- Display of status
- Power relationships and
dominance
- Automatic personality perception
Affective computing as a
new method for SE (1/3)
• Sensing affect from biometric measures
• Recognizing “in flow” vs. stuck developers
– In flow developers should not be disturbed
– Stuck developers need recommendations
Muller and Fritz, 2015 - Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and
Progress. ICSE 2015
EEG sensor
Wrist band
Eye
tracking
Affective computing as a
new method for SE (2/3)
• Affective natural language processing
• Software requirements evolution
– Feature-based sentiment analysis of app reviews
(Guzman and Maalej, 2015)
• Crowdsourced documentation
– Exploiting sentiment polarity to assess usefulness
of comments in Stack Overflow
(Rahman et al., 2015)
Guzman and Maalej, 2015 - How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App
Reviews - Requirements Engineering Conference (RE), 2014
Rahman et al., 2015 - Recommending insightful comments for source code using crowdsourced knowledge.
Source Code Analysis and Manipulation (SCAM), 2015
Affective computing as a
new method for SE (3/3)
• Affective natural language processing
• Improve team collaboration
– Sentiment analysis of communication artifacts for
emotional awareness in development teams
(Guzman and Bruegge, 2013)
• Crowdsourced knowledge
– Investigating the role played by emotions in
success of information seeking in community-
based Question & Answering (Calefato et al., 2015)
Guzman and Bruegge, 2013. Towards emotional awareness in software development teams. ESEC/FSE 2013.
Calefato et al., 2015. Mining Successful Answers in Stack Overflow. MSR, 2015.
How can we model and detect emotions?
How can we model and detect emotions?
MSR‘15
Mining Successful
Answers in Stack
Overflow (Calefato et al.)
Peer J ‘13
Happy software
developers solve
problems better
Peer J
(Graziotin et al.)
ESEC/FSE ‘13
Towards
emotional
awareness in
software
development
teams.
(Guzman and Bruegge)
ICSE‘15
Stuck and
Frustrated or In
Flow and Happy:
Sensing
Developers’
Emotions and
Progress.
(Muller and Fritz)
MSR ‘14
Sentiment analysis of commit
comments in GitHub: an
empirical study (Guzman et al.)
RE‘14
How Do Users
Like this
Feature? A Fine
Grained
Sentiment
Analysis of App
Reviews
(Guzman and Maalej)
Security and emotion: sentiment
analysis of security discussions
on GitHub (Pletea et al.)
CHASE ‘15
Exploring Causes of
Frustration for Software
Developers.
(Ford and Parnin)
Towards emotion-based
collaborative software
engineering
(Dewan)
Do developers feel emotions?
(Murgia et al.)
Are Bullies More
Productive? Empirical
Study of Affectiveness
vs. Issue Fixing Time
(Ortu et al.)
SCAM‘15
Recommending
insightful comments
for source code using
crowdsourced
knowledge. Source
Code Analysis and
Manipulation
(Rahman et al.)
2013 2014 2015
MSR‘15
Mining Successful
Answers in Stack
Overflow (Calefato et al.)
Peer J ‘13
Happy software
developers solve
problems better
Peer J
(Graziotin et al.)
ESEC/FSE ‘13
Towards
emotional
awareness in
software
development
teams.
(Guzman and Bruegge)
ICSE‘15
Stuck and
Frustrated or In
Flow and Happy:
Sensing
Developers’
Emotions and
Progress.
(Muller and Fritz)
MSR ‘14
Sentiment analysis of commit
comments in GitHub: an
empirical study (Guzman et al.)
RE‘14
How Do Users
Like this
Feature? A Fine
Grained
Sentiment
Analysis of App
Reviews
(Guzman and Maalej)
Security and emotion: sentiment
analysis of security discussions
on GitHub (Pletea et al.)
CHASE ‘15
Exploring Causes of
Frustration for Software
Developers.
(Ford and Parnin)
Towards emotion-based
collaborative software
engineering
(Dewan)
Do developers feel emotions?
(Murgia et al.)
Are Bullies More
Productive? Empirical
Study of Affectiveness
vs. Issue Fixing Time
(Ortu et al.)
SCAM‘15
Recommending
insightful comments
for source code using
crowdsourced
knowledge. Source
Code Analysis and
Manipulation
(Rahman et al.)
2013 2014 2015
How can we model and detect emotions?
MSR‘15
Mining Successful
Answers in Stack
Overflow (Calefato et al.)
Peer J ‘13
Happy software
developers solve
problems better
Peer J
(Graziotin et al.)
ESEC/FSE ‘13
Towards
emotional
awareness in
software
development
teams.
(Guzman and Bruegge)
ICSE‘15
Stuck and
Frustrated or In
Flow and Happy:
Sensing
Developers’
Emotions and
Progress.
(Muller and Fritz)
MSR ‘14
Sentiment analysis of commit
comments in GitHub: an
empirical study (Guzman et al.)
RE‘14
How Do Users
Like this
Feature? A Fine
Grained
Sentiment
Analysis of App
Reviews
(Guzman and Maalej)
Security and emotion: sentiment
analysis of security discussions
on GitHub (Pletea et al.)
CHASE ‘15
Exploring Causes of
Frustration for Software
Developers.
(Ford and Parnin)
Towards emotion-based
collaborative software
engineering
(Dewan)
Do developers feel emotions?
(Murgia et al.)
Are Bullies More
Productive? Empirical
Study of Affectiveness
vs. Issue Fixing Time
(Ortu et al.)
SCAM‘15
Recommending
insightful comments
for source code using
crowdsourced
knowledge. Source
Code Analysis and
Manipulation
(Rahman et al.)
2013 2014 2015
How can we model and detect emotions?
Polarity classification
• Classification of a text according to its positive,
negative or neutral semantic orientation
• Several tools available
– NLTK
• Outputs probability for each polarity class
• Trained on tweets and movie reviews
– Stanford Sentiment Analyzer
• Issues an overall polarity label + representation of the
sentence structure
• Trained on movie reviews
– SentiStrength
• Outputs a score for both positive and negative sentiment
• Designed for and validated on general purpose social media
[1] – NLTK: http://text-processing.com/
[2] – Stanford Sentiment Analyser - http://nlp.stanford.edu/sentiment/
[3] – SentiStrength - http://sentistrength.wlv.ac.uk/
Measuring the sentiment:
SentiStrength
• Estimates the strength of both positive and
negative sentiment in a text
• Robust also for informal language
• Widely employed in social computing
Input text
Positive Sentiment Score
Negative Sentiment Score
In [1,5]
In [-1,-5]
where ±1 indicates absence of pos/neg sentiment
Emotion
Lookup table
SentiStrength
abandon* -2 LIWC
abate -2 General Inquirer Feb 2010
abdicate* -2 General Inquirer Feb 2010
abhor* -4 General Inquirer Feb 2010
abject -2 General Inquirer Feb 2010
abnormal* -2 General Inquirer Feb 2010
accusation* -2 General Inquirer Feb 2010
[…]
Emotion
Lookup table
Sentiment annotation
with SentiStrength
Input text Positive Negative
Any help would be really great! :-) 5 -1
@<username> - what’s the emoticon for being
terribly embarassed!
1 -5
I have very simple and stupid trouble […] I am
pretty confused, explain please, what is wrong?
Any help would be greatly appreciated.
3 -3
What model and recognition approaches
are suitable to detect the affect of
programmers in a reliable manner?
• Which is the best model?
• How to operationalize it?
• What tools/resources are available?
It depends…
• On research goals and application domain
– Why do you want to model and detect affect?
• On the available source of data
– Sensors: biometric measurements
– Written text: natural language processing and
conversational analysis
– Speech: acoustic and prosodic features
– Cameras/Eye tracking devices: body posture, gaze,
facial analysis
Typology of Affective States
Duration++
Intensity++
Scherer, 1984. Emotion as a Multicomponent Process: A model and some cross-cultural data. In P. Shaver, ed.,
Review of Personality and Social Psych 5: 37-63.
Continuous vs. Discrete
Emotion Models (1/4)
Russel, 1980 - A circumplex model of affect. J.Personality and Social Psychology, 39, 1161-1178.
Polarity
ActivationCircumplex
Model of Affect
Continuous vs. Discrete
Emotion Models (2/4)
Ekman’s basic emotions
Anger Fear Disgust Surprise Happiness Sadness
Continuous vs. Discrete
Emotion Models (3/4)
Lazarus’ framework
Negative
Emotions
Positive
Emotions
Mixed
Emotions
anger
fright
anxiety
guilt
shame
sadness
envy
jealousy
Disgust
happiness
pride
relief
love
hope
compassion
gratitude
Based on appraisal theory
Continuous vs. Discrete
Emotion Models (4/4)
Plutchik’s
Wheel
Many others…
Goal
Example
Resources
Sentiment Analysis
Negative vs. Positive
Sentiment Strength
SentiStrength
(Thelwall et al., 2012)
SentiWordNet
(Esuli and Sebastiani, 2006)
MPQA Lexicon
(Wilson et al., 2005)
- …
‘I can't solve this problem, it’s very
frustrating’
Negative
Mining Affect from Text
Emotion Detection
Classification using Discrete
Emotion Labels
WordNet Affect
(Strapparava and Valitutti, 2004)
NRC Emotion Lexicon
(Mohammad and Turney, 2010)
Depeche Mood
(Staiano and Guerini, 2014)
- …
‘I can't solve this problem, it’s very
frustrating’
Frustrated
SentiWordNet
http://sentiwordnet.isti.cnr.it/
Esuli and Sebastiani. Sentiwordnet: A publicly available lexical resource for opinion mining. LREC 2006
Baccianella et al. SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining, LREC 2010
Scores Sense ID and gloss
as an adjective
Positive = 0.75
Negative = 0
Objective = 0.25
good#1 - Having desirable or positive
qualities especially those suitable for a
thing specified (as in ‘a good joke’)
as a noun
Positive = 0.5
Negative = 0
Objective = 0.5
good#1
benefit (as in ‘for your own good’)
Positive = 0
Negative = 0
Objective = 1
good#4
commodity, article of commerce
P N
O
Wordnet Affect
A-label Example of Synsets
EMOTION noun ‘anger’, verb ‘fear’
MOOD noun ‘animosity’, adjective ‘fear’
TRAIT noun ‘aggressiveness’, adj. ‘competitive’
COGNITIVE State noun ‘confusion’, adj. ‘dazed’
PHYSICAL State noun ‘illness’
HEDONIC Signal noun ‘hurt’, noun ‘suffering’
Emotion-eliciting SITUATION noun ‘awkwardness’
Emotional RESPONSE noun ‘cold sweat’, verb ‘tremble’
BEHAVIOR noun ‘offense’, adj. ‘inhibited’
ATTITUDE noun ‘intolerance’, noun ‘defensive’
SENSATION noun ‘coldness’, noun ‘feel’
Strapparava and Valitutti. WordNet-affect: an affective extension of WordNet. LREC 2004
Emotion Detection in the Social
Programmer Ecosystem
• Data source: written, asynchronous
communication on social media
• Goals
– To prevent negative emotion from negatively
affecting outcome of collaboration
– To support developers in appropriately convey
sentiment through text
– To exploit emotion mining for improving the creation
of crowdsourced knowledge
Research Question
• What affect model should we adopt?
• What are the main drawbacks of applying state-of-the-art
sentiment analysis techniques in the SE domain?
• What tools and linguistic resources should be used and
how can they be improved and adapted to the SE
domain?
How to reliably detect the affective states
of programmers in textual
communication artifacts?
A Preliminary Investigation
on Stack Overflow
SSE@FSE 2014 46
Stack Overflow dataset
• Questions, Answers and relative comments
from the Stack overflow official (May 2014)
• 800 items in our dataset
– We opportunistically chose items with the highest
positive and negative polarity scores (SentiStrength)
– 200 questions and 200 follow-up askers’ comments
(400 cases overall)
– 200 top answers and 200 follow-up answerers’
comments (400 additional cases).
Negative and Positive
Sentiment in Stack Overflow
Negative Sentiment detected Positive Sentiment detected
In Questions Negative attitude towards
technical issues
- Emotions such as Frustration
- Negative Opinions about, tools,
languages, IDE, etc.
Positive attitude towards technical
issues
- Positive Opinions about, tools,
languages, IDE, etc.
In Comments Negative attitude towards
technical issues
- Negative Opinions about, tools,
languages, IDE, etc.
Negative attitude towards
interlocutor
- Emotions such as Anger
Positive attitude towards technical
issues
- Positive Opinions about, tools,
languages, IDE, etc.
Positive attitude towards interlocutor
- Emotion such as Liking, Appreciation
or Gratitude
Negative attitude towards the
interlocutor
• Disliking
- ‘Didn't notice the horrid inline jQuery’
- ‘Added some instructions for the really hopeless
cases
• Anger
- ‘Do u know the answer? If not .... then u might
know how hard is homework. Ignorance is bliss’
- ‘Arrrghhh, how I hate those people who downvote
answers without leaving a comment as for why the
downvote…’
• Detecting hostile behaviour
‘Didn't notice the horrid inline jQuery’
‘Added some instructions for the really hopeless cases’
‘Do u know [the] answer ? If not .... then u might know
how hard is homework. Ignorance is bliss’
Relevant for community moderators
Negative attitude towards the
interlocutor
51 SSE ‘15
• Hostile behavior is a problem for the Stack
Exchange community
‘Do u know [the] answer ? If not .... then u might know
how hard is homework. Ignorance is bliss’
‘Didn't notice the horrid inline jQuery’
‘Added some instructions for the really hopeless cases’
Negative attitude towards the
interlocutor
Positive attitude towards the
interlocutor
• Positive polarity, positive attitude
– Gratitude
• Thanks, that helped. Case closed!
• Worked perfectly, thanks a lot
• Often positive feedback is provided for
discussion threads without an accepted answer
• ‘Thanks for the feedback, it was a pleasure!
Could please accept my answer?’
• Remind information seekers to accept useful
answers!
Calefato et al., 2015 - Mining Successful Answers in Stack Overflow. MSR 2015.s
• Frustration
– I am not sure what I did in a previous life to
warrant this, it must have been bad! I am
getting buried in a world of xml […]
– This is driving me nutz :-(
– There's no way to do this I'm afraid :(
• Negative opinions
– They use it to clean up connections, which is
really scary
– It is very painful to add multiple tickets to
Trac
– I find this incredibly annoying with
Dreamweaver
Attitude towards technical
issues
Exploiting negative affect
towards technical issues
Detect negative sentiment
Detect controversial technical issues or
questions that are not exhaustively answered
• Negative polarity, positive attitude
– Sorry-for
‘To explain my regrettably unfriendly comment
(sorry about that)’
‘I’m afraid I can’t help you any further with
this issue!’
Does polarity capture the true
sentiment? (1/2)
• Humor, an open challenge for affective NLP
• Irony
– ‘Haha that comment made me laugh my heart out.
Makes me kind of proud of how horrible my code
can be’
(positive sentiment = 3; negative sentiment = -4)
• Sarcasm
– ‘Ignorance is bliss’
(positive sentiment = 5; negative sentiment = -3)
Does polarity capture the true
sentiment? (2/2)
• Positive polarity
– Gratitude
‘Thanks for the feedback, it was a pleasure!’
• Negative polarity, positive attitude
– Sorry-for
‘I’m afraid I can’t help you any further with
this issue!’
Emotion or politeness?
True emotions might not be necessary involved!
*Politeness, ‘Behabitive’ speech acts*
Austin, 1962. How to Do Things with Words. Oxford University Press.
Domain dependence of
sentiment-analysis
• False positives in negative sentiment
detection
– Domain lexicon
‘What is the best way to kill a
critical process’
– Contextual semantics
‘I am missing a parenthesis. But where?
– Context of interaction (Q&A)
‘I have a problem, […] please explain
what is wrong’
Main findings
• Emotions emerge especially in comments
– Seen as a ‘free zone’, comments do not contribute to
reputation
• Need to distinguish between the emotions
towards somebody (i.e. the reader) vs.
something (i.e. technical issues)
– Relevant to different contexts and research goals
• Distinguish politeness from true emotions
• Domain-dependence of sentiment analysis
– Need for tuning tools and linguistic resources
Project EmoQuest
http://collab.di.uniba.it/emoquest
Investigating the Role of
Emotions in Social Q&A Sites
Investigating the Role of
Emotions in Social Q&A Sites
Impact in Computer-Supported Cooperative Work
HUMAN-COMPUTER INTERACTION
SOFTWARE ENGINEERING
PSYCHOLOGY LINGUISTICS
Project EmoQuest
http://collab.di.uniba.it/emoquest
Expected Results
AFFECTIVE COMPUTING
• Empirically-driven guidelines for emotional interface design
• Fine-grained Sentiment Analysis tools exploiting lexical semantics and
unsupervised approaches
• Real-time modeling of affect in collaboration dialogues in social media
PSYCHOLINGUISTICS
• New psycholinguistic theories and
models of social emotions in
computer-mediated interaction
APPLIED LINGUISTICS
• New models of affect expression
through language in social
computing
SOCIAL SOFTWARE ENGINEERING
• Netiquette: pragmatic and actionable synthesis for emotional awareness
• Software tools for embedding emotional intelligence into Q&A platforms
The Challenges of Affect Detection in the Social Programmer Ecosystem

More Related Content

What's hot (10)

Influencing visual judgement through affective priming
Influencing visual judgement through affective primingInfluencing visual judgement through affective priming
Influencing visual judgement through affective priming
 
User Generated Video Reviews by Hotel Guests
User Generated Video Reviews by Hotel GuestsUser Generated Video Reviews by Hotel Guests
User Generated Video Reviews by Hotel Guests
 
Brightfind world usability day 2016 full deck final
Brightfind world usability day 2016   full deck finalBrightfind world usability day 2016   full deck final
Brightfind world usability day 2016 full deck final
 
Curtis lily as cw evaluation and overall feedback sheet
Curtis lily as cw evaluation and overall feedback sheetCurtis lily as cw evaluation and overall feedback sheet
Curtis lily as cw evaluation and overall feedback sheet
 
Copy and paste for hotel mobile websites? Or: The power of screen sizes
Copy and paste for hotel mobile websites? Or: The power of screen sizesCopy and paste for hotel mobile websites? Or: The power of screen sizes
Copy and paste for hotel mobile websites? Or: The power of screen sizes
 
How do I get a job? Evidence-based advice
How do I get a job? Evidence-based adviceHow do I get a job? Evidence-based advice
How do I get a job? Evidence-based advice
 
Psychological antecedents of smartphone users behaviour along the mobile cust...
Psychological antecedents of smartphone users behaviour along the mobile cust...Psychological antecedents of smartphone users behaviour along the mobile cust...
Psychological antecedents of smartphone users behaviour along the mobile cust...
 
Exploring daily deals as a distribution channel and a potential driver of hot...
Exploring daily deals as a distribution channel and a potential driver of hot...Exploring daily deals as a distribution channel and a potential driver of hot...
Exploring daily deals as a distribution channel and a potential driver of hot...
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
 
Intro To Impact Reporting
Intro To Impact ReportingIntro To Impact Reporting
Intro To Impact Reporting
 

Similar to The Challenges of Affect Detection in the Social Programmer Ecosystem

Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges
Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open ChallengesKeynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges
Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open ChallengesNicole Novielli
 
To Label or Not? Advances and Open Challenges in SE-specific Sentiment Analysis
To Label or Not? Advances and Open Challenges in SE-specific Sentiment AnalysisTo Label or Not? Advances and Open Challenges in SE-specific Sentiment Analysis
To Label or Not? Advances and Open Challenges in SE-specific Sentiment AnalysisNicole Novielli
 
Emotions and e-learning - UOC
Emotions and e-learning - UOCEmotions and e-learning - UOC
Emotions and e-learning - UOCCarles
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Towards_multimodal_emotion_recognition_i.pdf
Towards_multimodal_emotion_recognition_i.pdfTowards_multimodal_emotion_recognition_i.pdf
Towards_multimodal_emotion_recognition_i.pdfSHEEJAMOLPT
 
RStrachanOct23.pptx
RStrachanOct23.pptxRStrachanOct23.pptx
RStrachanOct23.pptxJisc
 
Social Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategySocial Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategyPam Noreault
 
Cat Herding and Community Gardens: Practical e-Science Project Management
Cat Herding and Community Gardens: Practical e-Science Project ManagementCat Herding and Community Gardens: Practical e-Science Project Management
Cat Herding and Community Gardens: Practical e-Science Project ManagementNeil Chue Hong
 
Writing Effective NSF Proposals
Writing Effective NSF ProposalsWriting Effective NSF Proposals
Writing Effective NSF Proposalsbio-link
 
Survey on adverse influencing factors in the way of successful requirement en...
Survey on adverse influencing factors in the way of successful requirement en...Survey on adverse influencing factors in the way of successful requirement en...
Survey on adverse influencing factors in the way of successful requirement en...iosrjce
 
Design considerations for machine learning system
Design considerations for machine learning systemDesign considerations for machine learning system
Design considerations for machine learning systemAkemi Tazaki
 
Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Anne Bergen
 
A Review On Sentiment Analysis And Emotion Detection From Text
A Review On Sentiment Analysis And Emotion Detection From TextA Review On Sentiment Analysis And Emotion Detection From Text
A Review On Sentiment Analysis And Emotion Detection From TextYasmine Anino
 
Social Learning Snapshot Survey: The Performance Hub
Social Learning Snapshot Survey: The Performance HubSocial Learning Snapshot Survey: The Performance Hub
Social Learning Snapshot Survey: The Performance HubThe Performance Hub
 
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...Javier Gonzalez-Sanchez
 
Thesis+of+zohreh+sharafi.ppt
Thesis+of+zohreh+sharafi.pptThesis+of+zohreh+sharafi.ppt
Thesis+of+zohreh+sharafi.pptPtidej Team
 
7th International Workshop on Motivational and Affective Aspects - Keynote
7th International Workshop on Motivational and Affective Aspects - Keynote7th International Workshop on Motivational and Affective Aspects - Keynote
7th International Workshop on Motivational and Affective Aspects - KeynoteAndreas Schmidt
 

Similar to The Challenges of Affect Detection in the Social Programmer Ecosystem (20)

Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges
Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open ChallengesKeynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges
Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges
 
To Label or Not? Advances and Open Challenges in SE-specific Sentiment Analysis
To Label or Not? Advances and Open Challenges in SE-specific Sentiment AnalysisTo Label or Not? Advances and Open Challenges in SE-specific Sentiment Analysis
To Label or Not? Advances and Open Challenges in SE-specific Sentiment Analysis
 
Presentation1
Presentation1Presentation1
Presentation1
 
Emotions and e-learning - UOC
Emotions and e-learning - UOCEmotions and e-learning - UOC
Emotions and e-learning - UOC
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Towards_multimodal_emotion_recognition_i.pdf
Towards_multimodal_emotion_recognition_i.pdfTowards_multimodal_emotion_recognition_i.pdf
Towards_multimodal_emotion_recognition_i.pdf
 
RStrachanOct23.pptx
RStrachanOct23.pptxRStrachanOct23.pptx
RStrachanOct23.pptx
 
Social Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategySocial Media & Its Implications for Content Strategy
Social Media & Its Implications for Content Strategy
 
Cat Herding and Community Gardens: Practical e-Science Project Management
Cat Herding and Community Gardens: Practical e-Science Project ManagementCat Herding and Community Gardens: Practical e-Science Project Management
Cat Herding and Community Gardens: Practical e-Science Project Management
 
Writing Effective NSF Proposals
Writing Effective NSF ProposalsWriting Effective NSF Proposals
Writing Effective NSF Proposals
 
Survey on adverse influencing factors in the way of successful requirement en...
Survey on adverse influencing factors in the way of successful requirement en...Survey on adverse influencing factors in the way of successful requirement en...
Survey on adverse influencing factors in the way of successful requirement en...
 
G017264447
G017264447G017264447
G017264447
 
Design considerations for machine learning system
Design considerations for machine learning systemDesign considerations for machine learning system
Design considerations for machine learning system
 
Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE
 
Inclusive design workshop
Inclusive design workshopInclusive design workshop
Inclusive design workshop
 
A Review On Sentiment Analysis And Emotion Detection From Text
A Review On Sentiment Analysis And Emotion Detection From TextA Review On Sentiment Analysis And Emotion Detection From Text
A Review On Sentiment Analysis And Emotion Detection From Text
 
Social Learning Snapshot Survey: The Performance Hub
Social Learning Snapshot Survey: The Performance HubSocial Learning Snapshot Survey: The Performance Hub
Social Learning Snapshot Survey: The Performance Hub
 
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
 
Thesis+of+zohreh+sharafi.ppt
Thesis+of+zohreh+sharafi.pptThesis+of+zohreh+sharafi.ppt
Thesis+of+zohreh+sharafi.ppt
 
7th International Workshop on Motivational and Affective Aspects - Keynote
7th International Workshop on Motivational and Affective Aspects - Keynote7th International Workshop on Motivational and Affective Aspects - Keynote
7th International Workshop on Motivational and Affective Aspects - Keynote
 

More from Nicole Novielli

Towards Supporting Emotion Awareness of Software Developers
Towards Supporting Emotion Awareness of Software DevelopersTowards Supporting Emotion Awareness of Software Developers
Towards Supporting Emotion Awareness of Software DevelopersNicole Novielli
 
Emotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost SensorsEmotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost SensorsNicole Novielli
 
Evalita2018 iListen - itaLIan Speech acT labEliNg
Evalita2018 iListen - itaLIan Speech acT labEliNgEvalita2018 iListen - itaLIan Speech acT labEliNg
Evalita2018 iListen - itaLIan Speech acT labEliNgNicole Novielli
 
A Benchmark Study on Sentiment Analysis for Software Engineering Research
A Benchmark Study on Sentiment Analysis for Software Engineering ResearchA Benchmark Study on Sentiment Analysis for Software Engineering Research
A Benchmark Study on Sentiment Analysis for Software Engineering ResearchNicole Novielli
 
Deep Tweets: from Entity Linking to Sentiment Analysis
Deep Tweets: from Entity Linking to Sentiment AnalysisDeep Tweets: from Entity Linking to Sentiment Analysis
Deep Tweets: from Entity Linking to Sentiment AnalysisNicole Novielli
 
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...Nicole Novielli
 
Social Network Analysis for Global Software Engineering: Exploring relationsh...
Social Network Analysis for Global Software Engineering: Exploring relationsh...Social Network Analysis for Global Software Engineering: Exploring relationsh...
Social Network Analysis for Global Software Engineering: Exploring relationsh...Nicole Novielli
 

More from Nicole Novielli (7)

Towards Supporting Emotion Awareness of Software Developers
Towards Supporting Emotion Awareness of Software DevelopersTowards Supporting Emotion Awareness of Software Developers
Towards Supporting Emotion Awareness of Software Developers
 
Emotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost SensorsEmotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost Sensors
 
Evalita2018 iListen - itaLIan Speech acT labEliNg
Evalita2018 iListen - itaLIan Speech acT labEliNgEvalita2018 iListen - itaLIan Speech acT labEliNg
Evalita2018 iListen - itaLIan Speech acT labEliNg
 
A Benchmark Study on Sentiment Analysis for Software Engineering Research
A Benchmark Study on Sentiment Analysis for Software Engineering ResearchA Benchmark Study on Sentiment Analysis for Software Engineering Research
A Benchmark Study on Sentiment Analysis for Software Engineering Research
 
Deep Tweets: from Entity Linking to Sentiment Analysis
Deep Tweets: from Entity Linking to Sentiment AnalysisDeep Tweets: from Entity Linking to Sentiment Analysis
Deep Tweets: from Entity Linking to Sentiment Analysis
 
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...
UNIBA at EVALITA 2014-SENTIPOLC Task: Predicting tweet sentiment polarity com...
 
Social Network Analysis for Global Software Engineering: Exploring relationsh...
Social Network Analysis for Global Software Engineering: Exploring relationsh...Social Network Analysis for Global Software Engineering: Exploring relationsh...
Social Network Analysis for Global Software Engineering: Exploring relationsh...
 

Recently uploaded

%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrandmasabamasaba
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...masabamasaba
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension AidPhilip Schwarz
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationJuha-Pekka Tolvanen
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...SelfMade bd
 
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastPapp Krisztián
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...Shane Coughlan
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Hararemasabamasaba
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...masabamasaba
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburgmasabamasaba
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...Jittipong Loespradit
 
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...chiefasafspells
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyviewmasabamasaba
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...masabamasaba
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...WSO2
 
tonesoftg
tonesoftgtonesoftg
tonesoftglanshi9
 

Recently uploaded (20)

%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the Situation
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
 
tonesoftg
tonesoftgtonesoftg
tonesoftg
 

The Challenges of Affect Detection in the Social Programmer Ecosystem

  • 1. The Challenges of Affect Detection in the Social Programmer Ecosystem Nicole NOVIELLI COLLAB, Collaborative Development Group Dipartimento di Informatica Università degli Studi di Bari ‘Aldo Moro’
  • 2. Outline • Motivation • Studying Affect in SE • A preliminary investigation • Open Challenges
  • 3. University of Bari • Since 1924 • 2nd largest university of South Italy •  60,000 students,  1,500 professors,  1,400 employees • 4 main campuses: Science and Engineering, Economics, Law and Humanities, Medicine
  • 4. People at Collab • Faculty – Filippo Lanubile – Fabio Calefato – Nicole Novielli • Research Assistants – Alessandro Natilla • Graduate Students • Final-year undergraduate students Collaborative Development Group Department of Computer Science - collab.di.uniba.it
  • 5. Research at COLLAB • Distributed Development – Addressing the problem of distance in distributed workgroups • Collaborative / Global / Social Software Engineering – Special focus on software development as an intense collaborative process
  • 6. • Programmers cooperate, directly or indirectly • Massive adoption of social media and rise of the ‘social programmer’ (Storey, ‘12) and the surrounding ecosystem
  • 7. From: A. Begel, T. Zimmermann. Analyze This! 145 Questions for Data Scientists in Software Engineering, ICSE 2014 Microsoft’s Top 10 Questions Essential Essential + Worthwhile 1. How do users typically use my application? 80.0% 99.2% 2. What parts of a software product are most used and/or loved by customers? 72.0% 98.5% 3. How effective are the quality gates we run at checkin? 62.4% 96.6% 4. How can we improve collaboration and sharing between teams? 54.5% 96.4% 5. What are the best key performance indicators (KPIs) for monitoring services? 53.2% 93.6% 6. What is the impact of a code change or requirements change to the project and its tests? 52.1% 94.0% 7. What is the impact of tools on productivity? 50.5% 97.2% 8. How do I avoid reinventing the wheel by sharing and/or searching for code? 50.0% 90.9% 9. What are the common patterns of execution in my application? 48.7% 96.6% 10. How well does test coverage correspond to actual code usage by our customers? 48.7% 92.0%
  • 8. The Role of Affect • Emotion Awareness in Social Software Engineering – Do emotions affect the outcome of collaboration? – How to deal with troubles in emotion communication in computer-mediated interaction? – How to appropriately convey sentiment through text?
  • 9. Studying Emotions in Software Engineering
  • 10. Studying Emotions in Software Engineering MSR‘15 Mining Successful Answers in Stack Overflow (Calefato et al.) Peer J ‘13 Happy software developers solve problems better Peer J (Graziotin et al.) ESEC/FSE ‘13 Towards emotional awareness in software development teams. (Guzman and Bruegge) ICSE‘15 Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and Progress. (Muller and Fritz) MSR ‘14 Sentiment analysis of commit comments in GitHub: an empirical study (Guzman et al.) RE‘14 How Do Users Like this Feature? A Fine Grained Sentiment Analysis of App Reviews (Guzman and Maalej) Security and emotion: sentiment analysis of security discussions on GitHub (Pletea et al.) CHASE ‘15 Exploring Causes of Frustration for Software Developers. (Ford and Parnin) Towards emotion-based collaborative software engineering (Dewan) Do developers feel emotions? (Murgia et al.) Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time (Ortu et al.) SCAM‘15 Recommending insightful comments for source code using crowdsourced knowledge. Source Code Analysis and Manipulation (Rahman et al.) 2013 2014 2015
  • 11. • Annotation study on the Apache Software Foundation issue tracking system – Wide range of both positive and negative emotions Murgia et al., 2014 – Do developers feel emotions? An exploratiory analysis of emotions in software artifacts. MSR 2014. Do Developers Feel Emotions? Thanks for your input! You're, like, awesome. I'm happy with the approach and the code looks good I will come over to your work and slap you Sorry for the delay Stephen
  • 12. • Survey of 45 software developers – For 67% frustration is a severe problem • Learning barriers are a major cause of frustration – New programming tools and languages – New projects – Unavailability of resources • High cognitive complexity and time pressure – Misinterpretation of the task – Size of task, high cognitive complexity – Limited time, task less simple than expected Ford and Parnin, 2015. Exploring Causes of Frustration for Software Developers. CHASE ’15. Exploring Causes of Frustration for Developers
  • 13. Do emotions affect performance? (1/3) • Positive mood improves debugging performance • Positive mood induced through physical exercises Khan et al. 2011 - Do moods affect programmers’ debug performance? Cognition, Technology & Work
  • 14. Do emotions affect performance? (2/3) • Emotions is associated to issue tracking activity – More comments and watchers for issue where Sadness is expressed – Higher fixing time when negative emotions are expressed Murgia et al., 2014 – Do developers feel emotions? An exploratiory analysis of emotions in software artifacts. MSR 2014.
  • 15. • Emotion and cognition – Developers constantly face problem-solving tasks – Analysis and creativity skills are required – Emotions and moods deeply influence cognitive processing abilities and performance Do emotions affect performance? (3/3) Graziotin et al., 2013 - Happy software developers solve problems better: psychological measurements in empirical software engineering. Peer J
  • 16. - Google Careers - http://www.google.com/about/careers/lifeatgoogle/benefits/ Last accessed: Jan 2016.
  • 17. Affective Computing as a New Method for Empirical Software Engineering
  • 18. Multimodal recognition of affective states • Biometric measurements - Empatica – www.empatica.com - Bos, EEG-based Emotion Recognition - Human Media Interaction Need for individual training for each user
  • 19. Multimodal recognition of affective states • Biometric measurements • Facial expression analysis
  • 20. Multimodal recognition of affective states • Biometric measurements • Facial expression analysis • Affective natural language processing
  • 21. Multimodal recognition of affective states • Biometric measurements • Facial expression analysis • Affective natural language processing • Social signal processing (multimodal) A.Vinciarelli, M.Pantic, D.Heylen, C.Pelachaud, I.Poggi, F.D’Errico and M.Schroeder, 2012. “Bridging the Gap Between Social Animal and Unsocial Machine: A Survey of Social Signal Processing“, IEEE Transactions on Affective Computing. F.D’Errico, I.Poggi, A.Vinciarelli and L.Vincze (eds.), 2015. Conflict and Multimodal Communication - Negotiation and conflicts - Communication effectiveness - Role recognition - Display of status - Power relationships and dominance - Automatic personality perception
  • 22. Affective computing as a new method for SE (1/3) • Sensing affect from biometric measures • Recognizing “in flow” vs. stuck developers – In flow developers should not be disturbed – Stuck developers need recommendations Muller and Fritz, 2015 - Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and Progress. ICSE 2015 EEG sensor Wrist band Eye tracking
  • 23. Affective computing as a new method for SE (2/3) • Affective natural language processing • Software requirements evolution – Feature-based sentiment analysis of app reviews (Guzman and Maalej, 2015) • Crowdsourced documentation – Exploiting sentiment polarity to assess usefulness of comments in Stack Overflow (Rahman et al., 2015) Guzman and Maalej, 2015 - How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews - Requirements Engineering Conference (RE), 2014 Rahman et al., 2015 - Recommending insightful comments for source code using crowdsourced knowledge. Source Code Analysis and Manipulation (SCAM), 2015
  • 24. Affective computing as a new method for SE (3/3) • Affective natural language processing • Improve team collaboration – Sentiment analysis of communication artifacts for emotional awareness in development teams (Guzman and Bruegge, 2013) • Crowdsourced knowledge – Investigating the role played by emotions in success of information seeking in community- based Question & Answering (Calefato et al., 2015) Guzman and Bruegge, 2013. Towards emotional awareness in software development teams. ESEC/FSE 2013. Calefato et al., 2015. Mining Successful Answers in Stack Overflow. MSR, 2015.
  • 25. How can we model and detect emotions?
  • 26. How can we model and detect emotions? MSR‘15 Mining Successful Answers in Stack Overflow (Calefato et al.) Peer J ‘13 Happy software developers solve problems better Peer J (Graziotin et al.) ESEC/FSE ‘13 Towards emotional awareness in software development teams. (Guzman and Bruegge) ICSE‘15 Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and Progress. (Muller and Fritz) MSR ‘14 Sentiment analysis of commit comments in GitHub: an empirical study (Guzman et al.) RE‘14 How Do Users Like this Feature? A Fine Grained Sentiment Analysis of App Reviews (Guzman and Maalej) Security and emotion: sentiment analysis of security discussions on GitHub (Pletea et al.) CHASE ‘15 Exploring Causes of Frustration for Software Developers. (Ford and Parnin) Towards emotion-based collaborative software engineering (Dewan) Do developers feel emotions? (Murgia et al.) Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time (Ortu et al.) SCAM‘15 Recommending insightful comments for source code using crowdsourced knowledge. Source Code Analysis and Manipulation (Rahman et al.) 2013 2014 2015
  • 27. MSR‘15 Mining Successful Answers in Stack Overflow (Calefato et al.) Peer J ‘13 Happy software developers solve problems better Peer J (Graziotin et al.) ESEC/FSE ‘13 Towards emotional awareness in software development teams. (Guzman and Bruegge) ICSE‘15 Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and Progress. (Muller and Fritz) MSR ‘14 Sentiment analysis of commit comments in GitHub: an empirical study (Guzman et al.) RE‘14 How Do Users Like this Feature? A Fine Grained Sentiment Analysis of App Reviews (Guzman and Maalej) Security and emotion: sentiment analysis of security discussions on GitHub (Pletea et al.) CHASE ‘15 Exploring Causes of Frustration for Software Developers. (Ford and Parnin) Towards emotion-based collaborative software engineering (Dewan) Do developers feel emotions? (Murgia et al.) Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time (Ortu et al.) SCAM‘15 Recommending insightful comments for source code using crowdsourced knowledge. Source Code Analysis and Manipulation (Rahman et al.) 2013 2014 2015 How can we model and detect emotions?
  • 28. MSR‘15 Mining Successful Answers in Stack Overflow (Calefato et al.) Peer J ‘13 Happy software developers solve problems better Peer J (Graziotin et al.) ESEC/FSE ‘13 Towards emotional awareness in software development teams. (Guzman and Bruegge) ICSE‘15 Stuck and Frustrated or In Flow and Happy: Sensing Developers’ Emotions and Progress. (Muller and Fritz) MSR ‘14 Sentiment analysis of commit comments in GitHub: an empirical study (Guzman et al.) RE‘14 How Do Users Like this Feature? A Fine Grained Sentiment Analysis of App Reviews (Guzman and Maalej) Security and emotion: sentiment analysis of security discussions on GitHub (Pletea et al.) CHASE ‘15 Exploring Causes of Frustration for Software Developers. (Ford and Parnin) Towards emotion-based collaborative software engineering (Dewan) Do developers feel emotions? (Murgia et al.) Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time (Ortu et al.) SCAM‘15 Recommending insightful comments for source code using crowdsourced knowledge. Source Code Analysis and Manipulation (Rahman et al.) 2013 2014 2015 How can we model and detect emotions?
  • 29. Polarity classification • Classification of a text according to its positive, negative or neutral semantic orientation • Several tools available – NLTK • Outputs probability for each polarity class • Trained on tweets and movie reviews – Stanford Sentiment Analyzer • Issues an overall polarity label + representation of the sentence structure • Trained on movie reviews – SentiStrength • Outputs a score for both positive and negative sentiment • Designed for and validated on general purpose social media [1] – NLTK: http://text-processing.com/ [2] – Stanford Sentiment Analyser - http://nlp.stanford.edu/sentiment/ [3] – SentiStrength - http://sentistrength.wlv.ac.uk/
  • 30. Measuring the sentiment: SentiStrength • Estimates the strength of both positive and negative sentiment in a text • Robust also for informal language • Widely employed in social computing Input text Positive Sentiment Score Negative Sentiment Score In [1,5] In [-1,-5] where ±1 indicates absence of pos/neg sentiment Emotion Lookup table
  • 31. SentiStrength abandon* -2 LIWC abate -2 General Inquirer Feb 2010 abdicate* -2 General Inquirer Feb 2010 abhor* -4 General Inquirer Feb 2010 abject -2 General Inquirer Feb 2010 abnormal* -2 General Inquirer Feb 2010 accusation* -2 General Inquirer Feb 2010 […] Emotion Lookup table
  • 32. Sentiment annotation with SentiStrength Input text Positive Negative Any help would be really great! :-) 5 -1 @<username> - what’s the emoticon for being terribly embarassed! 1 -5 I have very simple and stupid trouble […] I am pretty confused, explain please, what is wrong? Any help would be greatly appreciated. 3 -3
  • 33. What model and recognition approaches are suitable to detect the affect of programmers in a reliable manner? • Which is the best model? • How to operationalize it? • What tools/resources are available?
  • 34. It depends… • On research goals and application domain – Why do you want to model and detect affect? • On the available source of data – Sensors: biometric measurements – Written text: natural language processing and conversational analysis – Speech: acoustic and prosodic features – Cameras/Eye tracking devices: body posture, gaze, facial analysis
  • 35. Typology of Affective States Duration++ Intensity++ Scherer, 1984. Emotion as a Multicomponent Process: A model and some cross-cultural data. In P. Shaver, ed., Review of Personality and Social Psych 5: 37-63.
  • 36. Continuous vs. Discrete Emotion Models (1/4) Russel, 1980 - A circumplex model of affect. J.Personality and Social Psychology, 39, 1161-1178. Polarity ActivationCircumplex Model of Affect
  • 37. Continuous vs. Discrete Emotion Models (2/4) Ekman’s basic emotions Anger Fear Disgust Surprise Happiness Sadness
  • 38. Continuous vs. Discrete Emotion Models (3/4) Lazarus’ framework Negative Emotions Positive Emotions Mixed Emotions anger fright anxiety guilt shame sadness envy jealousy Disgust happiness pride relief love hope compassion gratitude Based on appraisal theory
  • 39. Continuous vs. Discrete Emotion Models (4/4) Plutchik’s Wheel Many others…
  • 40. Goal Example Resources Sentiment Analysis Negative vs. Positive Sentiment Strength SentiStrength (Thelwall et al., 2012) SentiWordNet (Esuli and Sebastiani, 2006) MPQA Lexicon (Wilson et al., 2005) - … ‘I can't solve this problem, it’s very frustrating’ Negative Mining Affect from Text Emotion Detection Classification using Discrete Emotion Labels WordNet Affect (Strapparava and Valitutti, 2004) NRC Emotion Lexicon (Mohammad and Turney, 2010) Depeche Mood (Staiano and Guerini, 2014) - … ‘I can't solve this problem, it’s very frustrating’ Frustrated
  • 41. SentiWordNet http://sentiwordnet.isti.cnr.it/ Esuli and Sebastiani. Sentiwordnet: A publicly available lexical resource for opinion mining. LREC 2006 Baccianella et al. SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining, LREC 2010 Scores Sense ID and gloss as an adjective Positive = 0.75 Negative = 0 Objective = 0.25 good#1 - Having desirable or positive qualities especially those suitable for a thing specified (as in ‘a good joke’) as a noun Positive = 0.5 Negative = 0 Objective = 0.5 good#1 benefit (as in ‘for your own good’) Positive = 0 Negative = 0 Objective = 1 good#4 commodity, article of commerce P N O
  • 42. Wordnet Affect A-label Example of Synsets EMOTION noun ‘anger’, verb ‘fear’ MOOD noun ‘animosity’, adjective ‘fear’ TRAIT noun ‘aggressiveness’, adj. ‘competitive’ COGNITIVE State noun ‘confusion’, adj. ‘dazed’ PHYSICAL State noun ‘illness’ HEDONIC Signal noun ‘hurt’, noun ‘suffering’ Emotion-eliciting SITUATION noun ‘awkwardness’ Emotional RESPONSE noun ‘cold sweat’, verb ‘tremble’ BEHAVIOR noun ‘offense’, adj. ‘inhibited’ ATTITUDE noun ‘intolerance’, noun ‘defensive’ SENSATION noun ‘coldness’, noun ‘feel’ Strapparava and Valitutti. WordNet-affect: an affective extension of WordNet. LREC 2004
  • 43. Emotion Detection in the Social Programmer Ecosystem • Data source: written, asynchronous communication on social media • Goals – To prevent negative emotion from negatively affecting outcome of collaboration – To support developers in appropriately convey sentiment through text – To exploit emotion mining for improving the creation of crowdsourced knowledge
  • 44. Research Question • What affect model should we adopt? • What are the main drawbacks of applying state-of-the-art sentiment analysis techniques in the SE domain? • What tools and linguistic resources should be used and how can they be improved and adapted to the SE domain? How to reliably detect the affective states of programmers in textual communication artifacts?
  • 47. Stack Overflow dataset • Questions, Answers and relative comments from the Stack overflow official (May 2014) • 800 items in our dataset – We opportunistically chose items with the highest positive and negative polarity scores (SentiStrength) – 200 questions and 200 follow-up askers’ comments (400 cases overall) – 200 top answers and 200 follow-up answerers’ comments (400 additional cases).
  • 48. Negative and Positive Sentiment in Stack Overflow Negative Sentiment detected Positive Sentiment detected In Questions Negative attitude towards technical issues - Emotions such as Frustration - Negative Opinions about, tools, languages, IDE, etc. Positive attitude towards technical issues - Positive Opinions about, tools, languages, IDE, etc. In Comments Negative attitude towards technical issues - Negative Opinions about, tools, languages, IDE, etc. Negative attitude towards interlocutor - Emotions such as Anger Positive attitude towards technical issues - Positive Opinions about, tools, languages, IDE, etc. Positive attitude towards interlocutor - Emotion such as Liking, Appreciation or Gratitude
  • 49. Negative attitude towards the interlocutor • Disliking - ‘Didn't notice the horrid inline jQuery’ - ‘Added some instructions for the really hopeless cases • Anger - ‘Do u know the answer? If not .... then u might know how hard is homework. Ignorance is bliss’ - ‘Arrrghhh, how I hate those people who downvote answers without leaving a comment as for why the downvote…’
  • 50. • Detecting hostile behaviour ‘Didn't notice the horrid inline jQuery’ ‘Added some instructions for the really hopeless cases’ ‘Do u know [the] answer ? If not .... then u might know how hard is homework. Ignorance is bliss’ Relevant for community moderators Negative attitude towards the interlocutor
  • 51. 51 SSE ‘15 • Hostile behavior is a problem for the Stack Exchange community ‘Do u know [the] answer ? If not .... then u might know how hard is homework. Ignorance is bliss’ ‘Didn't notice the horrid inline jQuery’ ‘Added some instructions for the really hopeless cases’ Negative attitude towards the interlocutor
  • 52. Positive attitude towards the interlocutor • Positive polarity, positive attitude – Gratitude • Thanks, that helped. Case closed! • Worked perfectly, thanks a lot • Often positive feedback is provided for discussion threads without an accepted answer • ‘Thanks for the feedback, it was a pleasure! Could please accept my answer?’ • Remind information seekers to accept useful answers! Calefato et al., 2015 - Mining Successful Answers in Stack Overflow. MSR 2015.s
  • 53. • Frustration – I am not sure what I did in a previous life to warrant this, it must have been bad! I am getting buried in a world of xml […] – This is driving me nutz :-( – There's no way to do this I'm afraid :( • Negative opinions – They use it to clean up connections, which is really scary – It is very painful to add multiple tickets to Trac – I find this incredibly annoying with Dreamweaver Attitude towards technical issues
  • 54. Exploiting negative affect towards technical issues Detect negative sentiment Detect controversial technical issues or questions that are not exhaustively answered
  • 55. • Negative polarity, positive attitude – Sorry-for ‘To explain my regrettably unfriendly comment (sorry about that)’ ‘I’m afraid I can’t help you any further with this issue!’ Does polarity capture the true sentiment? (1/2)
  • 56. • Humor, an open challenge for affective NLP • Irony – ‘Haha that comment made me laugh my heart out. Makes me kind of proud of how horrible my code can be’ (positive sentiment = 3; negative sentiment = -4) • Sarcasm – ‘Ignorance is bliss’ (positive sentiment = 5; negative sentiment = -3) Does polarity capture the true sentiment? (2/2)
  • 57. • Positive polarity – Gratitude ‘Thanks for the feedback, it was a pleasure!’ • Negative polarity, positive attitude – Sorry-for ‘I’m afraid I can’t help you any further with this issue!’ Emotion or politeness? True emotions might not be necessary involved! *Politeness, ‘Behabitive’ speech acts* Austin, 1962. How to Do Things with Words. Oxford University Press.
  • 58. Domain dependence of sentiment-analysis • False positives in negative sentiment detection – Domain lexicon ‘What is the best way to kill a critical process’ – Contextual semantics ‘I am missing a parenthesis. But where? – Context of interaction (Q&A) ‘I have a problem, […] please explain what is wrong’
  • 59. Main findings • Emotions emerge especially in comments – Seen as a ‘free zone’, comments do not contribute to reputation • Need to distinguish between the emotions towards somebody (i.e. the reader) vs. something (i.e. technical issues) – Relevant to different contexts and research goals • Distinguish politeness from true emotions • Domain-dependence of sentiment analysis – Need for tuning tools and linguistic resources
  • 61. Investigating the Role of Emotions in Social Q&A Sites Impact in Computer-Supported Cooperative Work HUMAN-COMPUTER INTERACTION SOFTWARE ENGINEERING PSYCHOLOGY LINGUISTICS Project EmoQuest http://collab.di.uniba.it/emoquest
  • 62. Expected Results AFFECTIVE COMPUTING • Empirically-driven guidelines for emotional interface design • Fine-grained Sentiment Analysis tools exploiting lexical semantics and unsupervised approaches • Real-time modeling of affect in collaboration dialogues in social media PSYCHOLINGUISTICS • New psycholinguistic theories and models of social emotions in computer-mediated interaction APPLIED LINGUISTICS • New models of affect expression through language in social computing SOCIAL SOFTWARE ENGINEERING • Netiquette: pragmatic and actionable synthesis for emotional awareness • Software tools for embedding emotional intelligence into Q&A platforms