Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Studying Sustained Attention & Cognitive
States in Remote Technical Interviews
Denae Ford, Titus Barik, Chris Parnin
North...
>$100,000
Companies spend over $100,000 on candidate face to face interviews
Source: http://2.bp.blogspot.com/-nQc-Dj517_o/UTns6klEtTI/AAAAAAAAAEw/F9nK5uSVUBQ/s1600/people_talking_on_phone.jpg
Source: http://www.clker.com/cliparts/5/b/9/8/1194984513646717809chat_icon_01.svg.hi.png
Oh. I see you’re
coding I’ll wait...
Nonverbal Cues & Think-Aloud
Hollandsworth (1979) found that interviewers place high importance on
nonverbal cues such com...
Monitoring Sustained Attention
"the ability to direct and focus cognitive activity on specific stimuli”
What if we used th...
Pupil Dilation
Large pupil dilation implies high
cognitive load
Should not deter attention of candidate
during this peak p...
Saccades
Connections between shifts of attention & saccades
Saccades occur involuntary during information processing
If sa...
Blinks
Help determine a candidate's’
interest in a task
Using size and speed of blink we can
determine if the attention of...
Two Interventions
Remote Focus Lights Blackouts
Source: http://www.buffalovalley.org/uploads/2/1/1/8/21189646/6863220.jpg?...
Proposed Study
C1: No Interventions
E2: Blackout Only
E3: Focus Light Only
E4: Both Blackout and Focus Light
Challenges
Determining what valuable information can we extract from using eye
tracking in technical interviews
Seems like...
Conclusion
Only one step to understanding technical interviews
Goal: eventually establish a golden set of adaptable techni...
@DenaeFord
http://blog.DenaeFord.me
Q&A
Research Questions
RQ1: Is the candidate able to sustain their attention to the programming
issue less when the interviewe...
How Realistic is This?
There are smart phones that take advantage of this technology
Starting with Samsung Galaxy S4 - Eye...
Is this a real problem?
Costs
SMI Eye Tracking: $11,900
Gazepoint GP3 Eye Tracker: $495.00
Remote Focus Light[blink(1) mk2 USB]: $29.95
Black Out ...
Upcoming SlideShare
Loading in …5
×

EMIP15 Workshop Presentation

539 views

Published on

Presentation given in November 2015 in Joensuu, Finland

Published in: Recruiting & HR
  • Be the first to comment

  • Be the first to like this

EMIP15 Workshop Presentation

  1. 1. Studying Sustained Attention & Cognitive States in Remote Technical Interviews Denae Ford, Titus Barik, Chris Parnin North Carolina State University
  2. 2. >$100,000 Companies spend over $100,000 on candidate face to face interviews
  3. 3. Source: http://2.bp.blogspot.com/-nQc-Dj517_o/UTns6klEtTI/AAAAAAAAAEw/F9nK5uSVUBQ/s1600/people_talking_on_phone.jpg
  4. 4. Source: http://www.clker.com/cliparts/5/b/9/8/1194984513646717809chat_icon_01.svg.hi.png Oh. I see you’re coding I’ll wait... Thank you!
  5. 5. Nonverbal Cues & Think-Aloud Hollandsworth (1979) found that interviewers place high importance on nonverbal cues such composure and eye contact Can collect these nonverbal cues that occur during the interview process through eye tracking Confirm them through the “eye-mind hypothesis”
  6. 6. Monitoring Sustained Attention "the ability to direct and focus cognitive activity on specific stimuli” What if we used the concepts from sustained attention to enhance programming under high stress situations?
  7. 7. Pupil Dilation Large pupil dilation implies high cognitive load Should not deter attention of candidate during this peak processing time Can break concentration & make it difficult to resume task Source: https://upload.wikimedia.org/wikipedia/commons/a/a3/Eye_dilate.gif
  8. 8. Saccades Connections between shifts of attention & saccades Saccades occur involuntary during information processing If saccades begin to stray from information processed indicates a stray in sustained attention Source: http://49.media.tumblr.com/tumblr_md36ruuNXk1qfg7o3o1_400.gif
  9. 9. Blinks Help determine a candidate's’ interest in a task Using size and speed of blink we can determine if the attention of the candidate is on the eliciting stimulus Source: http://45.media.tumblr.com/91cfc58c55c969b876ab0238ddcda507/tumblr_mss1ejaDpX1r3maj7o1_500.gif
  10. 10. Two Interventions Remote Focus Lights Blackouts Source: http://www.buffalovalley.org/uploads/2/1/1/8/21189646/6863220.jpg?481 Source: http://blogs.baruch.cuny.edu//scdc/files/2011/11/dreamstime_l_3291533.jpg
  11. 11. Proposed Study C1: No Interventions E2: Blackout Only E3: Focus Light Only E4: Both Blackout and Focus Light
  12. 12. Challenges Determining what valuable information can we extract from using eye tracking in technical interviews Seems like this would be a great example to see someone program under a stressful situation
  13. 13. Conclusion Only one step to understanding technical interviews Goal: eventually establish a golden set of adaptable technical interviews for different programming styles Source: http://blog.rocketclub.co/wp-content/uploads/2015/03/bad_interview_questions.jpgSource: https://coderpad.io/
  14. 14. @DenaeFord http://blog.DenaeFord.me
  15. 15. Q&A
  16. 16. Research Questions RQ1: Is the candidate able to sustain their attention to the programming issue less when the interviewer has increased view of their actions? RQ2: How does visibility of the interviewer affect the candidates’ performance? RQ3: How is the performance of novices and experts reflected in their cognitive states during interviews?
  17. 17. How Realistic is This? There are smart phones that take advantage of this technology Starting with Samsung Galaxy S4 - Eye Scroll Feature, SmartStay Matter of time before it’s widespread such as laptops like Tobii
  18. 18. Is this a real problem?
  19. 19. Costs SMI Eye Tracking: $11,900 Gazepoint GP3 Eye Tracker: $495.00 Remote Focus Light[blink(1) mk2 USB]: $29.95 Black Out Feature : Programming Hours (< 1 Undergrad)

×