Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

MSR mining challenge 2015 - Quick Trigger

531 views

Published on

MSR 2015 mining challenge paper: Quick trigger on stack overflow: a study of gamification-influenced member tendencies

Published in: Software
  • Be the first to comment

  • Be the first to like this

MSR mining challenge 2015 - Quick Trigger

  1. 1. Quick Trigger on Stack Overflow: A Study of Gamification-influenced Member Tendencies MSR 2015 Mining Challenge Yong Jin Xin Yang Raula G. Kula Eunjong Choi Katsuro Inoue Hajimu Iida Nara Institute of Science and Technology, Japan Osaka University, Japan
  2. 2. Gamification in Stack Overflow (SO) User Information Reputation Score Reward-driven gamification For more info: http://stackoverflow.com/help/whats-reputation 1
  3. 3. Gamification in Stack Overflow (SO) User Information Reputation Score Vote posts Reward-driven gamification For more info: http://stackoverflow.com/help/whats-reputation 2
  4. 4. Gamification in Stack Overflow (SO) User Information Reputation Score Vote posts Accept answers Reward-driven gamification For more info: http://stackoverflow.com/help/whats-reputation 3
  5. 5. Quick Triggers Western Movies Q&A website 4
  6. 6. Quick Triggers Win Reward 5 Western Movies Q&A website
  7. 7. • Just for high score ▫ Answer quick, in order to get more score • We want to know: ▫ How many Quick Triggers? ▫ How about the quality? ▫ Do they only answer easy questions? Our Concerns 6 Be quick or be dead
  8. 8. • RQ1: Is Rapid Response (RR) widespread among community members? • RQ2: Are most Accepted Answers(AA) related to RR? • RQ3: Does member tagging tendencies change with RR? Research Questions 7
  9. 9. Defined Metrics •Response Time (RT) •Ratio of Accepted Answer (AA) •Tag Score (TS) Analysis with R •Distribution of RT •Distribution of NRR : RR •Relation between AA and RR •Distribution of TS Approach 8
  10. 10. RR:NRR = 1 RQ1: Is RR widespread among community members? RR is not widespread among the community 92% members have more NRR than RR 92% 9
  11. 11. RQ2: Are most Accepted Answers(AA) related to RR? 81% 79% 21% 19% No direct relationship between AA and RR 10
  12. 12. RQ3: Does member tagging tendencies change with RR? Tagging tendencies change in RR posts *p-value<0.05 11
  13. 13. • Threats to validity ▫ The threshold that using 80-20 rule ▫ Dataset is not big • Future work ▫ Quality metrics between RR and NRR ▫ Longer period of dataset. Discussion 12
  14. 14. Conclusion 13
  15. 15. 14 Nothing wrong with shooting, as long as the right people get shot. ― Clint Eastwood

×