Sentiment Analysis on the Linux Kernel
•
0 likes•125 views
Presentation performed in the Open Source Leadership Summit 2019.
Recommended
Recommended
More Related Content
Similar to Sentiment Analysis on the Linux Kernel
Similar to Sentiment Analysis on the Linux Kernel (20)
Recently uploaded
Recently uploaded (20)
Sentiment Analysis on the Linux Kernel
- 1. 1 Sentimine: a cregit Plugin to Analyze the Sentiment Behind the Linux Kernel Code Isabella Ferreira Polytechnique Montréal Kate Stewart Linux Foundation Daniel German University of Victoria Bram Adams Polytechnique Montréal Towards
- 2. 2Linus Torvalds’ temporary leave in September 2018 ...
- 3. 3 … sparked a Rich and Diverse Discussion about Change in the Community ...
- 4. 4 … even after Linus’ comeback, discussions continued
- 5. 5
- 6. 6 Almost half a year later, what did the community learn or change?
- 7. 7 Code of Conflict became Code of Conduct :-)
- 8. 8…, but a Code of Conduct just treats the symptoms, what is the root of the problem?
- 9. 9 How civil is the Linux community? Is it a recent problem? Is it a problem that is increasing over time? How does civility change across release cycles? How is the civility in the Linux community compared to other open source projects?
- 10. 10 Civility is not (yet) part of CHAOSS
- 11. 11 Initial idea: Measuring civility through sentiment Politeness Sentiment Emotion great work, guys! WTF, a package refactoring and class renaming in one patch? Good civility Bad civility
- 12. Challenges Identify the target of the sentiment ● Is the sentiment about the person (civility) or about the code (review)? Identify the right granularity to analyze sentiments ● Individual e-mails vs. e-mail threads? ● Subsystem vs. the whole kernel? ● Week vs. month vs. release cycle? 12
- 13. 13 Can we measure differences in sentiment between maintainers and non-maintainers? Can we measure differences in sentiment across time? Can we measure differences in sentiment between releases?
- 14. 14 Approach Extract LKML data Public-inbox e-mails from Jan 2017 to Jan 2019 Step 1 Step 2 Group e-mails by threads Mailboxminer tool Step 3 Filter threads >= 2 e-mails in a thread ignore e-mails that have patch
- 15. 15 Approach Step 4 Calculate metrics Release cycle Month, week, weekday Maintainer vs. non-maintainers Results
- 16. 16 A lot of communication across releases... 0 0
- 17. 17 Phase 2 in the release cycle has more discussion Phase 1 Phase 3 Phase 2
- 18. 18 Approach Extract LKML data Public-inbox e-mails from Jan 2017 to Jan 2019 Step 1 Step 2 Group e-mails by threads Mailboxminer tool Step 3 Filter threads >= 2 e-mails in a thread ignore e-mails that have patch Step 5 Detect sentiment Senti4SD Step 4 Calculate metrics Release cycle Subsystem Maintainer vs. non-maintainers Answer questions about civility
- 21. Equal proportion of positive/negative e-mail threads 21
- 22. 22 Equal number of positive/negative discussions across releases 0 0
- 23. 23 Specific events might change the sentiment…
- 24. 24 The sentiment fluctuates among weeks Weeks 31-34: August, 2018Weeks 31-39: September, 2018Weeks 40-44: October, 2018
- 25. 25 Tuesdays, Wednesdays, and Thursdays have more positive discussions
- 26. 26The sentiment does not differ between maintainers and non- maintainers
- 27. 27 Challenges and Ongoing Work
- 28. 28 Noisy tools How to act on results? Target of sentiment?Noisy data
- 29. 29 PollEv.com/isabellaferr986 Let’s do a quick survey?
- 31. 31 What kind of tool support could help the community?
- 32. 32 Links to mailing list reviews generated by email2git https://cregit.linuxsources.org Cregit tracks patches at token level
- 33. Ferreira et al. A Longitudinal Study on the Maintainers’ Sentiment of a Large Scale Open Source Ecosystem Isabella Ferreira Polytechnique Montréal MCIS Lab isabella.ferreira@polymtl.ca /isabellaferreira /isabellavieira @isaferreira_57 We need your feedback!