SlideShare a Scribd company logo
1 of 18
Download to read offline
Barriers faced by newcomers to
open source projects:
a Systematic Review
Igor Steinmacher
Marco Aurélio Graciotto Silva
Marco Aurélio Gerosa
Context
... and need support on
their first steps
“Newcomers are explorers who
must orient themselves within an
unfamiliar landscape...”
[Degenais et al. 2010]
B. Dagenais, H. Ossher, R.K.E Bellamy, M.P. Robillard and J.P.
de Vries, Moving into a new software project landscape,
in ICSE 2010.
Context
• A group of PhD students received an assignment:
▫ Contribute significantly to an OSS project
• Result:
▫ All succeeded!!!
• But...
▫ Onboarding was very hard
 emails not answered after a week
 outdated information on the issue tracker
 waste of time on an already existent feature
 concurrent work on translation caused by an unread/
unanswered message sent to devs forum
 undocumented code/architecture
Goal
Identifying the barriers that newcomers face when
contributing to an Open Source Software project
Aggregate the barriers evidenced by different
studies and organize them
Scope and Definitions
• Community-based OSS projects
• Newcomer
• Onboarding
• Contribution = source code
Outsider
Onboarding Contributing
Newcomer Contributor Member
Motivation
Attractiveness Retention
Onboarding Barriers
Onboarding
Onboarding Barriers
Method
• Systematic Literature Review
▫ Aims to present a fair evaluation of a research
topic by using a trustworthy, rigorous, and
auditable methodology [Kitchenham, 2004]
• Analysis of papers using open coding + axial
coding (Grounded Theory)
Kitchenham, B.: Procedures for performing systematic reviews. Tech. rep., Keele
University and NICTA (2004)
Systematic Literature Review
• Research Question
▫ What are the barriers that hinder newcomers’
onboarding to OSS projects?
• Keywords based on research question:
Systematic Literature Review
• Selecting the studies
Query Digital
Libraries
Selection of
Primary Studies
Analysis of Primary
Studies using open
coding
Author
snowballing
Backward
snowballing
ACM, IEEE, Scopus
SpringerLink
(("OSS" OR "Open Source" OR "Free Software" OR FLOSS OR
FOSS)
AND
(newcomer OR "joining process" OR newbie OR "new
developer" OR "new member" OR "new contributor" OR "new
member" OR novice OR beginner OR "potential participant"
OR retention OR joiner OR onboarding OR "new committer"))
Systematic Literature Review
Studies found and selected
Systematic Literature Review
Resulting map of barriers
Systematic Literature Review
Stakeholder that needs to take action
Mapping
Projects Analyzed
Mapping
Types of Studies
Mapping
Forums
Conclusions
• 21 studies that evidence barriers that can hinder
newcomers’ onboarding in OSS projects
• Most evidenced barriers:
▫ newcomers’ previous technical experience
▫ receiving response from community
▫ social interactions with core members
Conclusions
• Social interaction issues is the most thoroughly
studied category: 71.42% (15 out of 21) papers
▫ High focus on interaction in mailing lists (MSR)
• Technical issues are under-investigated
▫ code issues are evidenced by only 6 studies
Conclusions
• High diversity of projects studied
• Growth of studies evidencing problems
• No studies aiming specifically at identifying the
barriers faced by newcomers to OSS
• Most part of the studies rely on results of
quantitative case studies
• Qualitative work is needed to reveal the barriers
and needs of the newcomers
Thank you!
Questions?
Igor Steinmacher
igorfs@utfpr.edu.br
Marco Aurélio Graciotto Silva
magsilva@utfpr.edu.br
Marco Aurélio Gerosa
gerosa@ime.usp.br

More Related Content

Similar to OSS 2014 - Systematic Review on Barriers Faced by Newcomers to OSS

Apache Student Induction ApacheCon 2013
Apache Student Induction ApacheCon 2013Apache Student Induction ApacheCon 2013
Apache Student Induction ApacheCon 2013
smarru
 

Similar to OSS 2014 - Systematic Review on Barriers Faced by Newcomers to OSS (20)

Scientific Software - what happens after the grant?
Scientific Software - what happens after the grant?Scientific Software - what happens after the grant?
Scientific Software - what happens after the grant?
 
NUS PhD e-open day 2020
NUS PhD e-open day 2020NUS PhD e-open day 2020
NUS PhD e-open day 2020
 
Software Professionals (RSEs) at NCSA
Software Professionals (RSEs) at NCSASoftware Professionals (RSEs) at NCSA
Software Professionals (RSEs) at NCSA
 
Pathways to Technology Transfer and Adoption: Achievements and Challenges
Pathways to Technology Transfer and Adoption: Achievements and ChallengesPathways to Technology Transfer and Adoption: Achievements and Challenges
Pathways to Technology Transfer and Adoption: Achievements and Challenges
 
Sgci at-two-years-7-26-18
Sgci at-two-years-7-26-18Sgci at-two-years-7-26-18
Sgci at-two-years-7-26-18
 
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven ResearchISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
ISEC'18 Tutorial: Research Methodology on Pursuing Impact-Driven Research
 
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
 
Rubric-based Assessment of Programming Thinking Skills and Comparative Evalua...
Rubric-based Assessment of Programming Thinking Skills and Comparative Evalua...Rubric-based Assessment of Programming Thinking Skills and Comparative Evalua...
Rubric-based Assessment of Programming Thinking Skills and Comparative Evalua...
 
Research Software Engineering Inside and Outside the Library
Research Software Engineering Inside and Outside the LibraryResearch Software Engineering Inside and Outside the Library
Research Software Engineering Inside and Outside the Library
 
Critiquing CS Assessment from a CS for All lens: Dagstuhl Seminar Poster
Critiquing CS Assessment from a CS for All lens: Dagstuhl Seminar PosterCritiquing CS Assessment from a CS for All lens: Dagstuhl Seminar Poster
Critiquing CS Assessment from a CS for All lens: Dagstuhl Seminar Poster
 
A practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based LearningA practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based Learning
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
 
Apache Student Induction ApacheCon 2013
Apache Student Induction ApacheCon 2013Apache Student Induction ApacheCon 2013
Apache Student Induction ApacheCon 2013
 
Working towards Sustainable Software for Science: Practice and Experience (WS...
Working towards Sustainable Software for Science: Practice and Experience (WS...Working towards Sustainable Software for Science: Practice and Experience (WS...
Working towards Sustainable Software for Science: Practice and Experience (WS...
 
Summary of WSSSPE and its working groups
Summary of WSSSPE and its working groupsSummary of WSSSPE and its working groups
Summary of WSSSPE and its working groups
 
Past and Future of Software Testing and Analysis
Past and Future of Software Testing and AnalysisPast and Future of Software Testing and Analysis
Past and Future of Software Testing and Analysis
 
Collaborative Data Analysis with Taverna Workflows
Collaborative Data Analysis with Taverna WorkflowsCollaborative Data Analysis with Taverna Workflows
Collaborative Data Analysis with Taverna Workflows
 
User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...User experience at Imperial: a case study of qualitative approaches to Primo ...
User experience at Imperial: a case study of qualitative approaches to Primo ...
 
Come to the Fiesta! Join the OLE Project
Come to the Fiesta! Join the OLE ProjectCome to the Fiesta! Join the OLE Project
Come to the Fiesta! Join the OLE Project
 
Howison si2 keynote
Howison si2 keynoteHowison si2 keynote
Howison si2 keynote
 

More from Igor Steinmacher

More from Igor Steinmacher (8)

Almost there a study on quasi contributors in open source software projects ...
Almost there  a study on quasi contributors in open source software projects ...Almost there  a study on quasi contributors in open source software projects ...
Almost there a study on quasi contributors in open source software projects ...
 
Introdução ao GitHub e Git
Introdução ao GitHub  e GitIntrodução ao GitHub  e Git
Introdução ao GitHub e Git
 
Apresentaçao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Apresentaçao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...Apresentaçao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Apresentaçao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
 
Barreiras à entrada de novatos em projetos de software livre - Forum Goiano d...
Barreiras à entrada de novatos em projetos de software livre - Forum Goiano d...Barreiras à entrada de novatos em projetos de software livre - Forum Goiano d...
Barreiras à entrada de novatos em projetos de software livre - Forum Goiano d...
 
Presentation to IME-USP Research Group
Presentation to IME-USP Research GroupPresentation to IME-USP Research Group
Presentation to IME-USP Research Group
 
Why do newcomers abandon open source software projects?
Why do newcomers abandon open source software projects? Why do newcomers abandon open source software projects?
Why do newcomers abandon open source software projects?
 
Análise da Desistência de Novatos em Projetos de Software Livre: Caso do Proj...
Análise da Desistência de Novatos em Projetos de Software Livre: Caso do Proj...Análise da Desistência de Novatos em Projetos de Software Livre: Caso do Proj...
Análise da Desistência de Novatos em Projetos de Software Livre: Caso do Proj...
 
MinerAll: Uma ferramenta para extração e mineração de dados de repositórios d...
MinerAll: Uma ferramenta para extração e mineração de dados de repositórios d...MinerAll: Uma ferramenta para extração e mineração de dados de repositórios d...
MinerAll: Uma ferramenta para extração e mineração de dados de repositórios d...
 

Recently uploaded

Recently uploaded (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

OSS 2014 - Systematic Review on Barriers Faced by Newcomers to OSS

  • 1. Barriers faced by newcomers to open source projects: a Systematic Review Igor Steinmacher Marco Aurélio Graciotto Silva Marco Aurélio Gerosa
  • 2. Context ... and need support on their first steps “Newcomers are explorers who must orient themselves within an unfamiliar landscape...” [Degenais et al. 2010] B. Dagenais, H. Ossher, R.K.E Bellamy, M.P. Robillard and J.P. de Vries, Moving into a new software project landscape, in ICSE 2010.
  • 3. Context • A group of PhD students received an assignment: ▫ Contribute significantly to an OSS project • Result: ▫ All succeeded!!! • But... ▫ Onboarding was very hard  emails not answered after a week  outdated information on the issue tracker  waste of time on an already existent feature  concurrent work on translation caused by an unread/ unanswered message sent to devs forum  undocumented code/architecture
  • 4. Goal Identifying the barriers that newcomers face when contributing to an Open Source Software project Aggregate the barriers evidenced by different studies and organize them
  • 5. Scope and Definitions • Community-based OSS projects • Newcomer • Onboarding • Contribution = source code Outsider Onboarding Contributing Newcomer Contributor Member Motivation Attractiveness Retention Onboarding Barriers Onboarding Onboarding Barriers
  • 6. Method • Systematic Literature Review ▫ Aims to present a fair evaluation of a research topic by using a trustworthy, rigorous, and auditable methodology [Kitchenham, 2004] • Analysis of papers using open coding + axial coding (Grounded Theory) Kitchenham, B.: Procedures for performing systematic reviews. Tech. rep., Keele University and NICTA (2004)
  • 7. Systematic Literature Review • Research Question ▫ What are the barriers that hinder newcomers’ onboarding to OSS projects? • Keywords based on research question:
  • 8. Systematic Literature Review • Selecting the studies Query Digital Libraries Selection of Primary Studies Analysis of Primary Studies using open coding Author snowballing Backward snowballing ACM, IEEE, Scopus SpringerLink (("OSS" OR "Open Source" OR "Free Software" OR FLOSS OR FOSS) AND (newcomer OR "joining process" OR newbie OR "new developer" OR "new member" OR "new contributor" OR "new member" OR novice OR beginner OR "potential participant" OR retention OR joiner OR onboarding OR "new committer"))
  • 11. Systematic Literature Review Stakeholder that needs to take action
  • 15. Conclusions • 21 studies that evidence barriers that can hinder newcomers’ onboarding in OSS projects • Most evidenced barriers: ▫ newcomers’ previous technical experience ▫ receiving response from community ▫ social interactions with core members
  • 16. Conclusions • Social interaction issues is the most thoroughly studied category: 71.42% (15 out of 21) papers ▫ High focus on interaction in mailing lists (MSR) • Technical issues are under-investigated ▫ code issues are evidenced by only 6 studies
  • 17. Conclusions • High diversity of projects studied • Growth of studies evidencing problems • No studies aiming specifically at identifying the barriers faced by newcomers to OSS • Most part of the studies rely on results of quantitative case studies • Qualitative work is needed to reveal the barriers and needs of the newcomers
  • 18. Thank you! Questions? Igor Steinmacher igorfs@utfpr.edu.br Marco Aurélio Graciotto Silva magsilva@utfpr.edu.br Marco Aurélio Gerosa gerosa@ime.usp.br