Early Identification of Future Committers in Open Source Software Projects

Early Identification of Future Committers
in Open Source Software Projects
Akinori Ihara
(NAIST, Japan)
Yasutaka Kamei
(Kyushu Univ. Japan)
Masao Ohira
(Wakayma Univ. Japan)
Ahmed E. Hassan
(Queen’s Univ. Canada)
Naoyasu Ubayashi
(Kyushu Univ., Japan)
Kenichi Matsumoto
(NAIST, Japan)
Future
Committer?

What is Committer?
patchesVersion Control
System
Patch verification
committers developers

What is Committer’s Work?
System
Assigning tasksTriaging tasksRequirements
HIGH
LOW
Patch verification Advising coding

What is Committer’s Work?
System
Assigning tasksTriaging tasks
Patch verification
Requirements
HIGH
LOW
Advising coding
Sometimes,
leave the project!!
Too few!!

How do they get new committers?
Candidate committer
Committer Community
developers
Over 10,000 developers

The evaluated activities
Need more
contribution!
Time
Comment
Patch creation

Time
The evaluated activities
Good Works!
Contribute as
Committer!
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation
Comment
Patch creation

Future Committers and Developers
Future committers
53 51
CommentPatch
creation
Commit
VCS
Patch
creation

Future committers
53 51
Developers
8,964 12,287
CommentPatch
creation
Commit
VCS
Patch
creation
Comment Comment Patch
creation

Future committers
53 51
Developers
8,964 12,287
Existing committers
36 96
CommentPatch
creation
Commit
VCS
Patch
creation
Comment Comment Patch
creation
Commit
VCS
Patch
creation
Comment Patch
creation

Research Questions
RQ1
Are there any differences in the activities
of future committers and developers?
RQ2
Which developer activities lead to early
promotion to a committer role?
RQ3
How accurate is a committer-identification
model built using developer activities
？

RQ1
Are there any differences in the activities
of future committers and developers?
？
The amount of activities by future committers is
higher than developers.
Patch submissionComment submission

Activity period before Committer Activity period before Committer
RQ2
0 20 40 60 80 100
020406080100
step
percentage
0 10 20 30 40 50 60
020406080100
step
percentage
A developer who has contributed for one year should become a committer [Bird‘07]
Rapidly-promoted committer
Regularly-promoted committer
%numberofcommitters
%numberofcommitters

RQ2
RQ2-1
Is there a difference in activities of rapidly-promoted committers and
the activities of regularly-promoted committers?
The # activities performed by rapidly-promoted committers
is more than regularly-promoted committers.

RQ2
2 4 6 8 10 12 14
02040
Index
aaa$patch
2 4 6 8 10 12 14
02040
Index
aaa$comment
Dev1@Eclipse platform
for 10 months
0 5 10 15 20 25 30
051020
Index
aaa$patch
0 5 10 15 20 25 30
051020
Index
aaa$comment
Dev2@Mozilla Firefox for 17 months
activity period (month)
5 10 15 20 25 30
0204001020
0
1 2 3 4 5 6
01025
Index
sanza$patch
1 2 3 4 5 6
01025
Index
sanza$comment
Dev3@Eclipse platform
30150
1 2 3 4 5 6
0510
Index
sanza$patch
1 2 3 4 5 6
0510
Index
sanza$comment
Dev4@Mozilla Firefox
010
1 2 3 4 5 6
activity period (month)
the number of patches the number of comments
Rapidly-promoted committerRegularly-promoted committer
RQ2-2
What do regularly-promoted committers do more than the rapidly-
promoted committers?
Regularly-promoted committers have actively worked
for 1-1.5 years before they became committers.
1 2 3 4 5 62 4 6 8 10 12 14

RQ3
Precision Recall F1
Random Forest
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.2
0.4
0.6
0.8
1.0
0.2
0.5
0.8
Threshold
0.2
0.5
0.8
Threshold
AUC Precision Recall F1 AUC
Sum Patch
Med Num Patch
Patches creation
Sum Patch
Med Num Patch
Comment
Period
sampled same
number of developers
as committers

RQ3
Random ForestSumNumPatch
MedNumPatch
Patches creation
SumNumPatch
MedNumPatch
Comment
Period
sampled same
as committers
Precision Recall F1
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.2
0.4
0.6
0.8
1.0
0.2
0.5
0.8
Threshold
0.2
0.5
0.8
Threshold
The committer prediction model has higher accuracy than
the random predictor.

RQ3
rank Eclipse Firefox
1 SumNumComment Period
2 Period SumNumComment
3 SumNumPatch SumNumPatch
4 MedNumComment MedNumPatch
5 MedNumPatch MedNumComment

Discussion
Activities after becoming a committer
Rapidly-promoted committers actively worked more than
regular- promoted committers after their promotion.
CommitsComment submission

What is Commi er’s Work?
System
Assigning tasksTriaging tasks
Patch verifica on
Requirements
Requirements
Requirements
Requirements
HIGH
Requirements
Requirements
Requirements
Requirements
LOW
Requirements
RequirementsRequirements
Requirements
Requirements
Requirements
Requirements
Requirements
Requirements
Advising coding
Some mes,
leave the project!!
Too few!!
Discussion
Activities after becoming a committer
Rapidly-promoted commi ers ac vely worked more than
regular- promoted commi ers a er their promo on.
CommitsComment submission
RQ2
1 2
050100150200250300
020406080100
D &
1 2
01020304050
1 2
020406080100
D &
RQ2-1
Is there a difference in activities of rapidly-promoted committers and
the activities of regularly-promoted committers?
The # ac vi es performed by rapidly-promoted commi ers
is more than regularly-promoted commi ers.
RQ3
Precision Recall F1
Random Forest
0.0
0.2
0.4
0.6
0.8
1.0
0.0
0.2
0.4
0.6
0.8
1.0
0.2
0.5
0.8
Threshold
0.2
0.5
0.8
Threshold
SumNumPatch
MedNumPatch
Patches crea on
SumNumPatch
MedNumPatch
Comment
Period
sampled same
as commi ers

Early Identification of Future Committers in Open Source Software Projects

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Similar to Early Identification of Future Committers in Open Source Software Projects

Similar to Early Identification of Future Committers in Open Source Software Projects (20)

More from SAIL_QU

More from SAIL_QU (20)

Recently uploaded

Recently uploaded (20)

Early Identification of Future Committers in Open Source Software Projects

Editor's Notes