SlideShare a Scribd company logo
An Empirical Study of Dormant Bugs
Tse-Hsun(Peter) Chen Meiyappan Nagappan Emad Shihab Ahmed E. Hassan
1
Most studies focus on post-release bugs
2
Version A Version B
File
A
Bug 1 Bug 2
Bugs Discovered!Assign Bugs to File A
Some bugs may remain dormant for a
long time
3
Version A Version CVersion B
File
A
Bug is waken up, but is
counted as post-release
bug for Version B
Zzz… Zzz…
What are dormant bugs?
4
Version BVersion A Version C Today
File
A
Bug 1
File B
Bug 2 Bug 3
Bugs
introduced in
Version A
Not a
dormant bug
Bug 2
Dormant bug
(discovered one
version after it
was introduced )
Dormant bug
(discovered
many versions
after it was
introduced )
Bug 1
…
Zzz..Zzz..
Bug 3
Dormant bugs affect perceived
software quality
5
VersionA
Version
B
Version A has 5 bugs Version B has 10 bugs
Dormant bugs affect perceived
software quality
6
VersionA
Version
B
Version A has 5 bugs Version B has 10 bugs
Version B has 8
dormant bugs!
These dormant bugs were
introduced in version A
Case study on 20 systems
7
Studied 20 open-source systems in the Apache Foundation
Analyzed all versions
System LOCs: 61K ~ 1.5M
# dormant
bugs
29%
# non-
dormant
bugs
71%
Many bugs are actually dormant bugs
8
VersionA
Version
C
Bug introduced
in Version A
33% of bugs become
dormant bugs!
VersionA
Bugs reported in
Version A
Many post-release bugs are actually
introduced in MUCH EARLIER versions!
20% of bugs are
dormant bugs from
prior versions
RQ1: How quickly are
dormant bugs fixed?
Research questions
9
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
RQ1: How quickly are
dormant bugs fixed?
Research questions
10
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
Dormant bugs are fixed faster and the
fixes are larger
11
Dormant Non-dormant
Take 5 days to fix
(median)
Takes 60% more
time to fix
Dormant Non-dormant
Fix size is 19
LOC (median)
Fix size is 50%
smaller
RQ1: How quickly are
dormant bugs fixed?
Research questions
12
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
RQ1: How quickly are
dormant bugs fixed?
Research questions
13
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
Dormant fixers are more experienced
14
Dormant Non-dormant
#ofpriorcommitsofbugfixers
RQ1: How quickly are
dormant bugs fixed?
Research questions
15
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
RQ1: How quickly are
dormant bugs fixed?
Research questions
16
RQ2: What is the size
of a dormant bug fix?
RQ3: Who fixes
dormant bugs?
RQ4: What are the root
causes of dormant bug
fixes?
Manual study of the root causes
17
All bugs
Randomly sampled 357
dormant bugs and 357
non-dormant bugs
Manually classify the
bugs
Manually-derived root causes
18
%ofbugsbelongtoeachmanually-derivedrootcause
Corner
cases
Control
flow
Missing
Features
Process-
ing
Implemen-
tation
Stacked barplot of:
Dormant bugs are different from non-
dormant bugs
19
We should consider dormant bugs in
future studies to avoid bias
They are different!
20
21
22
23
24

More Related Content

Similar to Dormant bug v2

DevAppLB - PhoneGap Zombie App - Dani Arnaout
DevAppLB - PhoneGap Zombie App - Dani ArnaoutDevAppLB - PhoneGap Zombie App - Dani Arnaout
DevAppLB - PhoneGap Zombie App - Dani Arnaout
Dani Arnaout
 
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
SAIL_QU
 
Failfast
FailfastFailfast
Failfast
Al Sayed Gamal
 
Favourite technology
Favourite technologyFavourite technology
Favourite technology
Olga Sergeeva
 
Five Stages of Development - Nordic.js
Five Stages of Development  - Nordic.jsFive Stages of Development  - Nordic.js
Five Stages of Development - Nordic.js
Robert Nyman
 
2016 - Daniel Lebrero - REPL driven development
2016 - Daniel Lebrero - REPL driven development2016 - Daniel Lebrero - REPL driven development
2016 - Daniel Lebrero - REPL driven development
PROIDEA
 
Source Control 101
Source Control 101Source Control 101
Source Control 101
Robert MacLean
 
Debugging Your Plone Site
Debugging Your Plone SiteDebugging Your Plone Site
Debugging Your Plone Site
cdw9
 
6 easy bug tracking tips & tricks every developer should know!
6 easy bug tracking tips & tricks every developer should know!6 easy bug tracking tips & tricks every developer should know!
6 easy bug tracking tips & tricks every developer should know!
Thomas Peham
 
Five stages of development - at Vaimo
Five stages of development - at VaimoFive stages of development - at Vaimo
Five stages of development - at Vaimo
Robert Nyman
 
Version Control Systems - ArabNet Beirut 2014 - Dani Arnaout
Version Control Systems - ArabNet Beirut 2014 - Dani ArnaoutVersion Control Systems - ArabNet Beirut 2014 - Dani Arnaout
Version Control Systems - ArabNet Beirut 2014 - Dani Arnaout
Dani Arnaout
 
SAD15 - Maintenance
SAD15 - MaintenanceSAD15 - Maintenance
SAD15 - Maintenance
Michael Heron
 
Bug first Zero Defect
Bug first   Zero DefectBug first   Zero Defect
Bug first Zero Defect
Oliver Schreck
 
Let's Make the PAIN Visible!
Let's Make the PAIN Visible!Let's Make the PAIN Visible!
Let's Make the PAIN Visible!
Arty Starr
 
Improving Bug Tracking Systems
Improving Bug Tracking SystemsImproving Bug Tracking Systems
Improving Bug Tracking Systems
Rahul Premraj
 
React Apps at AirHelp. Lessons learned.
React Apps at AirHelp. Lessons learned.React Apps at AirHelp. Lessons learned.
React Apps at AirHelp. Lessons learned.
AirHelp
 
Software testing and concolic execution LSE 2013
Software testing and concolic execution LSE 2013Software testing and concolic execution LSE 2013
Software testing and concolic execution LSE 2013
Jonathan Salwan
 
Introducing BugBase 1.0
Introducing BugBase 1.0Introducing BugBase 1.0
Introducing BugBase 1.0
Abhishek Mishra
 
Droidcon thessaloniki 2015
Droidcon thessaloniki 2015Droidcon thessaloniki 2015
Droidcon thessaloniki 2015
Raymond Chenon
 
Middle Out Design
Middle Out DesignMiddle Out Design
Middle Out Design
Audrey Crane
 

Similar to Dormant bug v2 (20)

DevAppLB - PhoneGap Zombie App - Dani Arnaout
DevAppLB - PhoneGap Zombie App - Dani ArnaoutDevAppLB - PhoneGap Zombie App - Dani Arnaout
DevAppLB - PhoneGap Zombie App - Dani Arnaout
 
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
How are Discussions Associated with Bug Reworking? An Empirical Study on Open...
 
Failfast
FailfastFailfast
Failfast
 
Favourite technology
Favourite technologyFavourite technology
Favourite technology
 
Five Stages of Development - Nordic.js
Five Stages of Development  - Nordic.jsFive Stages of Development  - Nordic.js
Five Stages of Development - Nordic.js
 
2016 - Daniel Lebrero - REPL driven development
2016 - Daniel Lebrero - REPL driven development2016 - Daniel Lebrero - REPL driven development
2016 - Daniel Lebrero - REPL driven development
 
Source Control 101
Source Control 101Source Control 101
Source Control 101
 
Debugging Your Plone Site
Debugging Your Plone SiteDebugging Your Plone Site
Debugging Your Plone Site
 
6 easy bug tracking tips & tricks every developer should know!
6 easy bug tracking tips & tricks every developer should know!6 easy bug tracking tips & tricks every developer should know!
6 easy bug tracking tips & tricks every developer should know!
 
Five stages of development - at Vaimo
Five stages of development - at VaimoFive stages of development - at Vaimo
Five stages of development - at Vaimo
 
Version Control Systems - ArabNet Beirut 2014 - Dani Arnaout
Version Control Systems - ArabNet Beirut 2014 - Dani ArnaoutVersion Control Systems - ArabNet Beirut 2014 - Dani Arnaout
Version Control Systems - ArabNet Beirut 2014 - Dani Arnaout
 
SAD15 - Maintenance
SAD15 - MaintenanceSAD15 - Maintenance
SAD15 - Maintenance
 
Bug first Zero Defect
Bug first   Zero DefectBug first   Zero Defect
Bug first Zero Defect
 
Let's Make the PAIN Visible!
Let's Make the PAIN Visible!Let's Make the PAIN Visible!
Let's Make the PAIN Visible!
 
Improving Bug Tracking Systems
Improving Bug Tracking SystemsImproving Bug Tracking Systems
Improving Bug Tracking Systems
 
React Apps at AirHelp. Lessons learned.
React Apps at AirHelp. Lessons learned.React Apps at AirHelp. Lessons learned.
React Apps at AirHelp. Lessons learned.
 
Software testing and concolic execution LSE 2013
Software testing and concolic execution LSE 2013Software testing and concolic execution LSE 2013
Software testing and concolic execution LSE 2013
 
Introducing BugBase 1.0
Introducing BugBase 1.0Introducing BugBase 1.0
Introducing BugBase 1.0
 
Droidcon thessaloniki 2015
Droidcon thessaloniki 2015Droidcon thessaloniki 2015
Droidcon thessaloniki 2015
 
Middle Out Design
Middle Out DesignMiddle Out Design
Middle Out Design
 

More from SAIL_QU

Studying the Integration Practices and the Evolution of Ad Libraries in the G...
Studying the Integration Practices and the Evolution of Ad Libraries in the G...Studying the Integration Practices and the Evolution of Ad Libraries in the G...
Studying the Integration Practices and the Evolution of Ad Libraries in the G...
SAIL_QU
 
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
SAIL_QU
 
Improving the testing efficiency of selenium-based load tests
Improving the testing efficiency of selenium-based load testsImproving the testing efficiency of selenium-based load tests
Improving the testing efficiency of selenium-based load tests
SAIL_QU
 
Studying User-Developer Interactions Through the Distribution and Reviewing M...
Studying User-Developer Interactions Through the Distribution and Reviewing M...Studying User-Developer Interactions Through the Distribution and Reviewing M...
Studying User-Developer Interactions Through the Distribution and Reviewing M...
SAIL_QU
 
Studying online distribution platforms for games through the mining of data f...
Studying online distribution platforms for games through the mining of data f...Studying online distribution platforms for games through the mining of data f...
Studying online distribution platforms for games through the mining of data f...
SAIL_QU
 
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
SAIL_QU
 
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
SAIL_QU
 
Mining Development Knowledge to Understand and Support Software Logging Pract...
Mining Development Knowledge to Understand and Support Software Logging Pract...Mining Development Knowledge to Understand and Support Software Logging Pract...
Mining Development Knowledge to Understand and Support Software Logging Pract...
SAIL_QU
 
Which Log Level Should Developers Choose For a New Logging Statement?
Which Log Level Should Developers Choose For a New Logging Statement?Which Log Level Should Developers Choose For a New Logging Statement?
Which Log Level Should Developers Choose For a New Logging Statement?
SAIL_QU
 
Towards Just-in-Time Suggestions for Log Changes
Towards Just-in-Time Suggestions for Log ChangesTowards Just-in-Time Suggestions for Log Changes
Towards Just-in-Time Suggestions for Log Changes
SAIL_QU
 
The Impact of Task Granularity on Co-evolution Analyses
The Impact of Task Granularity on Co-evolution AnalysesThe Impact of Task Granularity on Co-evolution Analyses
The Impact of Task Granularity on Co-evolution Analyses
SAIL_QU
 
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
SAIL_QU
 
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
SAIL_QU
 
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
SAIL_QU
 
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
SAIL_QU
 
What Do Programmers Know about Software Energy Consumption?
What Do Programmers Know about Software Energy Consumption?What Do Programmers Know about Software Energy Consumption?
What Do Programmers Know about Software Energy Consumption?
SAIL_QU
 
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
SAIL_QU
 
Revisiting the Experimental Design Choices for Approaches for the Automated R...
Revisiting the Experimental Design Choices for Approaches for the Automated R...Revisiting the Experimental Design Choices for Approaches for the Automated R...
Revisiting the Experimental Design Choices for Approaches for the Automated R...
SAIL_QU
 
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
Measuring Program Comprehension: A Large-Scale Field Study with ProfessionalsMeasuring Program Comprehension: A Large-Scale Field Study with Professionals
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
SAIL_QU
 
On the Unreliability of Bug Severity Data
On the Unreliability of Bug Severity DataOn the Unreliability of Bug Severity Data
On the Unreliability of Bug Severity Data
SAIL_QU
 

More from SAIL_QU (20)

Studying the Integration Practices and the Evolution of Ad Libraries in the G...
Studying the Integration Practices and the Evolution of Ad Libraries in the G...Studying the Integration Practices and the Evolution of Ad Libraries in the G...
Studying the Integration Practices and the Evolution of Ad Libraries in the G...
 
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
 
Improving the testing efficiency of selenium-based load tests
Improving the testing efficiency of selenium-based load testsImproving the testing efficiency of selenium-based load tests
Improving the testing efficiency of selenium-based load tests
 
Studying User-Developer Interactions Through the Distribution and Reviewing M...
Studying User-Developer Interactions Through the Distribution and Reviewing M...Studying User-Developer Interactions Through the Distribution and Reviewing M...
Studying User-Developer Interactions Through the Distribution and Reviewing M...
 
Studying online distribution platforms for games through the mining of data f...
Studying online distribution platforms for games through the mining of data f...Studying online distribution platforms for games through the mining of data f...
Studying online distribution platforms for games through the mining of data f...
 
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
Understanding the Factors for Fast Answers in Technical Q&A Websites: An Empi...
 
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
Investigating the Challenges in Selenium Usage and Improving the Testing Effi...
 
Mining Development Knowledge to Understand and Support Software Logging Pract...
Mining Development Knowledge to Understand and Support Software Logging Pract...Mining Development Knowledge to Understand and Support Software Logging Pract...
Mining Development Knowledge to Understand and Support Software Logging Pract...
 
Which Log Level Should Developers Choose For a New Logging Statement?
Which Log Level Should Developers Choose For a New Logging Statement?Which Log Level Should Developers Choose For a New Logging Statement?
Which Log Level Should Developers Choose For a New Logging Statement?
 
Towards Just-in-Time Suggestions for Log Changes
Towards Just-in-Time Suggestions for Log ChangesTowards Just-in-Time Suggestions for Log Changes
Towards Just-in-Time Suggestions for Log Changes
 
The Impact of Task Granularity on Co-evolution Analyses
The Impact of Task Granularity on Co-evolution AnalysesThe Impact of Task Granularity on Co-evolution Analyses
The Impact of Task Granularity on Co-evolution Analyses
 
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bu...
 
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
A Study of the Relation of Mobile Device Attributes with the User-Perceived Q...
 
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
A Large-Scale Study of the Impact of Feature Selection Techniques on Defect C...
 
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...Studying the Dialogue Between Users and Developers of Free Apps in the Google...
Studying the Dialogue Between Users and Developers of Free Apps in the Google...
 
What Do Programmers Know about Software Energy Consumption?
What Do Programmers Know about Software Energy Consumption?What Do Programmers Know about Software Energy Consumption?
What Do Programmers Know about Software Energy Consumption?
 
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
Threshold for Size and Complexity Metrics: A Case Study from the Perspective ...
 
Revisiting the Experimental Design Choices for Approaches for the Automated R...
Revisiting the Experimental Design Choices for Approaches for the Automated R...Revisiting the Experimental Design Choices for Approaches for the Automated R...
Revisiting the Experimental Design Choices for Approaches for the Automated R...
 
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
Measuring Program Comprehension: A Large-Scale Field Study with ProfessionalsMeasuring Program Comprehension: A Large-Scale Field Study with Professionals
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
 
On the Unreliability of Bug Severity Data
On the Unreliability of Bug Severity DataOn the Unreliability of Bug Severity Data
On the Unreliability of Bug Severity Data
 

Dormant bug v2

  • 1. An Empirical Study of Dormant Bugs Tse-Hsun(Peter) Chen Meiyappan Nagappan Emad Shihab Ahmed E. Hassan 1
  • 2. Most studies focus on post-release bugs 2 Version A Version B File A Bug 1 Bug 2 Bugs Discovered!Assign Bugs to File A
  • 3. Some bugs may remain dormant for a long time 3 Version A Version CVersion B File A Bug is waken up, but is counted as post-release bug for Version B Zzz… Zzz…
  • 4. What are dormant bugs? 4 Version BVersion A Version C Today File A Bug 1 File B Bug 2 Bug 3 Bugs introduced in Version A Not a dormant bug Bug 2 Dormant bug (discovered one version after it was introduced ) Dormant bug (discovered many versions after it was introduced ) Bug 1 … Zzz..Zzz.. Bug 3
  • 5. Dormant bugs affect perceived software quality 5 VersionA Version B Version A has 5 bugs Version B has 10 bugs
  • 6. Dormant bugs affect perceived software quality 6 VersionA Version B Version A has 5 bugs Version B has 10 bugs Version B has 8 dormant bugs! These dormant bugs were introduced in version A
  • 7. Case study on 20 systems 7 Studied 20 open-source systems in the Apache Foundation Analyzed all versions System LOCs: 61K ~ 1.5M # dormant bugs 29% # non- dormant bugs 71%
  • 8. Many bugs are actually dormant bugs 8 VersionA Version C Bug introduced in Version A 33% of bugs become dormant bugs! VersionA Bugs reported in Version A Many post-release bugs are actually introduced in MUCH EARLIER versions! 20% of bugs are dormant bugs from prior versions
  • 9. RQ1: How quickly are dormant bugs fixed? Research questions 9 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 10. RQ1: How quickly are dormant bugs fixed? Research questions 10 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 11. Dormant bugs are fixed faster and the fixes are larger 11 Dormant Non-dormant Take 5 days to fix (median) Takes 60% more time to fix Dormant Non-dormant Fix size is 19 LOC (median) Fix size is 50% smaller
  • 12. RQ1: How quickly are dormant bugs fixed? Research questions 12 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 13. RQ1: How quickly are dormant bugs fixed? Research questions 13 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 14. Dormant fixers are more experienced 14 Dormant Non-dormant #ofpriorcommitsofbugfixers
  • 15. RQ1: How quickly are dormant bugs fixed? Research questions 15 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 16. RQ1: How quickly are dormant bugs fixed? Research questions 16 RQ2: What is the size of a dormant bug fix? RQ3: Who fixes dormant bugs? RQ4: What are the root causes of dormant bug fixes?
  • 17. Manual study of the root causes 17 All bugs Randomly sampled 357 dormant bugs and 357 non-dormant bugs Manually classify the bugs
  • 19. Dormant bugs are different from non- dormant bugs 19 We should consider dormant bugs in future studies to avoid bias They are different!
  • 20. 20
  • 21. 21
  • 22. 22
  • 23. 23
  • 24. 24