ICSE ‘09: New Ideas and Emerging ResultsDebugging Field Failures byMinimizing Captured ExecutionsJames Clause and Alessand...
ICSE ‘09: New Ideas and Emerging ResultsWhat are field failures?Failures that occur afterapplication deploymentDifficult to ...
ICSE ‘09: New Ideas and Emerging ResultsCurrent approachesCollect limitedinformationAsk the userhow to reproduce3
ICSE ‘09: New Ideas and Emerging ResultsReplay / DebugDevelop Record✘CapturedfailureInthefieldInhouseOur approach4
ICSE ‘09: New Ideas and Emerging ResultsOur approachInthefieldInhouseReplay / DebugDevelop Record✘Minimize✘Capturedfailure✘...
ICSE ‘09: New Ideas and Emerging ResultsRecordingCapture high-leveleventsefficientamenable tominimization6
ICSE ‘09: New Ideas and Emerging ResultsReplayingInterfere as little aspossibleredirect high-leveleventsmaintain relative ...
ICSE ‘09: New Ideas and Emerging ResultsMinimizationFocus debugging effortIteratively remove whatis not necessary forrepro...
ICSE ‘09: New Ideas and Emerging Results2-phase minimizationTime minimization✂Data minimization9
ICSE ‘09: New Ideas and Emerging ResultsTime minimizationRemove idle timesReduce event latency10
ICSE ‘09: New Ideas and Emerging ResultsData minimizationRemove datahierarchically1. complete files2. pieces of files3. indi...
ICSE ‘09: New Ideas and Emerging ResultsPrototype implementationRecord / Replayx86/libc binariesMinimizationcustomizable s...
ICSE ‘09: New Ideas and Emerging ResultsEvaluationRQ1: How effective isADDA at minimizingfailing executions?RQ2: How mucho...
ICSE ‘09: New Ideas and Emerging ResultsSubject and faultsTwo real field failuresfrom Pine’s historyaddress book faultheade...
ICSE ‘09: New Ideas and Emerging ResultsRQ1: Minimization results✘Around 10% of therecording remainsafter minimizationWe w...
ICSE ‘09: New Ideas and Emerging ResultsRQ2: Overhead resultsOnline: negligibleoverhead whilerecordingOffline: less than 75...
ICSE ‘09: New Ideas and Emerging ResultsFuture workSupportGUI eventsNon-determinismAdditional studies withmore subjectsADD...
ICSE ‘09: New Ideas and Emerging ResultsUtilize passing executionsCaptured failures areutilized for debuggingCaptured succ...
ICSE ‘09: New Ideas and Emerging ResultsAddress privacy issuesCaptured executionscan contain sensitiveinformationHow can w...
ICSE ‘09: New Ideas and Emerging ResultsThank youclause@cc.gatech.eduwww.cc.gatech.edu/~clause20
Upcoming SlideShare
Loading in …5
×

Debugging Field Failures by Minimizing Captured Executions (ICSE 2009: NIER example)

194 views
123 views

Published on

Published in: Technology, Sports
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
194
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Debugging Field Failures by Minimizing Captured Executions (ICSE 2009: NIER example)

  1. 1. ICSE ‘09: New Ideas and Emerging ResultsDebugging Field Failures byMinimizing Captured ExecutionsJames Clause and Alessandro OrsoGeorgia Institute of Technology1
  2. 2. ICSE ‘09: New Ideas and Emerging ResultsWhat are field failures?Failures that occur afterapplication deploymentDifficult to reproducein-house ➞ difficult todebug2
  3. 3. ICSE ‘09: New Ideas and Emerging ResultsCurrent approachesCollect limitedinformationAsk the userhow to reproduce3
  4. 4. ICSE ‘09: New Ideas and Emerging ResultsReplay / DebugDevelop Record✘CapturedfailureInthefieldInhouseOur approach4
  5. 5. ICSE ‘09: New Ideas and Emerging ResultsOur approachInthefieldInhouseReplay / DebugDevelop Record✘Minimize✘Capturedfailure✘Minimizedfailure5
  6. 6. ICSE ‘09: New Ideas and Emerging ResultsRecordingCapture high-leveleventsefficientamenable tominimization6
  7. 7. ICSE ‘09: New Ideas and Emerging ResultsReplayingInterfere as little aspossibleredirect high-leveleventsmaintain relative timeof events7
  8. 8. ICSE ‘09: New Ideas and Emerging ResultsMinimizationFocus debugging effortIteratively remove whatis not necessary forreproducing the failure✘8
  9. 9. ICSE ‘09: New Ideas and Emerging Results2-phase minimizationTime minimization✂Data minimization9
  10. 10. ICSE ‘09: New Ideas and Emerging ResultsTime minimizationRemove idle timesReduce event latency10
  11. 11. ICSE ‘09: New Ideas and Emerging ResultsData minimizationRemove datahierarchically1. complete files2. pieces of files3. individual characters✂11
  12. 12. ICSE ‘09: New Ideas and Emerging ResultsPrototype implementationRecord / Replayx86/libc binariesMinimizationcustomizable scriptsLimitationsnon-determinismGUI inputsADDAAssisting the Debugging ofDeployed Applications12
  13. 13. ICSE ‘09: New Ideas and Emerging ResultsEvaluationRQ1: How effective isADDA at minimizingfailing executions?RQ2: How muchoverhead does ADDAimpose?ADDAAssisting the Debugging ofDeployed Applications13
  14. 14. ICSE ‘09: New Ideas and Emerging ResultsSubject and faultsTwo real field failuresfrom Pine’s historyaddress book faultheader-color faultPine email and news client14
  15. 15. ICSE ‘09: New Ideas and Emerging ResultsRQ1: Minimization results✘Around 10% of therecording remainsafter minimizationWe were able todebug the failuresusing the minimizedrecording15
  16. 16. ICSE ‘09: New Ideas and Emerging ResultsRQ2: Overhead resultsOnline: negligibleoverhead whilerecordingOffline: less than 75minutes to minimize16
  17. 17. ICSE ‘09: New Ideas and Emerging ResultsFuture workSupportGUI eventsNon-determinismAdditional studies withmore subjectsADDAAssisting the Debugging ofDeployed Applications17
  18. 18. ICSE ‘09: New Ideas and Emerging ResultsUtilize passing executionsCaptured failures areutilized for debuggingCaptured successfulexecutions arediscardedCan we also usethem?Record✘Minimize✘Capturedfailure✔CapturedsuccessTrash18
  19. 19. ICSE ‘09: New Ideas and Emerging ResultsAddress privacy issuesCaptured executionscan contain sensitiveinformationHow can we sanitizesensitive informationbut make sure thefailure still occurs?✘CapturedfailureCredit card numbersEmail addressesAccount namesPasswords19
  20. 20. ICSE ‘09: New Ideas and Emerging ResultsThank youclause@cc.gatech.eduwww.cc.gatech.edu/~clause20

×