Crowdstacking Traces: a collaborative approach to identify software defects -- SANER 2015

1. Tommaso Dal Sasso
Andrea Mocci
Michele Lanza
University of Lugano
Misery Loves Company
CrowdStacking Traces to Aid Problem Detection
SANER 2015

2. Development

4. Stack Traces

5. Stack Traces
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueIn:put:during:
EpCurrentEvent>>value:during:
BlockClosure>>triggering:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluateSelectionAndDo:
SmalltalkEditor>>evaluateSelection
PluggableTextMorph>>doIt
PluggableTextMorph>>handleEdit:
TextMorphForEditView>>handleEdit:
PluggableTextMorph>>handleEdit:
PluggableTextMorph>>doIt
SmalltalkEditor class>>buildSmalltalkEditorKeymappingsOn:
BlockClosure>>cull:
BlockClosure>>cull:cull:
BlockClosure>>cull:cull:cull:
KMCategoryBinding>>completeMatch:buffer:
KMKeymap>>notifyCompleteMatchTo:buffer:
Array>>do:
KMKeymap>>notifyCompleteMatchTo:buffer:
KMKeymap>>onMatchWith:notify:andDo:
KMCategory>>onMatchWith:notify:andDo:

6. Stack Traces
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueIn:put:during:
EpCurrentEvent>>value:during:
BlockClosure>>triggering:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluateSelectionAndDo:
SmalltalkEditor>>evaluateSelection
PluggableTextMorph>>doIt
PluggableTextMorph>>handleEdit:
TextMorphForEditView>>handleEdit:
PluggableTextMorph>>handleEdit:
PluggableTextMorph>>doIt
SmalltalkEditor class>>buildSmalltalkEditorKeymappingsOn:
BlockClosure>>cull:
BlockClosure>>cull:cull:
BlockClosure>>cull:cull:cull:
KMCategoryBinding>>completeMatch:buffer:
KMKeymap>>notifyCompleteMatchTo:buffer:
Array>>do:
KMKeymap>>notifyCompleteMatchTo:buffer:
KMKeymap>>onMatchWith:notify:andDo:
KMCategory>>onMatchWith:notify:andDo:

7. Can we use this data?

8. Stack Traces
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat
SmallInteger>>/
UndefinedObject>>DoIt
OpalCompiler>>evaluate
BlockClosure>>ensure:
EpCurrentEvent>>valueI
n:put:during:
EpCurrentEvent>>value:d
uring:
BlockClosure>>triggering
:
OpalCompiler>>evaluate
SmalltalkEditor>>evaluat

10. Development Data

11. ShoreLine Reporter
A reporting tool for Pharo

15. Collected Data
Date
Author Name Stack Trace
ClassName>>method:
Version
(date, update, name)

16. June — November 2014
# of stack traces 7,532
# of lines in all stack traces 252,668
# of developers 8
average lines of a stack trace 34
size of the longest stack trace 314

17. Using the Data
Bugs
Understand Execution
Community

20. Clustering Stack Traces
Vector Space Model
ClassName>>method
ClassName>>method
ClassName>>method
…
<1,0,1,1,…>
Cosine similarity
distance between two stack traces

22. Archetype Popularity
UndefinedObject»doesNotUnderstand: 1,585
UndefinedObject»doesNotUnderstand: 647
UndefinedObject»DoIt 619
… …
SystemDictionary»errorKeyNotFound: 71
MouseWheelEvent»doesNotUnderstand: 69
UndefinedObject»doesNotUnderstand: 57
NBGLFrameBuffer»error: 41
Language features
Anomalies

23. Match with the Bug Tracker
Stack Traces Bug Tracker

24. 23
‣ Specific project
‣ Misuse of API
‣ Untracked Bug
‣ Bug reports related
to the exception
Filtered
Stack Traces
15
No match
8
Match

25. The case of Bug #12973
PluggableButtonMorph(Morph)>>handleKeyDown:
KeyboardEvent>>sentTo:
PluggableButtonMorph(Morph)>>handleEvent:
PluggableButtonMorph(Morph)>>handleFocusEvent:
[
ActiveHand := self.
ActiveEvent := anEvent.
result := focusHolder handleFocusEvent: (anEvent transformedBy:
(focusHolder transformedFrom: self)) ] in
HandMorph>>sendFocusEvent:to:clear:
BlockClosure>>on:do:
WorldMorph(PasteUpMorph)>>becomeActiveDuring:
HandMorph>>sendFocusEvent:to:clear:
HandMorph>>sendEvent:focus:clear:
HandMorph>>sendKeyboardEvent:
HandMorph>>handleEvent:
HandMorph>>processEvents
[ :h |
ActiveHand := h.
h processEvents.

26. Description
Discussion
Patch
Resolution
Stack Trace

27. Use of Related Bug Reports
‣ Give context to the current error
‣ Support the debugging process
‣ Provide feedback on the status of a defect
‣ Support understanding of undocumented code

28. Crowdstacking Traces
Using the activity of the community to help the code
development
Provide a smart environment
to deal with software defects
Build a dataset of fresh execution data

29. Crowdstacking Traces
http://shoreline.inf.usi.ch/