Nearest neighbor, defect prediction

Nearest Neighbor Sampling for Cross Company Defect Predictors Burak Turhan, Ayse Bener, (Bogazici University, Turkey) Tim Menzies (WVU, USA) DEFECTS’08 Seattle, USA

Is PROMISE useful? http://promisedata.org ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Generality in SE ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Setting up data, features learners, performance measures

Data (the usual suspects, plus 3) ,[object Object],[object Object],[object Object],[object Object]

Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Learner ,[object Object],[object Object],Lessman et.al IEEE TSE’09: AUC TP vs FP Jiang et.al Defects’08 : AUC pd vs pf

Performance reporting ,[object Object],[object Object],[object Object],[object Object],[object Object],Menzies et.al TSE’07

Experiments results, implications

Experiment #1: local vs imported ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Local vs imported

Experiment #1: results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Local vs imported

Experiment #2: local vs (imported+NN) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Local vs imported+NN vs imported new

Experiment #2: PD results ,[object Object],[object Object],[object Object],Local vs imported+NN vs imported CC= imported; NN=imported+NearNeigh; WC=local

[object Object],[object Object],[object Object],Local vs imported+NN vs imported Experiment #2: PF results CC= imported; NN=imported+NearNeigh; WC=local

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Local vs imported+NN vs imported Experiment #2: Discussion

[object Object],[object Object],[object Object],[object Object],Incremental Learning on local data Experiment #3: Incremental learning new ,[object Object],[object Object],[object Object]

Generality ,[object Object],[object Object],[object Object]

What have we learned? summary, conclusions

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Summary

Conclusions: generality in SE ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Implications of ceiling effects ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Nearest neighbor, defect prediction

Recommended

Recommended

More Related Content

Similar to Nearest neighbor, defect prediction

Similar to Nearest neighbor, defect prediction (20)

More from CS, NcState

More from CS, NcState (20)

Recently uploaded

Recently uploaded (20)

Nearest neighbor, defect prediction