Download as PDF, PPTX
Uploaded byLuca Ponzanelli
Mining Stack Overflow to Tun the IDE into a Self-confident Programming Prompter
The document discusses the development of a software tool called 'Prompter' aimed at enhancing developers' self-confidence in programming through effective query generation and recommendations sourced from Stack Overflow. It presents two studies that evaluate the tool's effectiveness, revealing that a significant majority of the developers found the recommendations useful and would utilize the tool in their daily tasks. The overall findings indicate that the Prompter improves development and maintenance tasks by facilitating better information retrieval and collaboration.
Mining Stack Overflow to Tun the IDE into a Self-confident Programming Prompter
- 1. Mining StackOverflow to Turnthe IDE into a Self-confident Programming Prompter Luca Ponzanelli, Gabriele Bavota, Massimiliano Di Penta, Rocco Oliveto, and Michele Lanza http://prompter.inf.usi.ch
- 2.
- 3.
- 4.
- 5.
- 6.
- 7. Recommender Systems for SoftwareEngineering M. P. Robillard, R. J. Walker, and T. Zimmerman Recommender systems for software engineering IEEE Software, 2010 “RSSEs are software applications that provide information estimated to be valuable for a software engineering task in a given context”
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 15. ● NP P 20406080100 Treatment Completeness Development Task NP= Without Prompter P = With Prompter Prompter is effective in development tasks
- 16.
- 17.
- 18. Query Generation Service Prompter Eclipse Code Context org.tartarus.snowball.SnowballStemmer org.tartarus.snowball.ext.englishStemmer java.util.List java.util.ArrayList String API Types setCurrent,getCurrent, stem, add API Method Names @Override public List<String> filter(final List<String> tokens) { final List<String> stemmed = new ArrayList<String>(); for(final String t : tokens){ SnowballStemmer stemmer = new englishStemmer(); stemmer.setCurrent(t); stemmer.stem(); stemmed.add(stemmer.getCurrent()); } return stemmed; } Entity Code
- 19.
- 20. Query Generation Service Prompter Eclipse Query @Override public List<String>filter(final List<String> tokens) { final List<String> stemmed = new ArrayList<String>(); for(final String t : tokens){ SnowballStemmer stemmer = new englishStemmer(); stemmer.setCurrent(t); stemmer.stem(); stemmed.add(stemmer.getCurrent()); } return stemmed; } Term Frequency Entropy Frequency * (1- Entropy) stemmer 6 0.15 5.1 stemmed 3 0.15 2.55 tokens 2 0.45 1.1 list 4 0.74 1.04 snowball 1 0.11 0.89 stem 1 0.25 0.75 english 1 0.51 0.49 filter 1 0.58 0.42 array 1 0.72 0.28 set 1 0.8 0.2 add 1 0.84 0.16
- 21.
- 22. Google Bing Blekko Search Engines Query Ranking Model Search Engines Proxy Search Service Code Context QueryGeneration Service Prompter Eclipse Results
- 23. Search Engines Proxy Ranking Model Prompter Query Generation Service Search Service Eclipse DiscussionsIDs Stack Overflow API Service Google Bing Blekko Search Engines
- 24. Stack Overflow API Service Ranking Model Search Engines Proxy Prompter QueryGeneration Service Search Service Eclipse Documents Google Bing Blekko Search Engines
- 25. Stack Overflow API Service Search Engines Proxy SearchService Prompter Eclipse Ranked Results Query Generation Service Ranking Model Google Bing Blekko Search Engines
- 26. Stack Overflow API Service QueryGeneration Service Prompter Eclipse Code Context Search Engines Proxy Search Service Prompter Eclipse Ranked Results Ranking Model Google Bing Blekko Search Engines Prompter Eclipse Query Query Code Context Query Results Documents
- 27. Query Generation Service Ranking Model StackOverflow API Service Prompter Eclipse Code Context Search Engines Proxy Search Service Ranked Results Google Bing Blekko Search EnginesQuery Query Code Context Query Results Documents
- 28.
- 29. ~ <code> … </code> @Override public List<String> filter(finalList<String> tokens) { final List<String> stemmed = new ArrayList<String>(); for(final String t : tokens){ SnowballStemmer stemmer = new englishStemmer(); stemmer.setCurrent(t); stemmer.stem(); stemmed.add(stemmer.getCurrent()); } return stemmed; } Entity Code
- 30. Code Related Textual Similarity CodeSimilarity API Types Similarity API Method Names Similarity Community Related Question Score Accepted Answer Score User Reputation Tags Similarity Code Context Similarity Features
- 31. 74 Code Context 2 RetrieveDiscussions (37 for Calibration) 1 Manual Classification 3 S = nX i=1 wi · fi nX i=1 wi = 1 having Model Calibration 4
- 32. Find all withat maximize the number of relevant discussions ranked at the top Model Calibration S = nX i=1 wi · fi nX i=1 wi = 1 having
- 33. Code Related (fi)wi Textual Similarity 0.32 Code Similarity 0.00 API Types Similarity 0.00 API Method Names Similarity 0.30 Community Related (fi) wi Question Score 0.07 Accepted Answer Score 0.00 User Reputation 0.13 Tags Similarity 0.18 S = nX i=1 wi · fi nX i=1 wi = 1 having Model Calibration
- 34.
- 35. Study I Evaluating RecommendationsAccuracy Study II Evaluating Prompter with Developers Validation
- 36. 33 Participants (Online Survey) Industry13 Ph.D. 9 Master 7 Bachelor 2 Faculty 2 Study I Evaluating Recommendations Accuracy
- 38. “76% of thediscussions where considered related (median 4) or strongly related (median 5) by developers, while only 10% was considered as unrelated.” Study I Summary
- 39. 12 Participants Industry 6 Master3 Bachelor 3 Study II Evaluating Prompter with Developers
- 40. Development Maintenance Prompter Prompter WithoutPrompterWithout Prompter
- 41. Development Maintenance Prompter Prompter WithoutPrompterWithout Prompter
- 42. NP P 406080100 Treatment Completeness ● NP P 20406080100 Treatment Completeness MaintenanceTask Development Task NP = Without Prompter P = With Prompter Study II Quantitative Analysis
- 43. Study II Qualitative Analysis 11out of 12 Participants would use Prompter in their daily activities
- 44. Study II Qualitative Analysis 11out of 12 Participants would use Prompter in their daily activities Explicitly write and execute queries
- 45. Turn the IDEinto a Self-Confident Programming Prompter Luca Ponzanelli, Gabriele Bavota, Massimiliano Di Penta, Rocco Oliveto, and Michele Lanza http://prompter.inf.usi.ch