Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Practical experiences and value of applying software analytics to manage quality

14 views

Published on

ESEM confefence presenting a paper on practical experiences and value of applying software analytics to manage quality

Published in: Software
  • Be the first to comment

  • Be the first to like this

Practical experiences and value of applying software analytics to manage quality

  1. 1. Practical experiences and value of applying software analytics to manage quality Anna Maria Vollmer, Silverio Martínez-Fernández, Alessandra Bagnato, Jari Partanen, Lidia López and Pilar Rodríguez
  2. 2. Motivation: provide support to manage quality in the context of agile software development Solution: a software analytics platform o Raw data visualization o Dashboard on aggregated data with software analytics features o Semi-Automatic generation of quality requirements www.q-rapids.eu github.com/q-rapids Context: Q-Rapids Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 2 ... ...
  3. 3. Analyze the impact and related benefits of Q-Rapids with respect to realistic usage from the perspective of project managers, technical leads, and developers in the context of managing quality in agile software development. Research Methodology Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 3 Summative stageFormative stage 26 months 10 months 1st evaluation: Proof of concept 2nd evaluation: Consolidated versionTraining Tasks Questionnaire Feedback … Training Tasks Questionnaire Group discussions
  4. 4. Research Methodology Part 1: Tracking the use of the software analytics platform over a period of time Online questionnaire in Limesurvey with an usage story template to explain how Q-Rapids was being used Part 2: Collecting feedback from practitioners on-site Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 4 Summative stage 3rd evaluation: Integrated solutionPresentation of company context and data Questionnaire Moderated group discussion Usage of Q-Rapids in real settings of the pilot projects
  5. 5. Expected Benefits Company A – Release frequency Increased number of releases per time unit. – Feature throughput Increased percentage of features that meet time-to-market targets with the desired levels of quality. – Realized requirements Increased proportion of quality requirements that are used in actual features and releases. – Product quality Refers to the maintainability, reliability, and functional suitability of the software product. – Process performance Improved process performance regarding the software development in terms of efficiency and quality of the software lifecycle processes used. Company B – Productivity rate Refers to the time used for the development and testing of new features / time used for maintenance or defect removal. – Quality feedback loop Refers to the proportion of quality requirements that are used in actual features and releases. – Product readiness Refers to a product that is ready to be released (i.e., a product implementing the features planned in the release and without blocking issues). – Product quality Refers to the maintainability, reliability, and functional suitability of the software product. Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 5
  6. 6. Results – Main benefits Company A 1. Semi-automated generation of quality requirements 2. Reflect on and check the process based on measured data 3. Improvement and transparency regarding product quality based on a data-driven baseline for decision-making 4. Possibility to build new releases based on a healthy baseline according to measured data (instead of every day) Company B 1. Semi-automated generation of quality requirements (& integrated into the software process) 2. Improvement and transparency regarding product quality based on a data-driven baseline for decision-making 3. Reflect on and check the process based on measured data integrating many aspects 4. Increased awareness of product readiness Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 6
  7. 7. Improve stability and configurability of Q-Rapids for increase the usage inside the company to other groups and people o Simplification of platform installation o Need for an efficient configuration process o Tailoring to the company o Integration with other tools Polish processes with more data-driven decision-making based on the information provided by Q-Rapids Increase the number of quality requirements semi-automatically managed by Q-Rapids Future Work Practical experiences and value of applying software analytics to manage quality Vollmer, ESEM - 19th September 2019 7
  8. 8. This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 732253. Questions

×