Successfully reported this slideshow.
QUALGEN:  Modeling and Analysing the Quality of  Evolving Software Systems Tom Mens, Leandro Doctors {tom.mens | leandro.d...
Overview <ul><li>Context </li></ul><ul><li>Quality Metamodel  </li></ul><ul><li>Evolving Software Ecosystem </li></ul><ul>...
Context <ul><li>Funded by the European Regional Development Fund (ERDF)  </li></ul><ul><ul><li>2007-2013 program </li></ul...
Context <ul><li>Project lead by the Center of Excellence in Information and Communication Technologies (CETIC). </li></ul>...
Context <ul><li>QUALGEN workpackage </li></ul><ul><ul><li>carried out in the context of the theme “Methodologies for devel...
Context <ul><li>QUALGEN workpackage </li></ul><ul><ul><li>modeling and evolution of quality from different points of view ...
Quality Metamodel <ul><li>Model-Centric Quality Assessment (MoCQA) framework </li></ul><ul><ul><li>theoretical framework  ...
Quality Metamodel <ul><li>Quality-related </li></ul><ul><ul><li>Definition or reuse of a hierarchy of quality factors  </l...
Evolving Software Systems <ul><li>Ecosystem-centered approach  </li></ul><ul><ul><li>“ no project is an island. Software p...
Evolving Software Systems <ul><li>Different stakeholders </li></ul><ul><ul><li>different /contradictory points of view on ...
Evolving Software Distributions <ul><li>Focus on libre and open source software distributions </li></ul><ul><ul><li>collec...
Evolving Software Distributions <ul><li>Application of quality assessment methods  (GQM, Qualipso) on Ubuntu and Debian </...
Research Methodology  <ul><li>Objectives and collaboration </li></ul><ul><ul><li>Analysis of evolving software distributio...
<ul><li>Objectives and collaboration </li></ul><ul><ul><li>Analysis of evolving software distributions  </li></ul></ul><ul...
Research Methodology  <ul><li>Iterative approach </li></ul><ul><li>Structure a candidate quality hypothesis hierarchy </li...
Future Work <ul><li>Validation of the customised quality model (and the quality metamodel) on the Debian and Ubuntu case s...
Future Work <ul><li>Expected outcome  </li></ul><ul><ul><li>Tool support for the generation of Customized Quality Assessme...
Upcoming SlideShare
Loading in …5
×

QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems

919 views

Published on

Published in: Education, Technology, Business
  • Be the first to comment

  • Be the first to like this

QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems

  1. 1. QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems Tom Mens, Leandro Doctors {tom.mens | leandro.doctors}@umons.ac.be Naji Habra, Benoît Vanderose, Flora Kamseu {naji.habra | benoit.vanderose | flora.kamseu}@fundp.ac.be 15th European Conference on Software Maintenance and Reengineering March 1–4, 2011, Oldenburg, Germany
  2. 2. Overview <ul><li>Context </li></ul><ul><li>Quality Metamodel </li></ul><ul><li>Evolving Software Ecosystem </li></ul><ul><li>Research Methodology </li></ul><ul><li>Future work </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  3. 3. Context <ul><li>Funded by the European Regional Development Fund (ERDF) </li></ul><ul><ul><li>2007-2013 program </li></ul></ul><ul><ul><li>consortium </li></ul></ul><ul><ul><ul><li>4 universities from Wallonia (FUNDP, UMONS, UCL and ULB) </li></ul></ul></ul><ul><ul><ul><li>3 research centers (CETIC, CENAERO and MULTITEL) </li></ul></ul></ul><ul><ul><ul><li>several small- and medium-sized local companies involved in ICT </li></ul></ul></ul><ul><li>Supported by Wallonia </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  4. 4. Context <ul><li>Project lead by the Center of Excellence in Information and Communication Technologies (CETIC). </li></ul><ul><ul><li>aimed at developing a portfolio of innovative techniques related to the engineering of information systems, allowing local companies to master the diversity, complexity, quality and rapid evolution of these systems </li></ul></ul><ul><li>Two virtual centers of expertise : </li></ul><ul><ul><li>CEIQS: Center of expertise in engineering and quality of systems </li></ul></ul><ul><ul><li>CELLAVI: Center of expertise on the use of libre software in industry </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  5. 5. Context <ul><li>QUALGEN workpackage </li></ul><ul><ul><li>carried out in the context of the theme “Methodologies for developing and evolving (software-intensive) systems” </li></ul></ul><ul><ul><ul><li>focus on open source software projects and software distributions </li></ul></ul></ul><ul><ul><li>close collaboration between Belgian universities (FUNDP and UMONS) since 2010 in the context of the CEIQS center </li></ul></ul><ul><ul><ul><li>1 full-time person for 4 years (UMONS) </li></ul></ul></ul><ul><ul><ul><li>1 full-time person for 2 years (FUNDP) </li></ul></ul></ul><ul><ul><li>in relation with the research activities of the CELLAVI center (libre software) </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  6. 6. Context <ul><li>QUALGEN workpackage </li></ul><ul><ul><li>modeling and evolution of quality from different points of view </li></ul></ul><ul><li>development and subsequent instantiation and validation of a quality metamodel </li></ul><ul><li>study and control of quality evolution of software ecosystems </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  7. 7. Quality Metamodel <ul><li>Model-Centric Quality Assessment (MoCQA) framework </li></ul><ul><ul><li>theoretical framework </li></ul></ul><ul><ul><li>based software measurement principles </li></ul></ul><ul><ul><li>quality model approach </li></ul></ul><ul><ul><li>continued quality assessment of software </li></ul></ul><ul><li>Generation of customised quality models </li></ul><ul><ul><li>rely on a quality metamodel </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  8. 8. Quality Metamodel <ul><li>Quality-related </li></ul><ul><ul><li>Definition or reuse of a hierarchy of quality factors </li></ul></ul><ul><li>Measurement-related </li></ul><ul><ul><li>Definition or reuse of measurement method </li></ul></ul><ul><ul><li>Associated to the quality factors </li></ul></ul><ul><li>Project-related concepts </li></ul><ul><ul><li>Project vs product </li></ul></ul><ul><ul><li>Software ≠ black-box </li></ul></ul><ul><ul><li>Scope = project ≈ ecosystem </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  9. 9. Evolving Software Systems <ul><li>Ecosystem-centered approach </li></ul><ul><ul><li>“ no project is an island. Software projects exist in larger contexts [, . . . ] ecosystems” [Lungu09] </li></ul></ul><ul><li>Software ecosystem (in our context) </li></ul><ul><ul><li>artifacts (source code, documentation, mailing list archives, packages, distributions) </li></ul></ul><ul><ul><li>stakeholders (developers, users, managers) </li></ul></ul><ul><ul><li>entities (communities, projects), </li></ul></ul><ul><ul><li>processes (development and business models) </li></ul></ul><ul><ul><li>any other influential aspect </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  10. 10. Evolving Software Systems <ul><li>Different stakeholders </li></ul><ul><ul><li>different /contradictory points of view on quality </li></ul></ul><ul><ul><li>different / contradictory quality priorities </li></ul></ul><ul><li>User communities : interested in popularity, usability and lack of defects </li></ul><ul><li>Developer communities : interested in readability, reusability, maintainability and portability (software packages) </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  11. 11. Evolving Software Distributions <ul><li>Focus on libre and open source software distributions </li></ul><ul><ul><li>collections of “assemblable” software components that work seamlessly together (software packages) </li></ul></ul><ul><ul><li>tools to manage and configure the entire system </li></ul></ul><ul><ul><li>examples : OS based on the Linux and/or *BSD kernels </li></ul></ul><ul><li>Important but understudied </li></ul><ul><li>Also “probably the most complex type of software ecosystem” [Lungu09] </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  12. 12. Evolving Software Distributions <ul><li>Application of quality assessment methods (GQM, Qualipso) on Ubuntu and Debian </li></ul><ul><ul><li>Ubuntu and Debian are “co-evolving” software distributions (“coopetition”) </li></ul></ul><ul><ul><li>availability of the Ultimate Debian Database (UDD) </li></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  13. 13. Research Methodology <ul><li>Objectives and collaboration </li></ul><ul><ul><li>Analysis of evolving software distributions </li></ul></ul><ul><ul><ul><li>development of a customised quality model </li></ul></ul></ul><ul><ul><ul><li>taking into account the specificities of stakeholder </li></ul></ul></ul><ul><ul><ul><li>taking into account the notion of ecosystem </li></ul></ul></ul><ul><ul><li>Model-Centric Quality Assessment framework </li></ul></ul><ul><ul><ul><li>validation of the quality metamodel instantiation process </li></ul></ul></ul><ul><ul><ul><li>validation of the usability of the generated models </li></ul></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  14. 14. <ul><li>Objectives and collaboration </li></ul><ul><ul><li>Analysis of evolving software distributions </li></ul></ul><ul><ul><li>Model-Centric Quality Assessment framework </li></ul></ul>Research Methodology / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany provides a framework to help formalize the quality hypothesis provides a concrete case to apply and validate the generation process
  15. 15. Research Methodology <ul><li>Iterative approach </li></ul><ul><li>Structure a candidate quality hypothesis hierarchy </li></ul><ul><ul><li>(a) stakeholders (e.g., user, developer) </li></ul></ul><ul><ul><li>(b) quality factors (e.g., popularity, readability) </li></ul></ul><ul><ul><li>(c) relationships and influences quality factors (i.e., influences). </li></ul></ul><ul><li>Define the measurable artifacts (e.g., packages, source code, bug tracking data, mailing lists) </li></ul><ul><li>Define the metrics and how they relate to the quality factors. </li></ul><ul><li>Validate the candidate model </li></ul><ul><li>Refine the candidate model </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  16. 16. Future Work <ul><li>Validation of the customised quality model (and the quality metamodel) on the Debian and Ubuntu case studies </li></ul><ul><li>Refinement of the MoCQA framework </li></ul><ul><li>Generalization of the customised quality model to other case studies of evolving software distributions </li></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany
  17. 17. Future Work <ul><li>Expected outcome </li></ul><ul><ul><li>Tool support for the generation of Customized Quality Assessment Model </li></ul></ul><ul><ul><ul><li>graphical quality model editor </li></ul></ul></ul><ul><ul><ul><li>relying on the MoCQA metamodel </li></ul></ul></ul><ul><ul><li>Tool support for the analysis of the quality and evolution of software distributions </li></ul></ul><ul><ul><ul><li>relying on the generated CAQM </li></ul></ul></ul><ul><ul><ul><li>adapting to the needs of each type of stakeholder/user </li></ul></ul></ul> / 17 CSMR 2011 - March 1–4, 2011, Oldenburg, Germany

×