+
The 20th Asia-Pacific Software Engineering Conference
APSEC’13
Presented by: Sofia Ouhbi
Software
Quality
Requirements
A systematic mapping study
Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval
3 Dec 2013
+
Software Quality Requirements
Introduction
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
2
+
“Although quality is pursued in order to satisfy users,
it is important to note that the quality desired by users
is not universal but rather subject to constant change”
SQuBOK, JUSE
2007
Software quality could be defined as “the totality of
characteristics of an entity that bear on it’s ability to
satisfy stated and implied needs”
ISO/IEC 9126-1
3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 3
+
ISO/IEC 250nn (SQuaRE)
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
2501n
Quality Model Division
2500n
Quality Management
Division
2502n
Quality Measurement
Division
2503n
Quality
Requirement
Division
2504n
Quality
Evaluation
Division
4
+
ISO/IEC 25030
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
Stakeholder
Needs
Stakeholder
Requirements
System
Requirements
Stakeholder
Quality
Needs
Stakeholder
Quality
Requirements
System Quality
Requirements
Software
Requirements
Software
Quality
Requirements
25010
Quality
Model
2502n
Quality
Measure
ment
Requirements
Definition
Process
Requirements
Analysis
Process
5
+
ISO/IEC 25030
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
Systemrequirements
Softwarerequirements
Softwareproduct
requirements
Other system
requirements
Software
development
requirements
Include for example requirements for computer hardware, data,
mechanical parts, and human business processes
Development organisation requirements
Development process requirements
Inherent
property
requirements
Functional requirements
Quality in use requirements
External quality requirements
Assigned
property
requirements
Managerial requirements including for example
requirements for price, delivery, date, product future,
and product supplier
Internal quality requirements
Software
quality
requirements
6
+
Software Quality Requirements
Systematic mapping study
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
7
+
Systematic mapping questions
• Which publication sources and channels are the main targets for SQR research?MQ1
• How has the frequency of SQR research changed over time?MQ2
• What are the research types of SQR studies?MQ3
• What are the research approaches of SQR studies?MQ4
• What are the contribution types of SQR research?MQ5
• What are the RE activities that were addressed by SQR research?MQ6
• What are the well-known SQ models that were used for specifying QR?MQ7
• What are the artifacts that were reported in SQR literature?MQ8
• What is the most reported SQR type in literature?MQ9
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
8
+
Search strategy
(Software OR Application*) AND Quality AND
(Requirement* OR Attribute* OR “No* functional” OR
Need*) AND (Engineer* OR Elicitat* OR Analys* OR Specif*
OR Validat* OR Process*)
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
IEEE Digital Library, ACM Digital Library,
Science Direct and Google scholar.
657 candidate
studies
9
+
Study selection
Published
papers
before
1990 and
after 2012
EC1
Papers
presenting
a general
focus on
SQ
EC2
Papers
presenting
a general
focus on
RE
EC3 Papers
that focus
only on
system
QR and do
not
discuss
SQR
EC4
Papers
that focus
only on
functional
requireme
nts
EC5
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
51 selected
studies
10
+
MQ1. Publication source
Conferences,
43%
RE
COMPSAC
CRIWG
DBKDA
ECSA
EMC
HICSS
IACC
ICCGI
ICIII
ICSE
ICSQ
ICSSEA
QSIC
QWE
SEAA
SEDM
SEKE
STRQA
SwSTE
Journals,
29%
REJ
IEEE Soft.
JOT
AE
ESWA
IEEE LAT
IEICE TIS
IST
JSS
SQP
TSE
Workshops,
20%
COMPSACW
REFSQ
WoSQ
IWSPM
SEW
SOQUA
Symposium, 4%
METRICS
SSD
Other,
4%
Book
PhD Thesis
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
11
+
MQ2. Publication trend
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
0
1
2
3
4
5
6
7
8
9
Identified studies Empirical studies
12
+ MQ3,4. Research types and approaches
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
14 12
61
9
9
0
5
10
15
20
25
30
Evaluation research Solution proposal Systematic investigation
Review
Theory
survey
Experiment
Case study
13
+
MQ3,4,5,6 results summary
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
14
+
MQ7. SQ models
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
34%
2%
2%
4%
58%
ISO/IEC 9126
McCall
Boehm
Other
No
15
+
MQ8,9. Artifacts and SQR types
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
16
+Conclusions and Implications
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
o Theoretical solutions need to be applied in practice and validated
empirically
o There is a need for more studies:
o focusing on the non-functional requirements validation,
o which identify and specify SQR according to a chosen SQ model
o Researchers should get familiarized with ISO/IEC 25010 standard
o SQ in use requirements need to be more explored by SQR researchers
17
Future research
o SLR on empirical SQR studies
+
Thank you for your attention!
Any questions?
3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 18
+
The 20th Asia-Pacific Software Engineering Conference
APSEC’13
Presented by: Sofia Ouhbi
Software
Quality
Requirements
A systematic mapping study
Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval
3 Dec 2013

Software quality requirements: a systematic mapping study

  • 1.
    + The 20th Asia-PacificSoftware Engineering Conference APSEC’13 Presented by: Sofia Ouhbi Software Quality Requirements A systematic mapping study Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval 3 Dec 2013
  • 2.
    + Software Quality Requirements Introduction 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 2
  • 3.
    + “Although quality ispursued in order to satisfy users, it is important to note that the quality desired by users is not universal but rather subject to constant change” SQuBOK, JUSE 2007 Software quality could be defined as “the totality of characteristics of an entity that bear on it’s ability to satisfy stated and implied needs” ISO/IEC 9126-1 3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 3
  • 4.
    + ISO/IEC 250nn (SQuaRE) 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 2501n Quality Model Division 2500n Quality Management Division 2502n Quality Measurement Division 2503n Quality Requirement Division 2504n Quality Evaluation Division 4
  • 5.
    + ISO/IEC 25030 3 Dec2013Software Quality Requirements: A systematic mapping study. APSEC'13 Stakeholder Needs Stakeholder Requirements System Requirements Stakeholder Quality Needs Stakeholder Quality Requirements System Quality Requirements Software Requirements Software Quality Requirements 25010 Quality Model 2502n Quality Measure ment Requirements Definition Process Requirements Analysis Process 5
  • 6.
    + ISO/IEC 25030 3 Dec2013Software Quality Requirements: A systematic mapping study. APSEC'13 Systemrequirements Softwarerequirements Softwareproduct requirements Other system requirements Software development requirements Include for example requirements for computer hardware, data, mechanical parts, and human business processes Development organisation requirements Development process requirements Inherent property requirements Functional requirements Quality in use requirements External quality requirements Assigned property requirements Managerial requirements including for example requirements for price, delivery, date, product future, and product supplier Internal quality requirements Software quality requirements 6
  • 7.
    + Software Quality Requirements Systematicmapping study 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 7
  • 8.
    + Systematic mapping questions •Which publication sources and channels are the main targets for SQR research?MQ1 • How has the frequency of SQR research changed over time?MQ2 • What are the research types of SQR studies?MQ3 • What are the research approaches of SQR studies?MQ4 • What are the contribution types of SQR research?MQ5 • What are the RE activities that were addressed by SQR research?MQ6 • What are the well-known SQ models that were used for specifying QR?MQ7 • What are the artifacts that were reported in SQR literature?MQ8 • What is the most reported SQR type in literature?MQ9 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 8
  • 9.
    + Search strategy (Software ORApplication*) AND Quality AND (Requirement* OR Attribute* OR “No* functional” OR Need*) AND (Engineer* OR Elicitat* OR Analys* OR Specif* OR Validat* OR Process*) 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 IEEE Digital Library, ACM Digital Library, Science Direct and Google scholar. 657 candidate studies 9
  • 10.
    + Study selection Published papers before 1990 and after2012 EC1 Papers presenting a general focus on SQ EC2 Papers presenting a general focus on RE EC3 Papers that focus only on system QR and do not discuss SQR EC4 Papers that focus only on functional requireme nts EC5 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 51 selected studies 10
  • 11.
    + MQ1. Publication source Conferences, 43% RE COMPSAC CRIWG DBKDA ECSA EMC HICSS IACC ICCGI ICIII ICSE ICSQ ICSSEA QSIC QWE SEAA SEDM SEKE STRQA SwSTE Journals, 29% REJ IEEESoft. JOT AE ESWA IEEE LAT IEICE TIS IST JSS SQP TSE Workshops, 20% COMPSACW REFSQ WoSQ IWSPM SEW SOQUA Symposium, 4% METRICS SSD Other, 4% Book PhD Thesis 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 11
  • 12.
    + MQ2. Publication trend 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 0 1 2 3 4 5 6 7 8 9 Identified studies Empirical studies 12
  • 13.
    + MQ3,4. Researchtypes and approaches 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 14 12 61 9 9 0 5 10 15 20 25 30 Evaluation research Solution proposal Systematic investigation Review Theory survey Experiment Case study 13
  • 14.
    + MQ3,4,5,6 results summary 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 14
  • 15.
    + MQ7. SQ models 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 34% 2% 2% 4% 58% ISO/IEC 9126 McCall Boehm Other No 15
  • 16.
    + MQ8,9. Artifacts andSQR types 3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 16
  • 17.
    +Conclusions and Implications 3Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13 o Theoretical solutions need to be applied in practice and validated empirically o There is a need for more studies: o focusing on the non-functional requirements validation, o which identify and specify SQR according to a chosen SQ model o Researchers should get familiarized with ISO/IEC 25010 standard o SQ in use requirements need to be more explored by SQR researchers 17 Future research o SLR on empirical SQR studies
  • 18.
    + Thank you foryour attention! Any questions? 3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 18
  • 19.
    + The 20th Asia-PacificSoftware Engineering Conference APSEC’13 Presented by: Sofia Ouhbi Software Quality Requirements A systematic mapping study Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval 3 Dec 2013