20th Asia-Pacific Software Engineering Conference (APSEC'13)

1. +
The 20th Asia-Pacific Software Engineering Conference
APSEC’13
Presented by: Sofia Ouhbi
Software
Quality
Requirements
A systematic mapping study
Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval
3 Dec 2013

2. +
Software Quality Requirements
Introduction
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
2

3. +
“Although quality is pursued in order to satisfy users,
it is important to note that the quality desired by users
is not universal but rather subject to constant change”
SQuBOK, JUSE
2007
Software quality could be defined as “the totality of
characteristics of an entity that bear on it’s ability to
satisfy stated and implied needs”
ISO/IEC 9126-1
3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 3

4. +
ISO/IEC 250nn (SQuaRE)
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
2501n
Quality Model Division
2500n
Quality Management
Division
2502n
Quality Measurement
Division
2503n
Quality
Requirement
Division
2504n
Quality
Evaluation
Division
4

5. +
ISO/IEC 25030
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
Stakeholder
Needs
Stakeholder
Requirements
System
Requirements
Stakeholder
Quality
Needs
Stakeholder
Quality
Requirements
System Quality
Requirements
Software
Requirements
Software
Quality
Requirements
25010
Quality
Model
2502n
Quality
Measure
ment
Requirements
Definition
Process
Requirements
Analysis
Process
5

6. +
ISO/IEC 25030
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
Systemrequirements
Softwarerequirements
Softwareproduct
requirements
Other system
requirements
Software
development
requirements
Include for example requirements for computer hardware, data,
mechanical parts, and human business processes
Development organisation requirements
Development process requirements
Inherent
property
requirements
Functional requirements
Quality in use requirements
External quality requirements
Assigned
property
requirements
Managerial requirements including for example
requirements for price, delivery, date, product future,
and product supplier
Internal quality requirements
Software
quality
requirements
6

7. +
Software Quality Requirements
Systematic mapping study
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
7

8. +
Systematic mapping questions
• Which publication sources and channels are the main targets for SQR research?MQ1
• How has the frequency of SQR research changed over time?MQ2
• What are the research types of SQR studies?MQ3
• What are the research approaches of SQR studies?MQ4
• What are the contribution types of SQR research?MQ5
• What are the RE activities that were addressed by SQR research?MQ6
• What are the well-known SQ models that were used for specifying QR?MQ7
• What are the artifacts that were reported in SQR literature?MQ8
• What is the most reported SQR type in literature?MQ9
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
8

9. +
Search strategy
(Software OR Application*) AND Quality AND
(Requirement* OR Attribute* OR “No* functional” OR
Need*) AND (Engineer* OR Elicitat* OR Analys* OR Specif*
OR Validat* OR Process*)
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
IEEE Digital Library, ACM Digital Library,
Science Direct and Google scholar.
657 candidate
studies
9

10. +
Study selection
Published
papers
before
1990 and
after 2012
EC1
Papers
presenting
a general
focus on
SQ
EC2
Papers
presenting
a general
focus on
RE
EC3 Papers
that focus
only on
system
QR and do
not
discuss
SQR
EC4
Papers
that focus
only on
functional
requireme
nts
EC5
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
51 selected
studies
10

11. +
MQ1. Publication source
Conferences,
43%
RE
COMPSAC
CRIWG
DBKDA
ECSA
EMC
HICSS
IACC
ICCGI
ICIII
ICSE
ICSQ
ICSSEA
QSIC
QWE
SEAA
SEDM
SEKE
STRQA
SwSTE
Journals,
29%
REJ
IEEE Soft.
JOT
AE
ESWA
IEEE LAT
IEICE TIS
IST
JSS
SQP
TSE
Workshops,
20%
COMPSACW
REFSQ
WoSQ
IWSPM
SEW
SOQUA
Symposium, 4%
METRICS
SSD
Other,
4%
Book
PhD Thesis
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
11

12. +
MQ2. Publication trend
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
0
1
2
3
4
5
6
7
8
9
Identified studies Empirical studies
12

13. + MQ3,4. Research types and approaches
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
14 12
61
9
9
0
5
10
15
20
25
30
Evaluation research Solution proposal Systematic investigation
Review
Theory
survey
Experiment
Case study
13

14. +
MQ3,4,5,6 results summary
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
14

15. +
MQ7. SQ models
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
34%
2%
2%
4%
58%
ISO/IEC 9126
McCall
Boehm
Other
No
15

16. +
MQ8,9. Artifacts and SQR types
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
16

17. +Conclusions and Implications
3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13
o Theoretical solutions need to be applied in practice and validated
empirically
o There is a need for more studies:
o focusing on the non-functional requirements validation,
o which identify and specify SQR according to a chosen SQ model
o Researchers should get familiarized with ISO/IEC 25010 standard
o SQ in use requirements need to be more explored by SQR researchers
17
Future research
o SLR on empirical SQR studies

18. +
Thank you for your attention!
Any questions?
3 Dec 2013 Software Quality Requirements: A systematic mapping study. APSEC'13 18

19. +
The 20th Asia-Pacific Software Engineering Conference
APSEC’13
Presented by: Sofia Ouhbi
Software
Quality
Requirements
A systematic mapping study
Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval
3 Dec 2013