Iwsm2014 an iso iec 33000-compliant measurement framework for software process sustainability assessment (giuseppe lami - fabrizio fabbrini - luigi buglione)

24°International Workshop on Software Measurement
(IWSM) and 9th International Conference on Software
Process and Product Measurement (MENSURA)
Rotterdam (Netherlands) - October 6-8, 2014
An ISO/IEC 33000-compliant Measurement Framework for Software
Process Sustainability Assessment
www.eng.it
Giuseppe LLaammii
Fabrizio FFaabbbbrriinnii
Luigi BBuugglliioonnee

Sustainability Assess Goals of the presentation
1. Discuss the Sustainability issue in general, more focus
on the ‘product’ entity
2. Introduce the Sustainability from a process-based
viewpoint, for its evaluation
3. Propose a Sustainability Measurement Framework
(SMF) compliant with the ISO/IEC 33000 series
2 IWSM-MENSURA 2014 – October 6-8, 2014 www.eng.it
© 2014 Lami, Fabbrini & Buglione

ISTI-CNR At a glance
wwwwww.i.sistit.ic.cnnr.ri.ti t

Engineering At a glance
wwwwww..eenngg..itit

Agenda
Sustainability Assess
• Introduction
– Sustainability: definition & concept
– Some basic questions
• Green & Sustainable Software Process
— Definitions
• ISO/IEC 33000: A Standard for Software Process Assessment
– MF: Measurement Framework
– PRM: Process Reference Model
– PAM: Process Assessment Model
• A Measurement Framework for Process Sustainability
– SL: Sustainability Levels
– PA: Process Attributes
– PRM Changes
• Conclusions & Future Works
• Q&&A

Introduction Sustainability – Definition & Concept
Sustainability (originating from the Latin
word sustenere that means: ‘to hold up’)
shows the capability of enduring over time.
In the last years sustainability is more and
more intended as the responsible use of the
heart resources in order to “meet the needs
of the present without compromising the
ability of future generations to meet their
own needs”
Rome, Teatro di Marcello (I century BC)

Introduction Previous works on Sustainability
• Ecological  Rework, Renew
• How to evalute the capability to ‘renew’ processes
• Capability to be ‘resilient’ across time
• Proposal for introducing a new criterion in PAMs
• Proposed a set of 3 sustainable processes in the
SPICE (ISO/IEC 15504) format
• Show proposals for measuring sustainability from a
Balanced Scorecard viewpoint, improving current
existing ISO standards (e.g. ISO/IEC 25010:2011)
• Proposed a set of Metrics to represent a starting
point for ‘measuring green projects’
• Analysis of the main CSFs for an EAM (Entity-
Attribute-Measure) analysis applied

Introduction ISO/IEC 25010:2011 – Revised view
• Potential new ISO/IEC 25010:2011 1°-level attribute to be added
• In the middle between Quality In Use and the Internal-External Quality
viewpoints
• Sustainability: “the capability of the software product to meet
concurrent needs of required functionalities without compromising the
ability to meet future needs”

Introduction Some basic questions...
Which is the definition of ‘sustainable’ concretely applied in
organizations?
How much are our projects ‘sustainable’?
Which best practices are yet in place? Which standards?
Which impact on ICT products and processes (if any)?

Agenda
Measur. Framework
• Introduction
— Definitions
– PRM Changes
• Q&&A

Green & Sustainable.. Definitions (1)
• Sustainability Goals: measurable objectives expressed in terms of direct
and indirect impacts on economy, society, human beings, and environment.
• Process Sustainability: the characterization of the ability of a process to
meet current or projected sustainability goals.
• Software Process: set of interrelated or interacting activities, related to the
development, maintenance, and disposal of a software product, which transforms
input in output.
• Sustainable software process: a software process able to meet its defined
sustainability goals,
• Process Sustainability Level: the characterization of a process on an
ordinal measurement scale of process sustainability.
• Process Sustainability Assessment : a disciplined evaluation of an
organizational unit’s process against a Process Assessment Model
• Sustainable software product: a software product able to meet its defined
sustainability goals. From such a definition a sustainable software product can be
seen as software, whose direct and indirect impacts on economy, society, human
beings, and environment that results from its development, deployment, and
usage are aligned with defined goals.

Green & Sustainable.. Definitions (2)
• Sustainable Software Engineering: the art of developing
sustainable software adopting a sustainable software engineering
process.
• Negative and positive impacts on sustainable development that result
and/or are expected to result from the software product over its whole
lifecycle are continuously assessed, documented, and used for a further
optimization of the software product.
 (i.e. a pattern of growth in which resource use aims to meet human
needs while preserving the environment so that these needs can be met
not only in the present, but also for generations to come)

Agenda
• Introduction
— Definitions
– PRM Changes
• Q&&A

ISO/IEC 33000 MF: Measurement Framework
• Measurement Framework: a scheme to use for assigning a
quantitative rating to a quality characteristics of a process
• ISO/IEC 33003  Requirements for the definition of a MF
Components of a MF
• Levels: points on an ordinal scale (e.g. from 0 to 5)
• Process Attributes: measurable characteristics of a process
• Rating Scales: set of values/categories to which an attribute is
mapped (e.g. Not/Partially/Largely/Fully achieved)

ISO/IEC 33000 PRM: Process Reference model
• Process Reference Model (PRM): model comprising definitions
of processes in a life cycle described in terms of process purpose and
outcomes, together with an architecture describing the relationships
between the processes. [ISO/IEC 33001]
• ISO/IEC 33004  Requirements for the definition of a PRM
Requirements of a PRM
A Process Reference Model shall contain:
• a declaration of the domain of the process reference model;
• a description of the relationship between the process reference model
and its intended context of use;
• descriptions of the processes within the scope of the process reference
model containing purpose, process outcomes necessary and sufficient to
achieve the purpose of the process;
• description of the relationship between the processes defined within the
process reference model.

ISO/IEC 33000 PRM: Process Reference Model
• This a
compliant PRM
from ISO/IEC
12207:2008
• The
‘sustainability’
proposal aims to
strengthen
PRMs with
processes and a
MF compliant
with the ISO/IEC
33000 design

ISO/IEC 33000 PAM: Process Assessment Model
• The PAM is a model for assessing the quality characteristic of
processes
• So far, only process quality characteristics of capability has been
addressed
• Once a MF specific for sustainability and a compatible PRM will be
defined  the SPICE PAM can be used with no change

Agenda
• Introduction
— Definitions
– PRM Changes
• Q&&A

MF-Sustainability SL (Sust. Levels) + PA (Product Attributes)
• Added a Process Attribute (PA) at SL1
• Performance & Sustainability need to be
both present at such level

MF-Sustainability PRM Changes
• Exemplar Process Definition
Process Name Measurement
Process
Purpose
The purpose of the Measurement Process is to collect, analyze, and report data relating to the
products developed and processes implemented within the organizational unit, to support effective and
sustainable management of the processes, and to objectively demonstrate the quality and
sustainability of the products.
Process
Performance Outcomes
As a result of the performance of the Measurement Process:
a) the information needs of technical and management processes are identified;
b) an appropriate set of measures, driven by the information needs are identified and/or developed;
c) measurement activities are identified and planned;
d) the required data are collected, stored, analyzed, and the results interpreted;
e) information products are used to support decisions and provide an objective basis for
communication;
f) the Measurement Process and measures are evaluated; and
g) improvements are communicated to the Measurement Process owner.
Process
Sustainability Outcomes
As a result of the sustainable implementation of the Measurement Process:
a) the information needs for controlling the achievement of sustainability objectives of technical and
management processes are identified;
b) the information needs for controlling the achievement of sustainability objectives of work products
are identified;
c) an appropriate set of sustainability measures for processes and work products, driven by the
information needs, are identified and/or developed;
d) sustainability measurement activities are identified and planned;
e) the data required for sustainability measurement are collected, stored, analyzed, and the results
interpreted and communicated to affected parties;
g) the Sustainability Measurement Process and sustainability measures are evaluated;
h) sustainability improvements are communicated to the sustainability Measurement Process owner.

MF-Sustainability MCM Capability Evaluation

Agenda
• Introduction
— Definitions
– PRM Changes
• Q&&A

Conclusions && Future Works
• Measuring Process Sustainability (not only Capability)
 Measurement is fundamental for approximating the size of entities of
interest
 Measurement should be desirable also for processes, not only
products/services
 Sustainability can be a further attribute to consider for evaluating a
process
• Measurement Framework (MF)
 ISO/IEC 33000 serie allows the definition of a MF for process
sustainability
 A MF for process sustainability has been presented
 The presented MF for process sustainability can be applied in
ISO/IEC 33000-compliant process assessments
All models are wrong. Some models are useful.
(George Box, Mathematician , 1919-2013)
 Next Steps
 ...try & see!
All models are wrong. Some models are useful.
(George Box, Mathematician , 1919-2013)

Lessons Learned...
URL: www.dilbert.com

Q && A
BBeeddaannkktt vvoooorr uuww aaaannddaacchhtt!!
TThhaannkkss ffoorr yyoouurr aatttteennttiioonn!!

Our Contact Data
Measur. Framework
Luigi
Buglione
Engineering Ingegneria Informatica/ETS
luigi.buglione@eng.it
Fabrizio
Fabbrini
ISTI/CNR
fabrizio.fabbrinii@isti.cnr.it
Giuseppe
Lami
ISTI/CNR
giuseppe.lami@isti.cnr.it

Iwsm2014 an iso iec 33000-compliant measurement framework for software process sustainability assessment (giuseppe lami - fabrizio fabbrini - luigi buglione)

Recommended

Recommended

More Related Content

Similar to Iwsm2014 an iso iec 33000-compliant measurement framework for software process sustainability assessment (giuseppe lami - fabrizio fabbrini - luigi buglione)

Similar to Iwsm2014 an iso iec 33000-compliant measurement framework for software process sustainability assessment (giuseppe lami - fabrizio fabbrini - luigi buglione) (20)

More from Nesma

More from Nesma (20)

Recently uploaded

Recently uploaded (20)

Iwsm2014 an iso iec 33000-compliant measurement framework for software process sustainability assessment (giuseppe lami - fabrizio fabbrini - luigi buglione)