How to MEASURE The Enterprise Architecture Models Quality With The MEASURE Platform, The H2020 Databio Project Success Story. This presentation is given by Alessandra Bagnato, Research Scientist and Head of the Research Unit at Softeam.

1. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
1
This project has received funding from
the European Union’s Horizon 2020
research and innovation programme
under grant agreement No 732064
This project is part
of BDV PPP
METRICS FOR ARCHIMATE MODELLING
Alessandra Bagnato
OW2con'19
Paris, 13th June 2019
How to MEASURE the Enterprise Architecture models quality with the
MEASURE Platform, the H2020 Databio Project success story

2. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
2
Softeam Software / Modeliosoft
MODELIOSOFT PRODUCTS
• Modelio Business Architecture
• For Business Analysts and Enterprise Architects
• TOGAF, ArchiMate, UML, BPMN
• Modelio System Architecture
• SysML, UPDM, NAF, DODAF, MODAF
• Modelio Software Development
• UML to Java, C#, C++, SQL …

3. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
3
DataBio Overview
• DataBio (2017-2019) - Data-Driven Bioeconomy
• EU Research and Innovation programme - H2020
• Big Data technologies for the domains of: Agriculture, Forestry and Fishery
• 48 partners, 27 pilots and 91 software components
• More than 40 datasets (Satellite Imagery, Maps, Open Data, IoT and Sensors data)

4. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
4
ArchiMate models for DataBio (1/2)
• Modelling Pilots
• Motivation views
• Strategy views
• Business processes
• Lifecycle view
• Pipelines
• Modelling Software Components
• Subordinates
• Interface View
• Data View
• Deployment View

5. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
5
ArchiMate models for DataBio (2/2)
Fishery Pilot: Lifecycle view

6. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
6
How to evaluate models quality?
Completion? Readability? Understandability? Complexity? Cohesion? ...

7. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
7
The MEASURE ITEA 3 Project

8. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
8
Measure Platform
• Dashboards with KPIs
• Third parties Measures
• Third parties Analysis Tools
• Continuous monitoring and
collecting of measures
Monitoring with Measure Platform
http://measure-platform.org/

9. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
9
Approach Measure
Collect
Measure Execution
Process
Measurement Tool
Platform Agent
Collect
Analysis Platform
Analysis Services
Configure
Measure Integration
in Project Scope
Deploy
Packaging
Standardization
Measure Catalogue
Develop
Measure
Standardization
Measure Modeling Tool
Measure Development
Framework
Develop Deploy Configure Collect
Configure
Measure
Visualization
Project Dashboards
Deploy
Measure Aggregation
Visual Aggregation
Develop
Big Data Storage
Store Visualize Combine Analyze
http://measure-platform.org/

10. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
10
• Open source solution for indexing
Modelio models, based on NoSQL
stores.
• Perform fast queries on large
models
• Example of measures performed
by Hawk
Hawk Measurement Tool for querying models
Proportions of ArchiMate Layers in
Modelio project

11. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
11
• Percentage of unused elements
➔ Elements not represented in diagrams
• Percentage of empty diagrams
• Percentage of duplicate elements
Modelio modelling efficiency metrics
Percentage of duplicate elements
Percentage of unused elements

12. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
12
• Number of commits per week
➔ Frequency of updates
• Number of contributors
➔ Amount of allocated resources per project
SVN Activity on Modelio repositories
DataBio projects : Number of commit per week

13. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
13
• Number of ArchiMate
concepts
➔ Number of elements and relationships
between elements
• Number of Diagrams
• Documentation size
Models size
Number of ArchiMate concepts per project

14. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
14
Average number of elements
per diagram
➔ Neither too crowded diagram nor empty
➔ Recommended : between 5 and 20
Models readability metrics
Average number of
relationships per diagram
➔ Neither too congested nor too low
connected
➔ Recommended : between 1 and 4

15. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
15
➔ ArchiMate concepts should be commented sometimes if the name is not self evident
Models understandability metrics

16. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
16
Median Importance Score
• Score affected to
elements/relationships
➔ Score depend on
• ArchiMate layers
• Passive/Active elements
• Type of relationship (Composition,
Triggering, Realization, etc)
➔ Metric by P. M. Singh and M. J. van Sinderen,
“Lightweight Metrics for Enterprise Architecture
Analysis”
• Low median score indicates:
➔ Many empty diagrams
➔ Low cohesion between diagrams

17. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
17
Conclusion
• DataBio Models provided clarity and efficiency
➔ Requirements elicitation
➔ Comprehensibility
➔ Fast production of documentation
• ArchiMate models monitoring allowed to maintain a good quality level
• In the future: having a modelling manager to ensure the respect of
conventions and guidelines

18. This document is part of a project that has received funding
from the European Union’s Horizon 2020 research and innovation programme
under agreement No 732064. It is the property of the DataBio consortium and shall not be distributed or
18
Thank you for your attention!
Alessandra Bagnato
alessandra.bagnato@softeam.fr