Presentation of the journal article "Thirteen Years of SysML: A Systematic Mapping Study" at Models 2019 in Munich

1. Christian Doppler Laboratory for Model-Integrated Smart Production
Institute of Business Informatics – Software Engineering
Johannes Kepler University Linz
Altenberger Straße 69, Science Park 3
4040 Linz
Christian Doppler Laboratory for Model-Integrated Smart Production
CDL-MINT
Thirteen years of SysML: A systematic mapping study
Models Conference 2019, Munich
Sabine Wolny, · Alexandra Mazak, · Christine Carpella,· Verena Geist,· Manuel Wimmer
Software & Systems Modeling
ISN 1619-1374
https://doi.org/10.1007/s10270-019-
00735-y

2. Systems Modeling Language (SysML)
 Out for 13 years
 Established standard?
 Domains?
 Community?
 Various tools available
 Papyrus 4 SysML
 MagicDraw
 Enterprise Architect
 ….
 SysML v2 emerging
 First release planned soon!
 Textual DSL
 Jupiter notebooks – Representation of SysML
http://imechatronic.com/en/ https://www.bmt.org/industries/offshore/design-and-
engineering/engineering-risk-and-safety-management/
https://www.synopsys.com/verification/solution
s/automotive/prototyping-in-automotive.html

3. Systems Modeling Language (SysML)
3https://www.omg.org/spec/SysML/About-SysML/
Activity
Diagram
Sequence
Diagram
State
Machine
Diagram
Behavior
Diagram
SysML Diagram
Structure
Diagram
Internal
Block
Diagram
Block
Definition
Diagram
Package
Diagram
Parametric
Diagram
Requirement
Diagram
Use Case
Diagram
Same as UML 2
Modified from UML 2
New diagram type

4. Systematic Mapping Study of SysML
4Procedure: K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson: Systematic Mapping Studies in Software
Engineering. In Proc. of the 12th International Conference on Evaluation and Assessment in Software
Engineering (EASE), 2008
All Papers
• Conduct Search
• 4 different digital libraries (Scopus, ACM, DBLP, IEEE)
• 2005 until 2017; SysML in the title
• 1613 papers
Review Scope
• Definition of Research Questions
• RQ 1 Bibliometric
• RQ 2 Major contributors and networks
• RQ 3 Classification of SysML papers
• RQ 4 Key aspects of SysML
Classification
Scheme
• Analyse Abstracts
• Type facets, contribution type, system engineering phase
Systematic
Map
• Data Extraction and Mapping Process
Relevant
Papers
• Screening of Papers
• Removing duplicates, no abstracts, no context to SysML
• 579 papers

5. Bibliometric
RQ1: What are the bibliometric key facts of SysML publications?
 Identify possible trends
 Over the years
 Considering the type of publication (articles, conference and workshop
papers)
 Which are the main venues?
 Conferences
 Journals
5

6. Major contributors and networks
RQ2: Where are the scientific communities of SysML located and are there
main contributors, who scientifically promote SysML topics?
 Are there only single authors?
 Small groups?
 Working networks over the world?
 Are there frequent authors?
6

7. Classification of SysML Papers
RQ3: Which research type facets do the identified publications address?
7
K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic Mapping Studies in Software Engineering,”
In Proc. of the 12th International Conference on Evaluation and Assessment in Software Engineering, ser.
EASE’08. Swinton, UK, UK: British Computer Society, 2008, p. 71
Category Description
Philosophical Papers
These papers sketch a new way of looking at existing things by structuring the
field in form of a taxonomy or conceptual framework
Opinion Papers
These papers express the personal opinion of somebody whether a certain
technique is good or bad, or how things should been done. They do not rely on
related work and research methodologies
Experience Papers
Experience papers explain on what and how something has been done in
practice. It has to be the personal experience of the author
Solution Proposal
A solution for a problem is proposed; the solution can be either novel or a
significant extension of an existing technique. The potential benefits and the
applicability of the solution are shown by a small example or a good line of
argumentation
Validation Research
Techniques investigated are novel and have not yet been implemented in
practice. Techniques used are, for example, experiments, i.e., work done in the
laboratory
Evaluation Research
Techniques are implemented in practice, and an evaluation of the technique is
conducted. That means, it is shown how the technique is implemented in
practice (solution implementation) and what are the consequences of the
implementation in terms of benefits and drawbacks (implementation
evaluation). This also includes to identify problems in industry

8. Key Aspects of SysML
RQ4: What are the key aspects of applying SysML in the classified
publications?
 In which phase of the engineering process is SysML used?1
 Requirement
 Design
 Implementation
 Validation & Verification
 Which contribution type does the publications have?2
 Technique
 Process
 Notation
 Tool
 Specific Solution
 Other
8
1: VDI Verein Deutscher Ingenieure: https://www.vdi.de/2206, Accessed: 2017-03-14
2: Shaw, M.: Writing good software engineering research paper. In Proc. of the 25th International
Conference on Software Engineering, IEEE Computer Society, 2003, pp. 726–737.

9. Conduct Search
 Tool support
 DBLP http://dblp.uni-trier.de/
 Open bibliographic information on computer science journals and proceedings
 ACM Digital Library http://dl.acm.org/
 Research, discovery and networking platform
 Collection of full-text articles, bibliographic records
 IEEE Xplore Digital Library http://ieeexplore.ieee.org
 Technical literature in engineering and technology
 Scopus http://www.scopus.com/
 Largest abstract and citation database of peer-reviewed literature
 Scientific journals, books and conference proceedings
 Keywords / Phrases
 SysML
 Systems Modeling Language / systems modeling language
 System Modeling Language / system modeling language
9

10. Screening of Papers
 Restrictions
 Years 2005 until 2017
 Keyword must be contained in the title of the paper
 Delete
 Duplicates
 Papers without abstract available
 Papers without any context to SysML
 Books and theses
 Final check of the result set: 21.1.2019
579 papers for the analysis
10

11. Results: Bibliometrics of SysML publications (1)
 2005 First draft of SysML by OMG
 2007 / 2008 / 2010 / 2012 / 2017 – New versions of SysML
11

12. Results: Bibliometrics of SysML publications (2)
12
Conference Venue Pub.
INCOSE (Annual International Symposium of the
International Council on Systems Engineering)
32
IDETC/CIE (International Design Engineering
Technical Conferences)
14
ETFA (International Conference on Emerging
Technologies and Factory Automation)
13
SysCon (International Systems Conference) 12
MODELSWARD (Conference on Model-Driven
Engineering and Software Development)
11
CSER (Conference on Systems Engineering
Research)
10
ISSE (International Symposium on Systems
Engineering)
9
WSC (Winter Simulation Conference) 9
ICEIS (International Conference on Enterprise
Information Systems)
8
Journal Venue Pub.
Systems Engineering 11
Innovations in Systems and Software
Engineering
5
Software and Systems Modeling 4

13. Results: Research communities and main contributors of
SysML topics (1)
 1167 authors worldwide
 30 single authors without relationship to another author in the SysML
publications
 Major contributors located in USA, France, and Germany
13

14. Results: Research communities and main contributors of
SysML topics (2)
14https://gephi.org/
Network
Biggest network (61 authors) with bridge builder
- Paredis C.J.J.: Georgia Institute of Technology, Atlanta, USA
- Friedenthal S.: Lockheed Martin Corporation, Fairfax, USA
- Canedo A.: Siemens Corporate Research, Princeton, USA

15. Results: Research communities and main contributors of
SysML topics (3)
15

16. Result: Classification of SysML publications
 Higher number of philosophical papers from 2005 to 2007
 Focus on realization of own approaches and implementations since
2010
16

17. Results: Key aspects of applying SysML (1)
 Phases Design and
Validation are
predominant topics in
all type facet
categories
 Contribution types
 Technique
 Notation
17

18. Results: Key aspects of applying SysML (2)
18

19. Results: Formalism Transformation Graph (FTG)1
19
1: Lúcio, L., Mustafiz, S., Denil, J., Meyers, B., Vangheluwe, H.: The Formalism Transformation Graph as a Guide to
Model Driven Engineering. Tech. rep. McGill University (2012)
SysML FTG: https://figshare.com/s/5de5b35ed2ef8cdf8317
SysML
T
DEVS ExtractSimulationModel
Arena
ExtractAnalysisModel
T
ExtractVerificationModel
T
B
T
Matlab
Orocos-RTT
T
ExtractCode
M3TK
Simulink
DHC Communication
Protocol
ExtractTestModel
TSmartesting
(Tool)
VHDL-
AMS
OWL
Stochastic Reward
Nets (SRNs)
Prolog
PetriNets
Simscape
Modelica
DesignStructureMatrix /
MultipleDomainMatrix
ExtractMatrix
TRNSYS
Communicating
Sequential Processes
HDL
Recursive
Object Model
(ROM)
T MigrateModel
ADL
IP Core
T GenerateModel
Mathematica
GAMS
Flexsim
James II
fUML
HLA
Aspen Plus
ABD logic
EXPRESS
model
Clean
Axiom set
T
ExtractCanonicalForm
T
ExtractDesignModel
Alta Rica
EPLAN,
Modelica
CML
DTMC
OPM
MoDAF/DoDAF
Architectural
Model
NuSMV ProVerif
Systemigrams
Traceability
Matrix
Promela/Spin
UPPAAL
Fault Tree
Generic
Simulation Model
eM Plant
PIDO
framework
SafeSlice
UML
PRISM
Interface
Automata
IBM
IEC61499
Python
SystemVerilog
T
ExtractOptimizationModel
PyOpt
SHIOQ(D)
SPL
ABM
MES Gateway Configurations
ARM Cortex-M MCUs
Real-Time
System
IEC
61131-3
SystemC
DiVinE
1-3 4-6 7-9 ≥10

20. Results: Formalism Extension Graph (FEG)
20SysML FEG: https://figshare.com/s/0f0f13ea189b891e312f
SysML
DEVS
{Simulation}
{SoS}
{GoalModeling}
AVATAR
{Verification}
DSEE
{DSM}
OMAC/PackML
Traceability
Simulink
MARTE
SystemC/C
{Electronics}
Architecture
Decisions
{Architecture
Modeling}SysML4
Modelica
Contracts/
Refinements
SysADL
{Mechanics}
Contact & Channel
{Geometry}
GERTRUDe
{Saftey &
Security}
Saftey
{Mechatronics} System
Architecture
{Thermal}
TheReSE
Trade
Studies
Variability
Modeling
{Automation}
SysML-AT
EIS
{IT}
OMEGA
Aspects
AUTOSAR
{Automotive}
KAOS
UPDM
TLM
fSysML
{Execution}
Modelica
Simscape
Space
{Libary}
Constraints
SysML4
IoT
{IoT}
AutomationML
Geometrical
Bond Graph
3+1 SysML
View-Model
Multi-Physical
Interactions
SysML4
Mechatronics
FMI
Signal
Flow
Multi Agent
System
ISO 26262
Tolerance
Specification
Design
Functional/Non
Functional Requirements
DSL
IEC 61131-3
Fault
Tree
Security
Viewpoint
{Embedded Systems}
ExSAM
Consol-Optcad
SysML-Sec
Multi-Core
Process
Knowledge
Management
B
Time
Constraints
TEPE
Use Case
Points
Design Optimization
Verification
Management
Techno-
Economic
AMADEOS
MES Gateway
{Manufacturing}
Piping & Instrumentation
Diagram
Supply Chain
OWLVulnerabilities
State
Analysis1-3 4-6 7-9 ≥10

21. Conclusion and Outlook
 Large set of SysML paper found
 A plethora of transformations and extensions available
 Worldwide community (but also dedicated groups)
 New diagrams (requirement, parametric) are in use
 SysML v2
 Addresses the issue of ambiguous operational semantics
 Planned enhancements (e.g., temporal components, history, …)
 Modeling hybrid systems
 Most publications consider either discrete or continuous challenges
 Formal semantics for SysML combining discrete and continuous parts
 Deep analysis for specific topics
 Contribution category notation may be further differentiated by specific
language engineering aspects, …
21

22. Questions?
22
Data available at https://figshare.com/s/871aa0c03aa18eb3edf6
Thirteen years of SysML: A systematic mapping study
Sabine Wolny
sabine.wolny@jku.at