Christian Doppler Laboratory for Model-Integrated Smart Production
Institute of Business Informatics – Software Engineering
Johannes Kepler University Linz
Altenberger Straße 69, Science Park 3
4040 Linz
Christian Doppler Laboratory for Model-Integrated Smart Production
CDL-MINT
Thirteen years of SysML: A systematic mapping study
Models Conference 2019, Munich
Sabine Wolny, · Alexandra Mazak, · Christine Carpella,· Verena Geist,· Manuel Wimmer
Software & Systems Modeling
ISN 1619-1374
https://doi.org/10.1007/s10270-019-
00735-y
Systems Modeling Language (SysML)
 Out for 13 years
 Established standard?
 Domains?
 Community?
 Various tools available
 Papyrus 4 SysML
 MagicDraw
 Enterprise Architect
 ….
 SysML v2 emerging
 First release planned soon!
 Textual DSL
 Jupiter notebooks – Representation of SysML
http://imechatronic.com/en/ https://www.bmt.org/industries/offshore/design-and-
engineering/engineering-risk-and-safety-management/
https://www.synopsys.com/verification/solution
s/automotive/prototyping-in-automotive.html
Systems Modeling Language (SysML)
3https://www.omg.org/spec/SysML/About-SysML/
Activity
Diagram
Sequence
Diagram
State
Machine
Diagram
Behavior
Diagram
SysML Diagram
Structure
Diagram
Internal
Block
Diagram
Block
Definition
Diagram
Package
Diagram
Parametric
Diagram
Requirement
Diagram
Use Case
Diagram
Same as UML 2
Modified from UML 2
New diagram type
Systematic Mapping Study of SysML
4Procedure: K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson: Systematic Mapping Studies in Software
Engineering. In Proc. of the 12th International Conference on Evaluation and Assessment in Software
Engineering (EASE), 2008
All Papers
• Conduct Search
• 4 different digital libraries (Scopus, ACM, DBLP, IEEE)
• 2005 until 2017; SysML in the title
• 1613 papers
Review Scope
• Definition of Research Questions
• RQ 1 Bibliometric
• RQ 2 Major contributors and networks
• RQ 3 Classification of SysML papers
• RQ 4 Key aspects of SysML
Classification
Scheme
• Analyse Abstracts
• Type facets, contribution type, system engineering phase
Systematic
Map
• Data Extraction and Mapping Process
Relevant
Papers
• Screening of Papers
• Removing duplicates, no abstracts, no context to SysML
• 579 papers
Bibliometric
RQ1: What are the bibliometric key facts of SysML publications?
 Identify possible trends
 Over the years
 Considering the type of publication (articles, conference and workshop
papers)
 Which are the main venues?
 Conferences
 Journals
5
Major contributors and networks
RQ2: Where are the scientific communities of SysML located and are there
main contributors, who scientifically promote SysML topics?
 Are there only single authors?
 Small groups?
 Working networks over the world?
 Are there frequent authors?
6
Classification of SysML Papers
RQ3: Which research type facets do the identified publications address?
7
K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic Mapping Studies in Software Engineering,”
In Proc. of the 12th International Conference on Evaluation and Assessment in Software Engineering, ser.
EASE’08. Swinton, UK, UK: British Computer Society, 2008, p. 71
Category Description
Philosophical Papers
These papers sketch a new way of looking at existing things by structuring the
field in form of a taxonomy or conceptual framework
Opinion Papers
These papers express the personal opinion of somebody whether a certain
technique is good or bad, or how things should been done. They do not rely on
related work and research methodologies
Experience Papers
Experience papers explain on what and how something has been done in
practice. It has to be the personal experience of the author
Solution Proposal
A solution for a problem is proposed; the solution can be either novel or a
significant extension of an existing technique. The potential benefits and the
applicability of the solution are shown by a small example or a good line of
argumentation
Validation Research
Techniques investigated are novel and have not yet been implemented in
practice. Techniques used are, for example, experiments, i.e., work done in the
laboratory
Evaluation Research
Techniques are implemented in practice, and an evaluation of the technique is
conducted. That means, it is shown how the technique is implemented in
practice (solution implementation) and what are the consequences of the
implementation in terms of benefits and drawbacks (implementation
evaluation). This also includes to identify problems in industry
Key Aspects of SysML
RQ4: What are the key aspects of applying SysML in the classified
publications?
 In which phase of the engineering process is SysML used?1
 Requirement
 Design
 Implementation
 Validation & Verification
 Which contribution type does the publications have?2
 Technique
 Process
 Notation
 Tool
 Specific Solution
 Other
8
1: VDI Verein Deutscher Ingenieure: https://www.vdi.de/2206, Accessed: 2017-03-14
2: Shaw, M.: Writing good software engineering research paper. In Proc. of the 25th International
Conference on Software Engineering, IEEE Computer Society, 2003, pp. 726–737.
Conduct Search
 Tool support
 DBLP http://dblp.uni-trier.de/
 Open bibliographic information on computer science journals and proceedings
 ACM Digital Library http://dl.acm.org/
 Research, discovery and networking platform
 Collection of full-text articles, bibliographic records
 IEEE Xplore Digital Library http://ieeexplore.ieee.org
 Technical literature in engineering and technology
 Scopus http://www.scopus.com/
 Largest abstract and citation database of peer-reviewed literature
 Scientific journals, books and conference proceedings
 Keywords / Phrases
 SysML
 Systems Modeling Language / systems modeling language
 System Modeling Language / system modeling language
9
Screening of Papers
 Restrictions
 Years 2005 until 2017
 Keyword must be contained in the title of the paper
 Delete
 Duplicates
 Papers without abstract available
 Papers without any context to SysML
 Books and theses
 Final check of the result set: 21.1.2019
579 papers for the analysis
10
Results: Bibliometrics of SysML publications (1)
 2005 First draft of SysML by OMG
 2007 / 2008 / 2010 / 2012 / 2017 – New versions of SysML
11
Results: Bibliometrics of SysML publications (2)
12
Conference Venue Pub.
INCOSE (Annual International Symposium of the
International Council on Systems Engineering)
32
IDETC/CIE (International Design Engineering
Technical Conferences)
14
ETFA (International Conference on Emerging
Technologies and Factory Automation)
13
SysCon (International Systems Conference) 12
MODELSWARD (Conference on Model-Driven
Engineering and Software Development)
11
CSER (Conference on Systems Engineering
Research)
10
ISSE (International Symposium on Systems
Engineering)
9
WSC (Winter Simulation Conference) 9
ICEIS (International Conference on Enterprise
Information Systems)
8
Journal Venue Pub.
Systems Engineering 11
Innovations in Systems and Software
Engineering
5
Software and Systems Modeling 4
Results: Research communities and main contributors of
SysML topics (1)
 1167 authors worldwide
 30 single authors without relationship to another author in the SysML
publications
 Major contributors located in USA, France, and Germany
13
Results: Research communities and main contributors of
SysML topics (2)
14https://gephi.org/
Network
Biggest network (61 authors) with bridge builder
- Paredis C.J.J.: Georgia Institute of Technology, Atlanta, USA
- Friedenthal S.: Lockheed Martin Corporation, Fairfax, USA
- Canedo A.: Siemens Corporate Research, Princeton, USA
Results: Research communities and main contributors of
SysML topics (3)
15
Result: Classification of SysML publications
 Higher number of philosophical papers from 2005 to 2007
 Focus on realization of own approaches and implementations since
2010
16
Results: Key aspects of applying SysML (1)
 Phases Design and
Validation are
predominant topics in
all type facet
categories
 Contribution types
 Technique
 Notation
17
Results: Key aspects of applying SysML (2)
18
Results: Formalism Transformation Graph (FTG)1
19
1: Lúcio, L., Mustafiz, S., Denil, J., Meyers, B., Vangheluwe, H.: The Formalism Transformation Graph as a Guide to
Model Driven Engineering. Tech. rep. McGill University (2012)
SysML FTG: https://figshare.com/s/5de5b35ed2ef8cdf8317
SysML
T
DEVS ExtractSimulationModel
Arena
ExtractAnalysisModel
T
ExtractVerificationModel
T
B
T
Matlab
Orocos-RTT
T
ExtractCode
M3TK
Simulink
DHC Communication
Protocol
ExtractTestModel
TSmartesting
(Tool)
VHDL-
AMS
OWL
Stochastic Reward
Nets (SRNs)
Prolog
PetriNets
Simscape
Modelica
DesignStructureMatrix /
MultipleDomainMatrix
ExtractMatrix
TRNSYS
Communicating
Sequential Processes
HDL
Recursive
Object Model
(ROM)
T MigrateModel
ADL
IP Core
T GenerateModel
Mathematica
GAMS
Flexsim
James II
fUML
HLA
Aspen Plus
ABD logic
EXPRESS
model
Clean
Axiom set
T
ExtractCanonicalForm
T
ExtractDesignModel
Alta Rica
EPLAN,
Modelica
CML
DTMC
OPM
MoDAF/DoDAF
Architectural
Model
NuSMV ProVerif
Systemigrams
Traceability
Matrix
Promela/Spin
UPPAAL
Fault Tree
Generic
Simulation Model
eM Plant
PIDO
framework
SafeSlice
UML
PRISM
Interface
Automata
IBM
IEC61499
Python
SystemVerilog
T
ExtractOptimizationModel
PyOpt
SHIOQ(D)
SPL
ABM
MES Gateway Configurations
ARM Cortex-M MCUs
Real-Time
System
IEC
61131-3
SystemC
DiVinE
1-3 4-6 7-9 ≥10
Results: Formalism Extension Graph (FEG)
20SysML FEG: https://figshare.com/s/0f0f13ea189b891e312f
SysML
DEVS
{Simulation}
{SoS}
{GoalModeling}
AVATAR
{Verification}
DSEE
{DSM}
OMAC/PackML
Traceability
Simulink
MARTE
SystemC/C
{Electronics}
Architecture
Decisions
{Architecture
Modeling}SysML4
Modelica
Contracts/
Refinements
SysADL
{Mechanics}
Contact & Channel
{Geometry}
GERTRUDe
{Saftey &
Security}
Saftey
{Mechatronics} System
Architecture
{Thermal}
TheReSE
Trade
Studies
Variability
Modeling
{Automation}
SysML-AT
EIS
{IT}
OMEGA
Aspects
AUTOSAR
{Automotive}
KAOS
UPDM
TLM
fSysML
{Execution}
Modelica
Simscape
Space
{Libary}
Constraints
SysML4
IoT
{IoT}
AutomationML
Geometrical
Bond Graph
3+1 SysML
View-Model
Multi-Physical
Interactions
SysML4
Mechatronics
FMI
Signal
Flow
Multi Agent
System
ISO 26262
Tolerance
Specification
Design
Functional/Non
Functional Requirements
DSL
IEC 61131-3
Fault
Tree
Security
Viewpoint
{Embedded Systems}
ExSAM
Consol-Optcad
SysML-Sec
Multi-Core
Process
Knowledge
Management
B
Time
Constraints
TEPE
Use Case
Points
Design Optimization
Verification
Management
Techno-
Economic
AMADEOS
MES Gateway
{Manufacturing}
Piping & Instrumentation
Diagram
Supply Chain
OWLVulnerabilities
State
Analysis1-3 4-6 7-9 ≥10
Conclusion and Outlook
 Large set of SysML paper found
 A plethora of transformations and extensions available
 Worldwide community (but also dedicated groups)
 New diagrams (requirement, parametric) are in use
 SysML v2
 Addresses the issue of ambiguous operational semantics
 Planned enhancements (e.g., temporal components, history, …)
 Modeling hybrid systems
 Most publications consider either discrete or continuous challenges
 Formal semantics for SysML combining discrete and continuous parts
 Deep analysis for specific topics
 Contribution category notation may be further differentiated by specific
language engineering aspects, …
21
Questions?
22
Data available at https://figshare.com/s/871aa0c03aa18eb3edf6
Thirteen years of SysML: A systematic mapping study
Sabine Wolny
sabine.wolny@jku.at

Thirteen Years of SysML: A Systematic Mapping Study

  • 1.
    Christian Doppler Laboratoryfor Model-Integrated Smart Production Institute of Business Informatics – Software Engineering Johannes Kepler University Linz Altenberger Straße 69, Science Park 3 4040 Linz Christian Doppler Laboratory for Model-Integrated Smart Production CDL-MINT Thirteen years of SysML: A systematic mapping study Models Conference 2019, Munich Sabine Wolny, · Alexandra Mazak, · Christine Carpella,· Verena Geist,· Manuel Wimmer Software & Systems Modeling ISN 1619-1374 https://doi.org/10.1007/s10270-019- 00735-y
  • 2.
    Systems Modeling Language(SysML)  Out for 13 years  Established standard?  Domains?  Community?  Various tools available  Papyrus 4 SysML  MagicDraw  Enterprise Architect  ….  SysML v2 emerging  First release planned soon!  Textual DSL  Jupiter notebooks – Representation of SysML http://imechatronic.com/en/ https://www.bmt.org/industries/offshore/design-and- engineering/engineering-risk-and-safety-management/ https://www.synopsys.com/verification/solution s/automotive/prototyping-in-automotive.html
  • 3.
    Systems Modeling Language(SysML) 3https://www.omg.org/spec/SysML/About-SysML/ Activity Diagram Sequence Diagram State Machine Diagram Behavior Diagram SysML Diagram Structure Diagram Internal Block Diagram Block Definition Diagram Package Diagram Parametric Diagram Requirement Diagram Use Case Diagram Same as UML 2 Modified from UML 2 New diagram type
  • 4.
    Systematic Mapping Studyof SysML 4Procedure: K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson: Systematic Mapping Studies in Software Engineering. In Proc. of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE), 2008 All Papers • Conduct Search • 4 different digital libraries (Scopus, ACM, DBLP, IEEE) • 2005 until 2017; SysML in the title • 1613 papers Review Scope • Definition of Research Questions • RQ 1 Bibliometric • RQ 2 Major contributors and networks • RQ 3 Classification of SysML papers • RQ 4 Key aspects of SysML Classification Scheme • Analyse Abstracts • Type facets, contribution type, system engineering phase Systematic Map • Data Extraction and Mapping Process Relevant Papers • Screening of Papers • Removing duplicates, no abstracts, no context to SysML • 579 papers
  • 5.
    Bibliometric RQ1: What arethe bibliometric key facts of SysML publications?  Identify possible trends  Over the years  Considering the type of publication (articles, conference and workshop papers)  Which are the main venues?  Conferences  Journals 5
  • 6.
    Major contributors andnetworks RQ2: Where are the scientific communities of SysML located and are there main contributors, who scientifically promote SysML topics?  Are there only single authors?  Small groups?  Working networks over the world?  Are there frequent authors? 6
  • 7.
    Classification of SysMLPapers RQ3: Which research type facets do the identified publications address? 7 K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic Mapping Studies in Software Engineering,” In Proc. of the 12th International Conference on Evaluation and Assessment in Software Engineering, ser. EASE’08. Swinton, UK, UK: British Computer Society, 2008, p. 71 Category Description Philosophical Papers These papers sketch a new way of looking at existing things by structuring the field in form of a taxonomy or conceptual framework Opinion Papers These papers express the personal opinion of somebody whether a certain technique is good or bad, or how things should been done. They do not rely on related work and research methodologies Experience Papers Experience papers explain on what and how something has been done in practice. It has to be the personal experience of the author Solution Proposal A solution for a problem is proposed; the solution can be either novel or a significant extension of an existing technique. The potential benefits and the applicability of the solution are shown by a small example or a good line of argumentation Validation Research Techniques investigated are novel and have not yet been implemented in practice. Techniques used are, for example, experiments, i.e., work done in the laboratory Evaluation Research Techniques are implemented in practice, and an evaluation of the technique is conducted. That means, it is shown how the technique is implemented in practice (solution implementation) and what are the consequences of the implementation in terms of benefits and drawbacks (implementation evaluation). This also includes to identify problems in industry
  • 8.
    Key Aspects ofSysML RQ4: What are the key aspects of applying SysML in the classified publications?  In which phase of the engineering process is SysML used?1  Requirement  Design  Implementation  Validation & Verification  Which contribution type does the publications have?2  Technique  Process  Notation  Tool  Specific Solution  Other 8 1: VDI Verein Deutscher Ingenieure: https://www.vdi.de/2206, Accessed: 2017-03-14 2: Shaw, M.: Writing good software engineering research paper. In Proc. of the 25th International Conference on Software Engineering, IEEE Computer Society, 2003, pp. 726–737.
  • 9.
    Conduct Search  Toolsupport  DBLP http://dblp.uni-trier.de/  Open bibliographic information on computer science journals and proceedings  ACM Digital Library http://dl.acm.org/  Research, discovery and networking platform  Collection of full-text articles, bibliographic records  IEEE Xplore Digital Library http://ieeexplore.ieee.org  Technical literature in engineering and technology  Scopus http://www.scopus.com/  Largest abstract and citation database of peer-reviewed literature  Scientific journals, books and conference proceedings  Keywords / Phrases  SysML  Systems Modeling Language / systems modeling language  System Modeling Language / system modeling language 9
  • 10.
    Screening of Papers Restrictions  Years 2005 until 2017  Keyword must be contained in the title of the paper  Delete  Duplicates  Papers without abstract available  Papers without any context to SysML  Books and theses  Final check of the result set: 21.1.2019 579 papers for the analysis 10
  • 11.
    Results: Bibliometrics ofSysML publications (1)  2005 First draft of SysML by OMG  2007 / 2008 / 2010 / 2012 / 2017 – New versions of SysML 11
  • 12.
    Results: Bibliometrics ofSysML publications (2) 12 Conference Venue Pub. INCOSE (Annual International Symposium of the International Council on Systems Engineering) 32 IDETC/CIE (International Design Engineering Technical Conferences) 14 ETFA (International Conference on Emerging Technologies and Factory Automation) 13 SysCon (International Systems Conference) 12 MODELSWARD (Conference on Model-Driven Engineering and Software Development) 11 CSER (Conference on Systems Engineering Research) 10 ISSE (International Symposium on Systems Engineering) 9 WSC (Winter Simulation Conference) 9 ICEIS (International Conference on Enterprise Information Systems) 8 Journal Venue Pub. Systems Engineering 11 Innovations in Systems and Software Engineering 5 Software and Systems Modeling 4
  • 13.
    Results: Research communitiesand main contributors of SysML topics (1)  1167 authors worldwide  30 single authors without relationship to another author in the SysML publications  Major contributors located in USA, France, and Germany 13
  • 14.
    Results: Research communitiesand main contributors of SysML topics (2) 14https://gephi.org/ Network Biggest network (61 authors) with bridge builder - Paredis C.J.J.: Georgia Institute of Technology, Atlanta, USA - Friedenthal S.: Lockheed Martin Corporation, Fairfax, USA - Canedo A.: Siemens Corporate Research, Princeton, USA
  • 15.
    Results: Research communitiesand main contributors of SysML topics (3) 15
  • 16.
    Result: Classification ofSysML publications  Higher number of philosophical papers from 2005 to 2007  Focus on realization of own approaches and implementations since 2010 16
  • 17.
    Results: Key aspectsof applying SysML (1)  Phases Design and Validation are predominant topics in all type facet categories  Contribution types  Technique  Notation 17
  • 18.
    Results: Key aspectsof applying SysML (2) 18
  • 19.
    Results: Formalism TransformationGraph (FTG)1 19 1: Lúcio, L., Mustafiz, S., Denil, J., Meyers, B., Vangheluwe, H.: The Formalism Transformation Graph as a Guide to Model Driven Engineering. Tech. rep. McGill University (2012) SysML FTG: https://figshare.com/s/5de5b35ed2ef8cdf8317 SysML T DEVS ExtractSimulationModel Arena ExtractAnalysisModel T ExtractVerificationModel T B T Matlab Orocos-RTT T ExtractCode M3TK Simulink DHC Communication Protocol ExtractTestModel TSmartesting (Tool) VHDL- AMS OWL Stochastic Reward Nets (SRNs) Prolog PetriNets Simscape Modelica DesignStructureMatrix / MultipleDomainMatrix ExtractMatrix TRNSYS Communicating Sequential Processes HDL Recursive Object Model (ROM) T MigrateModel ADL IP Core T GenerateModel Mathematica GAMS Flexsim James II fUML HLA Aspen Plus ABD logic EXPRESS model Clean Axiom set T ExtractCanonicalForm T ExtractDesignModel Alta Rica EPLAN, Modelica CML DTMC OPM MoDAF/DoDAF Architectural Model NuSMV ProVerif Systemigrams Traceability Matrix Promela/Spin UPPAAL Fault Tree Generic Simulation Model eM Plant PIDO framework SafeSlice UML PRISM Interface Automata IBM IEC61499 Python SystemVerilog T ExtractOptimizationModel PyOpt SHIOQ(D) SPL ABM MES Gateway Configurations ARM Cortex-M MCUs Real-Time System IEC 61131-3 SystemC DiVinE 1-3 4-6 7-9 ≥10
  • 20.
    Results: Formalism ExtensionGraph (FEG) 20SysML FEG: https://figshare.com/s/0f0f13ea189b891e312f SysML DEVS {Simulation} {SoS} {GoalModeling} AVATAR {Verification} DSEE {DSM} OMAC/PackML Traceability Simulink MARTE SystemC/C {Electronics} Architecture Decisions {Architecture Modeling}SysML4 Modelica Contracts/ Refinements SysADL {Mechanics} Contact & Channel {Geometry} GERTRUDe {Saftey & Security} Saftey {Mechatronics} System Architecture {Thermal} TheReSE Trade Studies Variability Modeling {Automation} SysML-AT EIS {IT} OMEGA Aspects AUTOSAR {Automotive} KAOS UPDM TLM fSysML {Execution} Modelica Simscape Space {Libary} Constraints SysML4 IoT {IoT} AutomationML Geometrical Bond Graph 3+1 SysML View-Model Multi-Physical Interactions SysML4 Mechatronics FMI Signal Flow Multi Agent System ISO 26262 Tolerance Specification Design Functional/Non Functional Requirements DSL IEC 61131-3 Fault Tree Security Viewpoint {Embedded Systems} ExSAM Consol-Optcad SysML-Sec Multi-Core Process Knowledge Management B Time Constraints TEPE Use Case Points Design Optimization Verification Management Techno- Economic AMADEOS MES Gateway {Manufacturing} Piping & Instrumentation Diagram Supply Chain OWLVulnerabilities State Analysis1-3 4-6 7-9 ≥10
  • 21.
    Conclusion and Outlook Large set of SysML paper found  A plethora of transformations and extensions available  Worldwide community (but also dedicated groups)  New diagrams (requirement, parametric) are in use  SysML v2  Addresses the issue of ambiguous operational semantics  Planned enhancements (e.g., temporal components, history, …)  Modeling hybrid systems  Most publications consider either discrete or continuous challenges  Formal semantics for SysML combining discrete and continuous parts  Deep analysis for specific topics  Contribution category notation may be further differentiated by specific language engineering aspects, … 21
  • 22.
    Questions? 22 Data available athttps://figshare.com/s/871aa0c03aa18eb3edf6 Thirteen years of SysML: A systematic mapping study Sabine Wolny sabine.wolny@jku.at