SlideShare a Scribd company logo
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
ML-Aided Simulation:A Conceptual Framework for
Integrating Simulation Models with Machine Learning
Mahmoud Elbattah, Owen Molloy
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Integrating M&S with ML: Why, When, How?
2
Image Source:
Robinson, S. (2004). Simulation: The Practice of Model Development and Use. Chichester: Wiley.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Basic View on Systems & Simulations
3
Source: Zeigler, B.P. and Sarjoughian, H.S., 2012. Guide to modeling and simulation of systems of systems.
Springer Science & Business Media.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Motivational Questions
• How simulation models can learn about changes in the actual
system behaviour with minimal human input?
• Is it possible to integrate simulation models with ML models to
enable that learning process to happen in an automated
manner? If so, how?
• Can the integration with ML lead to a higher level of confidence
in simulations, given by a more measurable accuracy of ML
models?
4
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 1:
Learning to Predict the System Behaviour
5
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 2:
Identify Predictable Influential Variables
6
• Influential Variable: A variable that has a significant influence
on the system behaviour with respect to the question(s) of
interest, whereas the variation of that variable can lead to a
change in policy, strategy, or decision-making.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 2:
Identify Predictable Influential Variables (cont’d)
7
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 2:
Identify Predictable Influential Variables (cont’d)
8
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 3:
Incremental Learning = Adaptive Behaviour
9
A Basic Feedback Loop 1
Feedback Loops Aided by ML.
Source: Forrester, J.W., 1968. Principles of Systems, Text and Workbook, Wright-Allen Press-US.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Key Idea 3:
Incremental Learning = Adaptive Behaviour (cont’d)
10
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
How This Can Be Useful?
• The power of learning from data is that the entire process can
be automated with minimal, or without, involvement of human
input.
• This can be useful for modeling dynamic systems that exist in
rapidly changing environments (Concept Drift).
• Realising “self-adaptive” simulation models that can adapt their
behaviour based on ML predictions.
• May help reduce the epistemic uncertainty1 attributed to the
subjective interpretation of system knowledge.
• Works effectively in situations where the system behaviour can
be largely described and learned by examples.
11
Source: Oberkampf, W.L., DeLand, S.M., Rutherford, B.M., Diegert, K.V. and Alvin, K.F., 2002. Error and uncertainty in modeling
and simulation. Reliability Engineering & System Safety, 75(3), pp.333-357.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Further Directions: More Complex ML for More
Complex Systems
12
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
Closing Thought
• Machine Learning: The subfield of computer science that
gives computers the ability to learn without being explicitly
programmed (Arthur Samuel 1959).
• ML-Aided Simulations: Simulation models given the
ability to adapt to new knowledge without being explicitly
informed by modellers.
13
Source: Samuel, A.L., 1959. Some Studies in Machine Learning Using the Game of Checkers. IBM Journal of Research and
Development, 3(3), pp.210-229.
ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS)
THANK YOU!
Mahmoud Elbattah
mahmoud.elbattah@nuigalway.ie

More Related Content

Similar to ML-Aided Simulation: A Conceptual Framework for Integrating Simulation Models with Machine Learning

Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"
Aalto University
 
​​Explainability in AI and Recommender systems: let’s make it interactive!
​​Explainability in AI and Recommender systems: let’s make it interactive!​​Explainability in AI and Recommender systems: let’s make it interactive!
​​Explainability in AI and Recommender systems: let’s make it interactive!
Eindhoven University of Technology / JADS
 
Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationAmjad Adib
 
Machine Learning The Powerhouse of AI Explained.pdf
Machine Learning The Powerhouse of AI Explained.pdfMachine Learning The Powerhouse of AI Explained.pdf
Machine Learning The Powerhouse of AI Explained.pdf
CIO Look Magazine
 
System modeling and simulation full notes by sushma shetty (www.vtulife.com)
System modeling and simulation full notes by sushma shetty (www.vtulife.com)System modeling and simulation full notes by sushma shetty (www.vtulife.com)
System modeling and simulation full notes by sushma shetty (www.vtulife.com)
Vivek Maurya
 
Real World Talent Insights From Computer Simulations
Real World Talent Insights From Computer SimulationsReal World Talent Insights From Computer Simulations
Real World Talent Insights From Computer Simulations
Andrea Kropp
 
Applying Machine Learning to Agricultural Data
Applying Machine Learning to Agricultural DataApplying Machine Learning to Agricultural Data
Applying Machine Learning to Agricultural Databutest
 
Machine learning
Machine learningMachine learning
Machine learning
Tushar Nikam
 
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docxChapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
tiffanyd4
 
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docxChapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
mccormicknadine86
 
T OWARDS A S YSTEM D YNAMICS M ODELING M E- THOD B ASED ON DEMATEL
T OWARDS A  S YSTEM  D YNAMICS  M ODELING  M E- THOD B ASED ON  DEMATELT OWARDS A  S YSTEM  D YNAMICS  M ODELING  M E- THOD B ASED ON  DEMATEL
T OWARDS A S YSTEM D YNAMICS M ODELING M E- THOD B ASED ON DEMATEL
ijcsit
 
Rsqrd AI: Recent Advances in Explainable Machine Learning Research
Rsqrd AI: Recent Advances in Explainable Machine Learning ResearchRsqrd AI: Recent Advances in Explainable Machine Learning Research
Rsqrd AI: Recent Advances in Explainable Machine Learning Research
Sanjana Chowdhury
 
Interpretable machine learning
Interpretable machine learningInterpretable machine learning
Interpretable machine learning
Sri Ambati
 
Model bias in AI
Model bias in AIModel bias in AI
Model bias in AI
Jason Tamara Widjaja
 
Introduction of abm
Introduction of abmIntroduction of abm
Introduction of abm
Yudi Yasik
 
System Modeling & Simulation Introduction
System Modeling & Simulation  IntroductionSystem Modeling & Simulation  Introduction
System Modeling & Simulation Introduction
SharmilaChidaravalli
 
Modeling & simulation in projects
Modeling & simulation in projectsModeling & simulation in projects
Modeling & simulation in projectsanki009
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Sri Ambati
 
The state of the art in integrating machine learning into visual analytics
The state of the art in integrating machine learning into visual analyticsThe state of the art in integrating machine learning into visual analytics
The state of the art in integrating machine learning into visual analytics
Cagatay Turkay
 

Similar to ML-Aided Simulation: A Conceptual Framework for Integrating Simulation Models with Machine Learning (20)

Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"Inverse Modeling for Cognitive Science "in the Wild"
Inverse Modeling for Cognitive Science "in the Wild"
 
​​Explainability in AI and Recommender systems: let’s make it interactive!
​​Explainability in AI and Recommender systems: let’s make it interactive!​​Explainability in AI and Recommender systems: let’s make it interactive!
​​Explainability in AI and Recommender systems: let’s make it interactive!
 
Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to Implementation
 
Machine Learning The Powerhouse of AI Explained.pdf
Machine Learning The Powerhouse of AI Explained.pdfMachine Learning The Powerhouse of AI Explained.pdf
Machine Learning The Powerhouse of AI Explained.pdf
 
System modeling and simulation full notes by sushma shetty (www.vtulife.com)
System modeling and simulation full notes by sushma shetty (www.vtulife.com)System modeling and simulation full notes by sushma shetty (www.vtulife.com)
System modeling and simulation full notes by sushma shetty (www.vtulife.com)
 
Real World Talent Insights From Computer Simulations
Real World Talent Insights From Computer SimulationsReal World Talent Insights From Computer Simulations
Real World Talent Insights From Computer Simulations
 
Applying Machine Learning to Agricultural Data
Applying Machine Learning to Agricultural DataApplying Machine Learning to Agricultural Data
Applying Machine Learning to Agricultural Data
 
Machine learning
Machine learningMachine learning
Machine learning
 
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docxChapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
 
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docxChapters 4,5 and 6Into policymaking and modeling in a comple.docx
Chapters 4,5 and 6Into policymaking and modeling in a comple.docx
 
Ai unit-6
Ai unit-6Ai unit-6
Ai unit-6
 
T OWARDS A S YSTEM D YNAMICS M ODELING M E- THOD B ASED ON DEMATEL
T OWARDS A  S YSTEM  D YNAMICS  M ODELING  M E- THOD B ASED ON  DEMATELT OWARDS A  S YSTEM  D YNAMICS  M ODELING  M E- THOD B ASED ON  DEMATEL
T OWARDS A S YSTEM D YNAMICS M ODELING M E- THOD B ASED ON DEMATEL
 
Rsqrd AI: Recent Advances in Explainable Machine Learning Research
Rsqrd AI: Recent Advances in Explainable Machine Learning ResearchRsqrd AI: Recent Advances in Explainable Machine Learning Research
Rsqrd AI: Recent Advances in Explainable Machine Learning Research
 
Interpretable machine learning
Interpretable machine learningInterpretable machine learning
Interpretable machine learning
 
Model bias in AI
Model bias in AIModel bias in AI
Model bias in AI
 
Introduction of abm
Introduction of abmIntroduction of abm
Introduction of abm
 
System Modeling & Simulation Introduction
System Modeling & Simulation  IntroductionSystem Modeling & Simulation  Introduction
System Modeling & Simulation Introduction
 
Modeling & simulation in projects
Modeling & simulation in projectsModeling & simulation in projects
Modeling & simulation in projects
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
 
The state of the art in integrating machine learning into visual analytics
The state of the art in integrating machine learning into visual analyticsThe state of the art in integrating machine learning into visual analytics
The state of the art in integrating machine learning into visual analytics
 

More from Mahmoud Elbattah

Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
Mahmoud Elbattah
 
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
Mahmoud Elbattah
 
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
Mahmoud Elbattah
 
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye MovementNLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
Mahmoud Elbattah
 
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
Mahmoud Elbattah
 
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
Mahmoud Elbattah
 
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
Mahmoud Elbattah
 
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
Mahmoud Elbattah
 
Designing Care Pathways Using Simulation Modeling and Machine Learning
Designing Care Pathways Using Simulation Modeling and Machine LearningDesigning Care Pathways Using Simulation Modeling and Machine Learning
Designing Care Pathways Using Simulation Modeling and Machine Learning
Mahmoud Elbattah
 
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
Mahmoud Elbattah
 
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
Mahmoud Elbattah
 
Evaluation Criteria of ERP Systems
Evaluation Criteria of ERP SystemsEvaluation Criteria of ERP Systems
Evaluation Criteria of ERP Systems
Mahmoud Elbattah
 
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
Mahmoud Elbattah
 
Using Simulation Modeling to Design Value-Based Healthcare Systems
Using Simulation Modeling to Design Value-Based Healthcare SystemsUsing Simulation Modeling to Design Value-Based Healthcare Systems
Using Simulation Modeling to Design Value-Based Healthcare Systems
Mahmoud Elbattah
 
Large-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
Large-Scale Ontology Storage and Query Using Graph Database-Oriented ApproachLarge-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
Large-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
Mahmoud Elbattah
 
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
Mahmoud Elbattah
 
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven VisualisationFrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
Mahmoud Elbattah
 
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
Mahmoud Elbattah
 
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
Mahmoud Elbattah
 
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
Mahmoud Elbattah
 

More from Mahmoud Elbattah (20)

Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
Learning Embeddings from Free-text Triage Notes using Pretrained Transformer ...
 
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
Vision-Based Approach for Autism Diagnosis Using Transfer Learning and Eye-Tr...
 
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
NLP-Based Prediction of Medical Specialties at Hospital Admission Using Triag...
 
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye MovementNLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
NLP-Based Approach to Detect Autism Spectrum Disorder in Saccadic Eye Movement
 
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
Generative Modeling of Synthetic Eye-Tracking Data: NLP-Based Approach with R...
 
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
Multi-Channel ConvNet Approach to Predict the Risk of In-Hospital Mortality f...
 
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-...
 
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
Learning to Predict Autism Spectrum Disorder Based on the Visual Patterns of ...
 
Designing Care Pathways Using Simulation Modeling and Machine Learning
Designing Care Pathways Using Simulation Modeling and Machine LearningDesigning Care Pathways Using Simulation Modeling and Machine Learning
Designing Care Pathways Using Simulation Modeling and Machine Learning
 
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
Clustering-Aided Approach for Predicting Patient Outcomes with Application to...
 
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
Using Machine Learning to Predict Length of Stay and Discharge Destination fo...
 
Evaluation Criteria of ERP Systems
Evaluation Criteria of ERP SystemsEvaluation Criteria of ERP Systems
Evaluation Criteria of ERP Systems
 
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
The Economic Burden of Hip Fractures among Elderly Patients in Ireland: A Com...
 
Using Simulation Modeling to Design Value-Based Healthcare Systems
Using Simulation Modeling to Design Value-Based Healthcare SystemsUsing Simulation Modeling to Design Value-Based Healthcare Systems
Using Simulation Modeling to Design Value-Based Healthcare Systems
 
Large-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
Large-Scale Ontology Storage and Query Using Graph Database-Oriented ApproachLarge-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
Large-Scale Ontology Storage and Query Using Graph Database-Oriented Approach
 
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
Towards Improving Modeling and Simulation of Clinical Pathways: Lessons Learn...
 
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven VisualisationFrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
FrrbaseViz-A Tool for Exploring Freebase Using Query-Driven Visualisation
 
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
Supply Chains Modelling and Simulation Framework:Graph-Driven Approach Using ...
 
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
Coupling Simulation with Machine Learning:A Hybrid Approach for Elderly Disch...
 
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
Learning about Systems Using Machine Learning:Towards More Data-Driven Feedba...
 

Recently uploaded

Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
pchutichetpong
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Linda486226
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
ewymefz
 
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar
 
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
ukgaet
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
axoqas
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单
enxupq
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
Q1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year ReboundQ1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year Rebound
Oppotus
 
一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单
enxupq
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
AbhimanyuSinha9
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
ewymefz
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
haila53
 
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
NABLAS株式会社
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
NABLAS株式会社
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
ewymefz
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
ArpitMalhotra16
 

Recently uploaded (20)

Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
 
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
 
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单一比一原版(QU毕业证)皇后大学毕业证成绩单
一比一原版(QU毕业证)皇后大学毕业证成绩单
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
Q1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year ReboundQ1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year Rebound
 
一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
 
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
 

ML-Aided Simulation: A Conceptual Framework for Integrating Simulation Models with Machine Learning

  • 1. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) ML-Aided Simulation:A Conceptual Framework for Integrating Simulation Models with Machine Learning Mahmoud Elbattah, Owen Molloy
  • 2. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Integrating M&S with ML: Why, When, How? 2 Image Source: Robinson, S. (2004). Simulation: The Practice of Model Development and Use. Chichester: Wiley.
  • 3. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Basic View on Systems & Simulations 3 Source: Zeigler, B.P. and Sarjoughian, H.S., 2012. Guide to modeling and simulation of systems of systems. Springer Science & Business Media.
  • 4. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Motivational Questions • How simulation models can learn about changes in the actual system behaviour with minimal human input? • Is it possible to integrate simulation models with ML models to enable that learning process to happen in an automated manner? If so, how? • Can the integration with ML lead to a higher level of confidence in simulations, given by a more measurable accuracy of ML models? 4
  • 5. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 1: Learning to Predict the System Behaviour 5
  • 6. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 2: Identify Predictable Influential Variables 6 • Influential Variable: A variable that has a significant influence on the system behaviour with respect to the question(s) of interest, whereas the variation of that variable can lead to a change in policy, strategy, or decision-making.
  • 7. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 2: Identify Predictable Influential Variables (cont’d) 7
  • 8. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 2: Identify Predictable Influential Variables (cont’d) 8
  • 9. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 3: Incremental Learning = Adaptive Behaviour 9 A Basic Feedback Loop 1 Feedback Loops Aided by ML. Source: Forrester, J.W., 1968. Principles of Systems, Text and Workbook, Wright-Allen Press-US.
  • 10. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Key Idea 3: Incremental Learning = Adaptive Behaviour (cont’d) 10
  • 11. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) How This Can Be Useful? • The power of learning from data is that the entire process can be automated with minimal, or without, involvement of human input. • This can be useful for modeling dynamic systems that exist in rapidly changing environments (Concept Drift). • Realising “self-adaptive” simulation models that can adapt their behaviour based on ML predictions. • May help reduce the epistemic uncertainty1 attributed to the subjective interpretation of system knowledge. • Works effectively in situations where the system behaviour can be largely described and learned by examples. 11 Source: Oberkampf, W.L., DeLand, S.M., Rutherford, B.M., Diegert, K.V. and Alvin, K.F., 2002. Error and uncertainty in modeling and simulation. Reliability Engineering & System Safety, 75(3), pp.333-357.
  • 12. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Further Directions: More Complex ML for More Complex Systems 12
  • 13. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) Closing Thought • Machine Learning: The subfield of computer science that gives computers the ability to learn without being explicitly programmed (Arthur Samuel 1959). • ML-Aided Simulations: Simulation models given the ability to adapt to new knowledge without being explicitly informed by modellers. 13 Source: Samuel, A.L., 1959. Some Studies in Machine Learning Using the Game of Checkers. IBM Journal of Research and Development, 3(3), pp.210-229.
  • 14. ACM 2018 Conference on Principles of Advanced Discrete Simulation (PADS) THANK YOU! Mahmoud Elbattah mahmoud.elbattah@nuigalway.ie