Machine Learning & Data Analytics in Digital Twin: ML Integration, Conventional Creation, Real-World Benefits, NeRF & 3D Splatting

1. Machine Learning & Data
Analytics in Digital Twin
Keval Patel
@kmpatel100

2. Introduction
Keval Patel
@kmpatel100
Founder
Personal Company
Data Analytics for Business
Bachelors Degree in Physics

3. Keval Patel
@kmpatel100
Agenda
1. Digital Twin
2. Conventional Digital Twin vs Morden Digital Twin
3. Machine Learning and Data Analysis
4. Neural Radiance Fields (Nerfs) & Gaussian
Splatting
Machine Learning & Data
Analytics in Digital Twin

4. Digital Twin
What is Digital Twin?
Digital Replica of physical object which only exist as
software rendered by computing power
Who initially created Digital Twin?
How ?

5. Digital Twin
In 1970, during Apollo 13 mission there was spark in oxygen tank
It become famous and successful rescue mission
How has NASA’s
engineers found
the solution?

6. Digital Twin

7. Type of Digital Twin
Descriptive twin Informative twin Predictive twin Comprehensive
twin
Autonomous
twin
Level 1 Level 2 Level 3 Level 4 Level 5

8. Type of Digital Twin
Descriptive twin: 2D drawings, 3D models
Informative twin: Connected with sensors, real-time data
Predictive twin: Predictions such weather, maintenance cost
Comprehensive twin: Advance modeling, simulations,
recommendations
Autonomous twin: Ability to learn and make changes as
needed with A.I.

9. Descriptive twin
rough Measurements
Floor plans, schematic drawings
600 ft
50 ft
Too much
Information

10. Informative twin
Lots of Sensors
Real-Time Data
All the information related
to the Physical object

11. Predictive twin
Predict the potential threats & issues
based on Real-time data
Preventive Maintenance

12. Comprehensive twin
It’s all about modeling and simulations
Find the solutions for problems

13. Autonomous twin
It learn and make decisions through
artificial intelligence
Basically, the combination of 3 different levels
Level 2 - Informative Twin
Level 3 - Predictive Twin
Level 4 - Comprehensive Twin

14. Conventional vs Morden Approach

15. Conventional Approach
Everything was hand-made initially But everything change after CAD files

16. Conventional Approach
Manual measuring with Tape Measuring with iPad OR iPhone

17. Morden Approach
Create 3D Model How ?

18. Morden Approach
Photogrammetry Ortho-mosaic imagery

19. ML & DA in Digital Twin
How can Machine Learning and Data Analytics help?

20. Space/Occupancy Management
Manual counting Space Management System

21. Temperature Control
Manually managing Temperature
Automatically manage Temperature
based on occupancy
Building Automation System (BAS)

22. Which industries are affected?
Automotive Healthcare
Insurance
Smart Cities
Building Automations

23. General Idea
behind the
scenes

24. Neural
Radiance Fields
and Gaussian
Splatting

25. Morden Approach
Photogrammetry Ortho-mosaic imagery

26. Structure From Motion

27. Neural Radiance Fields

28. Gaussian Splatting

29. Gaussian Distribution

30. Gaussian Distribution

31. Few Examples
• https://poly.cam/gaussian-splatting
• https://lumalabs.ai/
• https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
https://youriguide.com/1_riverside_dr
https://youriguide.com/realiq_demo
https://www.marzipano.net/