This document summarizes a project meeting on August 8, 2018 about SCIKE and the Industrial Data Space task. It discusses partners involved including DFKI and Siemens, the use of semantic representations for Industry 4.0, and developing multimodal interaction based on semantic representations. It describes a use case of interacting with a virtual production line using gestures, speech, and a situation-adaptive dialogue platform. The goal is to create a proof of concept demonstration by the end of 2018 and a full demonstrator by August 2019.

1. Dr. Tilman Becker
SCIKE Project Meeting
Saarbrücken
8 August 2018
German Research Center for Artificial Intelligence, DFKI GmbH
Stuhlsatzenhausweg 3, Saarland Informatics Campus D3 2
D-66123 Saarbrücken
Tel.: +49 681 857 75-5271
Fax.: +49 681 857 75-5341
Email: tilman.becker@dfki.de
www.dfki.de
SCIKE Silicon Valley
Task 1.2 Industrial Data Space

2. ·
Software-Cluster · Seite 2
Overview Industrial Data Space
o SCIKE Silicon Valley
o Task 1.2: Industrial Data Space
o Partner
o Semantic Representations for
Industrie 4.0
o Multimodal Interaction based on
Semantic Representations

3. ·
Software-Cluster · Seite 3
Partner Industrial Data Space
o DFKI Saarbrücken
FB Cognitive Assitance (formerly: Intelligent User Interfaces)
Prof. Wahlster
o SIEMENS USA, Berkeley
Siemens Corporate Technology
o KMU Saarbrücken
o Konzern USA
o KIS Universität Saarbrücken
o EIT Digital Silicon Valley Hub

4. DFKI GmbH has sites in
Kaiserslautern, Saarbrücken, Bremen, Berlin and Osnabrück
Standort
Kaiserslautern
(Firmensitz)
DFKI GmbH
Trippstadter Straße 122
D-67663 Kaiserslautern
Tel.: 0631 205 75-0
Fax.: 0631 205 75-5030
email: info@dfki.de
www.dfki.de
Standort
Saarbrücken
DFKI GmbH
Stuhlsatzenhausweg 3
Saarland Informatics Campus D3 2
D-66123 Saarbrücken
Tel.: 0681 85775 5252
Fax.: 0681 85775 5341
email: info@dfki.de
www.dfki.de
Projektbüro
Berlin
DFKI GmbH
Alt-Moabit 91c
D-10559 Berlin
Tel.: 030 23895 1800
Fax.: 030 23895 1810
email: info@dfki.de
www.dfki.de
Standort
Bremen
DFKI GmbH
Robert-Hooke-Straße 1
D-28359 Bremen
Tel.: 0421 178 45-4100
Fax.: 0421 178 45-4150
email: info@dfki.de
www.dfki.de
Robotics
Innovation Center
Außenstelle Osnabrück
DFKI GmbH
ICO InnovationsCentrum
Osnabrück
Albert-Einstein-Straße 1
D-49076 Osnabrück
Tel.: 0541 386050 2252
Fax.: 0541 969 2799
email: info@dfki.de
www.dfki.de

5. Basic Building Block:
Active Semantic Product Memory, Industrie 4.0: Digital Twin
Smart
Services
Production
Production
Planning
Product
Design
Production
Engineering
The Semantic Product Memory Is Continiously Updated and Serves as a Lifelog
of the History of an Individual Product
• Maintenance
• Context Conditions
• Security
• Location
• Status
Cyber-Physical System (CPS)
Physical Production
Component
Active Semantic Product
Memory as a Digital Model
• Embedded
Components,
• Interfaces
• CO2 Footprint
• Materials
• Handling
Includes Information about …
+
Source: Siemens

6. Basic Builing Block: Innovation Lab for Hybrid Human-
Robot Collaboration in Teams (MRK4.0)
2 Pepper4 Universal
Robots
2 KUKA
LBR iiwa
2 Double
Telepresence
• 20 Robots
 Humanoids, mobile platforms, tele-presence, collaborative robotic arms
• Cooperation with CIIRC (Czech Institute of Informatics, Robotics and
Cybernetics)
 Intelligent Human-Machine-Collaboration in cyber-physical production
environments
 Semantic Technologies for service orchestration and process
optimization in Smart Factories
 Multimodal, proactive und situation aware Production Assistence with
VR, AR and Mixed Reality-Technologies
 Realtime-Production Planning for Industrie 4.0
1 Baxter with
mobile base
1 Sawyer 4 MiR 100
mobile
platforms
2 ABB YuMi
2 Franka
Robots

7. Extended Modalities
OptiTrack optical tracking system 5x Microsoft HoloLens
(Augmented Reality)
2x HTC Vive
(Virtual Reality)
2x HTC Vive with SMI eye-tracker
(Virtual Reality)
2x wireless SMI eyetracker 1x GoPro Omni
(360 degree pictures)
1x Faro Laserscanner
(360 degree point clouds)
various in- and output devices

8. ·
Software-Cluster · Seite 8
Basic Building Block:
Software Cluster Projects
• SINNODIUM
• EMERGENT
• ADIWA
• Peer Energy Cloud
• Poly Energy Net

9. ·
Software-Cluster · Seite 9
SIEMENS USA
o SIEMENS USA, Berkeley
Siemens Corporate Technology
o „Web of Things“ – Gruppe
o Semantische Technologien
o Mensch-Maschine-Interaktion
o Cooperations with UC Berkeley, ICSI, U Stanford, Siemens
Princeton
o Established paths to Siemens Business Units and customers

10. ·
Software-Cluster · Seite 10
Semantis Representations for
Industrie 4.0
o As new standard for data exchange, -storage and –
processing
o Based on existing industry standards
o Siemens research topic:
Integration of industry standards based
on semantic representationen
o Modular integration framework

11. ·
Software-Cluster · Seite 11
SemanticProduct
Memory
Smart
Products
Smart
Data
Smart
Services
Technologies for Industrie 4.0
Layer cake

12. ·
Software-Cluster · Seite 12
Multimodal Interaction based on
Semantic Representations
o SIEMENS Use-Case:
o Semantic Modelling of a prodution line (car manufacturing in China)
o 3D-Modelling and Visualization
o Interaction in Virtual Reality
(Hololens) with Gestures and Speech
o DFKI Technology for multimodal Dialogs
Situation-Adaptive Multimodal Dialogue Platform

13. ·
Software-Cluster · Seite 13
Situation-Adaptive Multimodal Dialogue Platform

14. ·
Software-Cluster · Seite 14
SCIKE
Use-Case Production Line
o Dialog with Gestures and Speech
o Navigation through virtual production line
o Data base queries
o “Which machine connects here?“
o Free interaction
o “Any question at any time“
o Integration of interactivity as a “Smart Service“
Situation-Adaptive Multimodal Dialogue Platform

15. ·
Software-Cluster · Seite 15
SCIKE
Use-Case Production Line
o Use Case selected and roadmap decided
o First Proof-of-Concept until end of 2018
o Full Demonstrator by end of SCIKE_SV (August 2019)
Situation-Adaptive Multimodal Dialogue Platform

16. Design by R.O.
Thank you for your attention!

17. Dr. Tilman Becker
SCIKE Project Meeting
Saarbrücken
8 August 2018
German Research Center for Artificial Intelligence, DFKI GmbH
Stuhlsatzenhausweg 3, Saarland Informatics Campus D3 2
D-66123 Saarbrücken
Tel.: +49 681 857 75-5271
Fax.: +49 681 857 75-5341
Email: tilman.becker@dfki.de
www.dfki.de
SCIKE Silicon Valley
Task 1.2 Industrial Data Space

18. ·
Software-Cluster · Seite 18
Intelligent Assistant at Wittenstein
alpha
o Intelligent assembly manual for
o Electrical motors (stator)
o Gear boxes
o Modalities
o Speech (in and out)
o Screen (text, images, video)
o Buttons and Gestures

19. ·
Software-Cluster · Seite 19
Intelligent Assistant at Wittenstein
alpha
o 200 variants
o 10% with special issues
have their own manual
o Target group:
o New and experienced workers
o Security
o Documentation