Virtual Reality Analytics

Virtual Reality Analytics
Keynote
by Joerg Osarek
IT-avant-gardist, Business-IT-Architect
Skilltower Institute
Business Intelligence Stream
at the DOAG Conference 2015
November 17th 2015, v1.L
Nuremberg, Germany
Keynote
by Joerg Osarek
IT-avant-gardist, Business-IT-Architect
Business Intelligence Stream
at the DOAG Conference 2015
November 17th 2015, v1.L
Nuremberg, Germany

2Joerg Osarek © Skilltower Institute, Nov. 2015
Virtual Reality: The power of Immersion
VR / MR puts tough guys under a spell unlike any other medium
ranging from
delight to pure horror
Try it yourself after the keynote
or visit our VR Meetup in Frankfurt.

What is happening at VR / MR? - VR is not just headsets!
Display Technology
 2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2,
Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++
 2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version
Playstation VR (Morpheus)Playstation VR (Morpheus)
HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking)
Microsoft Hololens for DevelopersMicrosoft Hololens for Developers

Display Technology
FulldomesFulldomes
Leia HolodisplayLeia Holodisplay
Magic LeapMagic Leap

Display Technology Recording
FulldomesFulldomes
Google JumpGoogle Jump
+ Youtube VR+ Youtube VR
JauntVR NeoJauntVR Neo
Lightfield CamLightfield Cam
Lytro ImmergeLytro Immerge

Display Technology Recording
Interacting 2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2,
FulldomesFulldomes
Google JumpGoogle Jump
+ Youtube VR+ Youtube VR
JauntVR NeoJauntVR Neo
Lightfield CamLightfield Cam
LeapMotionLeapMotion
Fairy LightsFairy Lights
TouchableTouchable
HologramHologram
VR SculptingVR Sculpting
Google SoliGoogle Soli
Radar ChipRadar Chip
Disney DISHDisney DISH
ILM X-LabsILM X-Labs
Lytro ImmergeLytro Immerge

What is happening next?
 Voice Mood Analysis (e.g. cogito App)
 Brain Wave interfaces (e.g. NeuroSky Neuro Headset)
 Nerve Induction? (e.g. direct projection into retina or nerves)
 Mark Zuckerberg: „we'll be able to send emotions to each other soon“*
* Article at theverge.com from Rich McCormick on June 30, 2015.* http://www.theverge.com/2015/6/30/8873819/mark-zuckerberg-facebook-sending-emotions-soon

Quelle: Woman and pan: combined of two public domain images from www.pixabay.com
 Mark Zuckerberg: „we'll be able to send emotions to each other soon“
… could look like this:

Quelle: Woman and pan: combined of two public domain images from www.pixabay.com , Quelle: Angry driver: Vladimir Mucibabic/123rf.com #4554701_l
 Mark Zuckerberg: „we'll be able to send emotions to each other soon“
… could look like this:
LIKE ?

VR Analytics comes in two flavours
a) Visualization of analytics data in VR

VR Analytics comes in two flavours
a) Visualization of analytics data in VR
We don't cover this today.
b) Analyze VR experiences in your DWH

Let's Play

Level 1: Your Mission
BUILD ME THE PERFECT
VR ANALYTICS PLATFORM.
MUHAHAHA...

Level 2: Make or buy? - Status VR Analytics vendorsLevel 2: Make or buy? - Status VR Analytics vendors
 Election.tvElection.tv Engages Kosher Virtual Reality Analytics For Exclusive 2016 USEngages Kosher Virtual Reality Analytics For Exclusive 2016 US
Election Tech Polling Partnership (Election Tech Polling Partnership (Kosher.tvKosher.tv, a media ventures company), a media ventures company)
 retinadVR.comretinadVR.com (Unity Plugin) → joined(Unity Plugin) → joined rothenbergventures.comrothenbergventures.com
(investing in frontier tech startups)(investing in frontier tech startups)
 Some BI / DWH experts start to broaden their portfolioSome BI / DWH experts start to broaden their portfolio
(like(like its-peopleits-people andand skilltower instituteskilltower institute))
 It is quite early for the large BI / DWH software vendors but we should watchIt is quite early for the large BI / DWH software vendors but we should watch
trendsetterstrendsetters like:like: IBM, SAP, Qlik, Oracle, SAS, Information Builders,IBM, SAP, Qlik, Oracle, SAS, Information Builders,
MicrostrategyMicrostrategy andand challengerschallengers like:like: Microsoft, Tableau, Tibco, Infor,Microsoft, Tableau, Tibco, Infor,
BoardBoard and some more.and some more.

Level 3: Approaches for displaying VR in headsets
Hybrid Rendering
 Nozon.com Presenz
 some light field tech
Live 3D in Game engine
 (Unity3D, Cryengine
Unreal Engine 4, ...).
Pre-rendered
 YouTube VR or 360°
 VR Player apps, ...

measurement data, e.g.:measurement data, e.g.:
Position 5,3,1Position 5,3,1
Rotation 23°left, 18°upRotation 23°left, 18°up
Speed of movementSpeed of movement
(eye position, parallax)(eye position, parallax)
......
Mapping:Mapping:
Position in VRPosition in VR
Objects watchedObjects watched
InteractionsInteractions
……
Merging with otherMerging with other
Data WarehouseData Warehouse
ContentContent
Enriched AnalysisEnriched Analysis
determinedetermine
meaningmeaning
MeasureMeasure
AnalyzeAnalyze
←← (Interactive live return path) ←(Interactive live return path) ←
Level 4: How to build a semanticLevel 4: How to build a semantic
Meta Layer for VR Analytics?Meta Layer for VR Analytics?

 depends on the particular VR/MR experience.depends on the particular VR/MR experience.
 meaning must be mapped manually or...meaning must be mapped manually or...
 (soon) can be mapped automatically by autonomous analysis algorithms(soon) can be mapped automatically by autonomous analysis algorithms
(Google/Facebook recognize objects, text and speech in images, videos,(Google/Facebook recognize objects, text and speech in images, videos,
audio) e.g. Google Translate Augmented Reality or Youtube Transcriptionaudio) e.g. Google Translate Augmented Reality or Youtube Transcription
Level 4: How to build a semanticLevel 4: How to build a semantic
Meta Layer for VR Analytics?Meta Layer for VR Analytics?

Level 5: add more data sources like heart rate, voice, ...
SmartWatch:SmartWatch:
heart rateheart rate
voice and moodvoice and mood
analysisanalysis
facial expressionfacial expression
recognitionrecognition
NLP* eyeNLP* eye
movementsmovements
*NLP = Neuro Linguistic Programming:*NLP = Neuro Linguistic Programming:
an approach to communication, personal development, and psychotherapyan approach to communication, personal development, and psychotherapy
created by Richard Bandler and John Grinder in California, United States in the 1970s.created by Richard Bandler and John Grinder in California, United States in the 1970s.

Level 5: facial
expression analysis
Science Fiction?
Only for Headsets?
predicted in 2012 at DOAG for 2017,predicted in 2012 at DOAG for 2017,
already reality todayalready reality today

Level 5: facial
expression analysis
Science Fiction?
Only for Headsets?
www.affectiva.comwww.affectiva.com
The video, that watches you.The video, that watches you.
analysis of facial expressions and your moodanalysis of facial expressions and your mood
with a simple webcam → Emotion Database with APIwith a simple webcam → Emotion Database with API

Level 5: facial
expression analysis
Science Fiction?
Only for Headsets?
Yesterday:Yesterday:
What did the user do while interacting?What did the user do while interacting?
Today:Today:
What is the user doing while interacting?What is the user doing while interacting?
Tomorrow:Tomorrow:
What is the user going to doWhat is the user going to do while interacting?while interacting?

Mission accomplishedMission accomplished
 measurement data → semantic layer
 combination with
additional data
(heart rate, facial expressions,
eye movement)
 combination with
classic data warehouse
data streams
 enables (NLP)
conclusions
close to thought reading and
prediction of behaviour
YES. YES.
MUHAHAHA...

Level Up: Entering the USEMIR era
 Q-GRINS technologies introduce artificial intelligence (strong AI) and hyper
intelligence into our world. Corporations, organizations, countries, AIs and
HIs will be able to read our thoughts.
 Eventually we are confronted with U.SE.MIRU.SE.MIR –
UUbiquitiousbiquitious SESEnsiblensible MIMIxedxedRRealityeality
QuantumQuantum
TechTech
GeneticsGenetics RoboticsRobotics ITIT Nano-TechNano-Tech Space-TechSpace-Tech

I have an idea.
Let's provide them
with technology
to read our thougts.
Quelle: Wikimedia.org – Erstellt 1590 – Public Domain
Who ought to know what about us? - a comparable encounterWho ought to know what about us? - a comparable encounter

Joerg Osarek © Skilltower Institute, Nov. 2015 25
With great power comes great responsibility (Stan Lee)With great power comes great responsibility (Stan Lee)
 John F.Kennedy mastered this burden facing the cuba crisis and savedJohn F.Kennedy mastered this burden facing the cuba crisis and saved
us from a nuclear desaster.us from a nuclear desaster.
 What is our burden / fear at the eve of VR analytics, of machinesWhat is our burden / fear at the eve of VR analytics, of machines
capable of reading thoughts and of the technological singularity?capable of reading thoughts and of the technological singularity?

What choices do we have?
back to the caves?back to the caves?
prepare to be terminated?prepare to be terminated?

What choices do we have?
 Wrong question!Wrong question!
Why do we fear a Terminator-Scenario?Why do we fear a Terminator-Scenario?
 Is there a third choice?Is there a third choice?
 Why don't we consider ourselves as self-confident honourable partners?Why don't we consider ourselves as self-confident honourable partners?
 Do we want to work on ourselves and stop being the trickster?Do we want to work on ourselves and stop being the trickster?

The third choice:
We can qualify for the
22nd century by
cultivating
chivalry and wisdom.
Q22=C+W
humbleness, honour,
kindness, confidence,
politeness, courage and bravery, clemency,
moderate behaviour ,
continuity, loyalty, dignity,
discipline and decency

The third choice:
We can qualify for the
22nd century by
cultivating
chivalry and wisdom.
Q22=C+W
self confidence by
acting honourable
working together
as civilization
to boost our
development
EARNING BONUS POINTS:EARNING BONUS POINTS:
appearing as
self confident
and honourable
examples and
partners

LEVEL UP!LEVEL UP! INSERT COINSINSERT COINS
TO CONTINUETO CONTINUE
The rest is
up to you now.
Make your choice and
shape our future.

Contact and further information on VR Analytics
Dossier
publication date: 2016
Joerg Osarek
Founder and CEO
Triftstr. 30
D-61350 Bad Homburg
Germany
mailto:joerg.osarek@skilltower.com
Tel.: +49(0)151-23 0 24 333
www.skilltower.com

background information: Joerg Osarek
 ManagementManagement
 IT-avant-gardeIT-avant-garde
 Virtualization (VMware)Virtualization (VMware)
 Oracle, LinuxOracle, Linux
 Virtual Reality AnalyticsVirtual Reality Analytics
 Cinematic VRCinematic VR

Reports from the future – my passion ever since
1989: Hewlett Packard
Computer viruses – digital threat
or scare tactics?

1998: DOAG: VRML – The future
of the internet
Many thanks to
Wolfgang Taschner for
his archived copy

always some Years Ahead of Mainstream (YAM)
 1989: HP: Computer viruses: 10 YAM
 1998: DOAG: VRML – The future of the internet 9 YAM (2ndLife 2007)
 2007: DOAG: How does SOA influence Business Intelligence?: 3 YAM
 2010: DOAG: Cloud Computing and the Technology Monster: 2 YAM
 2011: DOAG: The Organic Computing age 9 YAM?
 2012: DOAG: SoMoLo (Social, Mobile, Local) / Big Data 3 YAM
 2015: DOAG: Virtual Reality Analytics 3-5 YAM?

Virtual Reality Analytics

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Virtual Reality Analytics

Similar to Virtual Reality Analytics (20)

Recently uploaded

Recently uploaded (20)

Virtual Reality Analytics