Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Virtual Reality Analytics

4,286 views

Published on

Keynote from the DOAG Conference 2015 on Virtual and Augmented Reality Analytics by Joerg Osarek. What is state of the art end of 2015, what awaits us in 2016 and within the next 3 to 5 years? After 3 years working on virtual reality projects Skilltower institute dares to give some answers and predictions on virtual reality analytics. More information will be available in the dossier "Virtual Reality Analytics" publication date in 2016.

Published in: Data & Analytics

Virtual Reality Analytics

  1. 1. Virtual Reality Analytics Keynote by Joerg Osarek IT-avant-gardist, Business-IT-Architect Skilltower Institute Business Intelligence Stream at the DOAG Conference 2015 November 17th 2015, v1.L Nuremberg, Germany Virtual Reality Analytics Keynote by Joerg Osarek IT-avant-gardist, Business-IT-Architect Skilltower Institute Business Intelligence Stream at the DOAG Conference 2015 November 17th 2015, v1.L Nuremberg, Germany
  2. 2. 2Joerg Osarek © Skilltower Institute, Nov. 2015 Virtual Reality: The power of Immersion VR / MR puts tough guys under a spell unlike any other medium ranging from delight to pure horror Try it yourself after the keynote or visit our VR Meetup in Frankfurt.
  3. 3. 3Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening at VR / MR? - VR is not just headsets! Display Technology  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers
  4. 4. 4Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening at VR / MR? - VR is not just headsets! Display Technology  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap
  5. 5. 5Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening at VR / MR? - VR is not just headsets! Display Technology Recording  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap Google JumpGoogle Jump + Youtube VR+ Youtube VR JauntVR NeoJauntVR Neo Lightfield CamLightfield Cam Lytro ImmergeLytro Immerge
  6. 6. 6Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening at VR / MR? - VR is not just headsets! Display Technology Recording Interacting 2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap Google JumpGoogle Jump + Youtube VR+ Youtube VR JauntVR NeoJauntVR Neo Lightfield CamLightfield Cam LeapMotionLeapMotion Fairy LightsFairy Lights TouchableTouchable HologramHologram VR SculptingVR Sculpting Google SoliGoogle Soli Radar ChipRadar Chip Disney DISHDisney DISH ILM X-LabsILM X-Labs Lytro ImmergeLytro Immerge
  7. 7. 7Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening next?  Voice Mood Analysis (e.g. cogito App)  Brain Wave interfaces (e.g. NeuroSky Neuro Headset)  Nerve Induction? (e.g. direct projection into retina or nerves)  Mark Zuckerberg: „we'll be able to send emotions to each other soon“* * Article at theverge.com from Rich McCormick on June 30, 2015.* http://www.theverge.com/2015/6/30/8873819/mark-zuckerberg-facebook-sending-emotions-soon
  8. 8. 8Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening next? Quelle: Woman and pan: combined of two public domain images from www.pixabay.com  Mark Zuckerberg: „we'll be able to send emotions to each other soon“ … could look like this:
  9. 9. 9Joerg Osarek © Skilltower Institute, Nov. 2015 What is happening next? Quelle: Woman and pan: combined of two public domain images from www.pixabay.com , Quelle: Angry driver: Vladimir Mucibabic/123rf.com #4554701_l  Mark Zuckerberg: „we'll be able to send emotions to each other soon“ … could look like this: LIKE ?
  10. 10. 10Joerg Osarek © Skilltower Institute, Nov. 2015 VR Analytics comes in two flavours a) Visualization of analytics data in VR
  11. 11. 11Joerg Osarek © Skilltower Institute, Nov. 2015 VR Analytics comes in two flavours a) Visualization of analytics data in VR We don't cover this today. b) Analyze VR experiences in your DWH
  12. 12. 12Joerg Osarek © Skilltower Institute, Nov. 2015 Let's Play
  13. 13. 13Joerg Osarek © Skilltower Institute, Nov. 2015 Level 1: Your Mission BUILD ME THE PERFECT VR ANALYTICS PLATFORM. MUHAHAHA...
  14. 14. 14Joerg Osarek © Skilltower Institute, Nov. 2015 Level 2: Make or buy? - Status VR Analytics vendorsLevel 2: Make or buy? - Status VR Analytics vendors  Election.tvElection.tv Engages Kosher Virtual Reality Analytics For Exclusive 2016 USEngages Kosher Virtual Reality Analytics For Exclusive 2016 US Election Tech Polling Partnership (Election Tech Polling Partnership (Kosher.tvKosher.tv, a media ventures company), a media ventures company)  retinadVR.comretinadVR.com (Unity Plugin) → joined(Unity Plugin) → joined rothenbergventures.comrothenbergventures.com (investing in frontier tech startups)(investing in frontier tech startups)  Some BI / DWH experts start to broaden their portfolioSome BI / DWH experts start to broaden their portfolio (like(like its-peopleits-people andand skilltower instituteskilltower institute))  It is quite early for the large BI / DWH software vendors but we should watchIt is quite early for the large BI / DWH software vendors but we should watch trendsetterstrendsetters like:like: IBM, SAP, Qlik, Oracle, SAS, Information Builders,IBM, SAP, Qlik, Oracle, SAS, Information Builders, MicrostrategyMicrostrategy andand challengerschallengers like:like: Microsoft, Tableau, Tibco, Infor,Microsoft, Tableau, Tibco, Infor, BoardBoard and some more.and some more.
  15. 15. 15Joerg Osarek © Skilltower Institute, Nov. 2015 Level 3: Approaches for displaying VR in headsets Hybrid Rendering  Nozon.com Presenz  some light field tech Live 3D in Game engine  (Unity3D, Cryengine Unreal Engine 4, ...). Pre-rendered  YouTube VR or 360°  VR Player apps, ...
  16. 16. 16Joerg Osarek © Skilltower Institute, Nov. 2015 measurement data, e.g.:measurement data, e.g.: Position 5,3,1Position 5,3,1 Rotation 23°left, 18°upRotation 23°left, 18°up Speed of movementSpeed of movement (eye position, parallax)(eye position, parallax) ...... Mapping:Mapping: Position in VRPosition in VR Objects watchedObjects watched InteractionsInteractions …… Merging with otherMerging with other Data WarehouseData Warehouse ContentContent Enriched AnalysisEnriched Analysis determinedetermine meaningmeaning MeasureMeasure AnalyzeAnalyze ←← (Interactive live return path) ←(Interactive live return path) ← Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics?Meta Layer for VR Analytics?
  17. 17. 17Joerg Osarek © Skilltower Institute, Nov. 2015  depends on the particular VR/MR experience.depends on the particular VR/MR experience.  meaning must be mapped manually or...meaning must be mapped manually or...  (soon) can be mapped automatically by autonomous analysis algorithms(soon) can be mapped automatically by autonomous analysis algorithms (Google/Facebook recognize objects, text and speech in images, videos,(Google/Facebook recognize objects, text and speech in images, videos, audio) e.g. Google Translate Augmented Reality or Youtube Transcriptionaudio) e.g. Google Translate Augmented Reality or Youtube Transcription Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics?Meta Layer for VR Analytics?
  18. 18. 18Joerg Osarek © Skilltower Institute, Nov. 2015 Level 5: add more data sources like heart rate, voice, ... SmartWatch:SmartWatch: heart rateheart rate voice and moodvoice and mood analysisanalysis facial expressionfacial expression recognitionrecognition NLP* eyeNLP* eye movementsmovements *NLP = Neuro Linguistic Programming:*NLP = Neuro Linguistic Programming: an approach to communication, personal development, and psychotherapyan approach to communication, personal development, and psychotherapy created by Richard Bandler and John Grinder in California, United States in the 1970s.created by Richard Bandler and John Grinder in California, United States in the 1970s.
  19. 19. 19Joerg Osarek © Skilltower Institute, Nov. 2015 Level 5: facial expression analysis Science Fiction? Only for Headsets? predicted in 2012 at DOAG for 2017,predicted in 2012 at DOAG for 2017, already reality todayalready reality today
  20. 20. 20Joerg Osarek © Skilltower Institute, Nov. 2015 Level 5: facial expression analysis Science Fiction? Only for Headsets? www.affectiva.comwww.affectiva.com The video, that watches you.The video, that watches you. analysis of facial expressions and your moodanalysis of facial expressions and your mood with a simple webcam → Emotion Database with APIwith a simple webcam → Emotion Database with API
  21. 21. 21Joerg Osarek © Skilltower Institute, Nov. 2015 Level 5: facial expression analysis Science Fiction? Only for Headsets? Yesterday:Yesterday: What did the user do while interacting?What did the user do while interacting? Today:Today: What is the user doing while interacting?What is the user doing while interacting? Tomorrow:Tomorrow: What is the user going to doWhat is the user going to do while interacting?while interacting?
  22. 22. 22Joerg Osarek © Skilltower Institute, Nov. 2015 Mission accomplishedMission accomplished  measurement data → semantic layer  combination with additional data (heart rate, facial expressions, eye movement)  combination with classic data warehouse data streams  enables (NLP) conclusions close to thought reading and prediction of behaviour YES. YES. MUHAHAHA...
  23. 23. 23Joerg Osarek © Skilltower Institute, Nov. 2015 Level Up: Entering the USEMIR era  Q-GRINS technologies introduce artificial intelligence (strong AI) and hyper intelligence into our world. Corporations, organizations, countries, AIs and HIs will be able to read our thoughts.  Eventually we are confronted with U.SE.MIRU.SE.MIR – UUbiquitiousbiquitious SESEnsiblensible MIMIxedxedRRealityeality QuantumQuantum TechTech GeneticsGenetics RoboticsRobotics ITIT Nano-TechNano-Tech Space-TechSpace-Tech
  24. 24. 24Joerg Osarek © Skilltower Institute, Nov. 2015 I have an idea. Let's provide them with technology to read our thougts. Quelle: Wikimedia.org – Erstellt 1590 – Public Domain Who ought to know what about us? - a comparable encounterWho ought to know what about us? - a comparable encounter
  25. 25. Joerg Osarek © Skilltower Institute, Nov. 2015 25 With great power comes great responsibility (Stan Lee)With great power comes great responsibility (Stan Lee)  John F.Kennedy mastered this burden facing the cuba crisis and savedJohn F.Kennedy mastered this burden facing the cuba crisis and saved us from a nuclear desaster.us from a nuclear desaster.  What is our burden / fear at the eve of VR analytics, of machinesWhat is our burden / fear at the eve of VR analytics, of machines capable of reading thoughts and of the technological singularity?capable of reading thoughts and of the technological singularity?
  26. 26. 26Joerg Osarek © Skilltower Institute, Nov. 2015 What choices do we have? back to the caves?back to the caves? prepare to be terminated?prepare to be terminated?
  27. 27. 27Joerg Osarek © Skilltower Institute, Nov. 2015 What choices do we have?  Wrong question!Wrong question! Why do we fear a Terminator-Scenario?Why do we fear a Terminator-Scenario?  Is there a third choice?Is there a third choice?  Why don't we consider ourselves as self-confident honourable partners?Why don't we consider ourselves as self-confident honourable partners?  Do we want to work on ourselves and stop being the trickster?Do we want to work on ourselves and stop being the trickster?
  28. 28. 28Joerg Osarek © Skilltower Institute, Nov. 2015 The third choice: We can qualify for the 22nd century by cultivating chivalry and wisdom. Q22=C+W humbleness, honour, kindness, confidence, politeness, courage and bravery, clemency, moderate behaviour , continuity, loyalty, dignity, discipline and decency
  29. 29. 29Joerg Osarek © Skilltower Institute, Nov. 2015 The third choice: We can qualify for the 22nd century by cultivating chivalry and wisdom. Q22=C+W self confidence by acting honourable working together as civilization to boost our development EARNING BONUS POINTS:EARNING BONUS POINTS: appearing as self confident and honourable examples and partners
  30. 30. 30Joerg Osarek © Skilltower Institute, Nov. 2015 LEVEL UP!LEVEL UP! INSERT COINSINSERT COINS TO CONTINUETO CONTINUE The rest is up to you now. Make your choice and shape our future.
  31. 31. Joerg Osarek © Skilltower Institute, Nov. 2015 31 Contact and further information on VR Analytics Dossier Virtual Reality Analytics publication date: 2016 Skilltower Institute Joerg Osarek Founder and CEO Triftstr. 30 D-61350 Bad Homburg Germany mailto:joerg.osarek@skilltower.com Tel.: +49(0)151-23 0 24 333 www.skilltower.com
  32. 32. Joerg Osarek © Skilltower Institute, Nov. 2015 32 background information: Joerg Osarek  ManagementManagement  IT-avant-gardeIT-avant-garde  Virtualization (VMware)Virtualization (VMware)  Oracle, LinuxOracle, Linux  Virtual Reality AnalyticsVirtual Reality Analytics  Cinematic VRCinematic VR
  33. 33. 33Joerg Osarek © Skilltower Institute, Nov. 2015 Reports from the future – my passion ever since 1989: Hewlett Packard Computer viruses – digital threat or scare tactics?
  34. 34. 34Joerg Osarek © Skilltower Institute, Nov. 2015 Reports from the future – my passion ever since 1998: DOAG: VRML – The future of the internet Many thanks to Wolfgang Taschner for his archived copy
  35. 35. 35Joerg Osarek © Skilltower Institute, Nov. 2015 Reports from the future – my passion ever since always some Years Ahead of Mainstream (YAM)  1989: HP: Computer viruses: 10 YAM  1998: DOAG: VRML – The future of the internet 9 YAM (2ndLife 2007)  2007: DOAG: How does SOA influence Business Intelligence?: 3 YAM  2010: DOAG: Cloud Computing and the Technology Monster: 2 YAM  2011: DOAG: The Organic Computing age 9 YAM?  2012: DOAG: SoMoLo (Social, Mobile, Local) / Big Data 3 YAM  2015: DOAG: Virtual Reality Analytics 3-5 YAM?

×