VR/AR Meetup Frankfurt #1 cinematic VR Analytics

1. VR Meetup Frankfurt #1 Sat. 23rd of January 2016 Chuck Ian Gordon VR Meetup Frankfurt #1 Sat. 23rd of January 2016 Chuck Ian Gordon

2. 3futurez holodeck musical - © 2014 by GordonsArca.de - Blender Conference Oct.2014, Amsterdam 2 how to wake the superhero inside youhow to wake the superhero inside you "It seems that I've been living two"It seems that I've been living two lifes.lifes. One life, I am an IT consultantOne life, I am an IT consultant for a respectable softwarefor a respectable software company.company. I have a social security number,I have a social security number, pay my taxes and I ...pay my taxes and I ... ... am sent by my wife to carry... am sent by my wife to carry out the garbage.out the garbage. The other life is lived in myThe other life is lived in my Gordon Cave where I go by theGordon Cave where I go by the alias Chuck Ian Gordon trying toalias Chuck Ian Gordon trying to help mankind qualify for the 22ndhelp mankind qualify for the 22nd century. "century. "

3. background check:background check:  Science Fiction AuthorScience Fiction Author  Cinematic VRCinematic VR  Virtual Reality AnalyticsVirtual Reality Analytics  Immersive Technology Alliance (ITA3D.com)Immersive Technology Alliance (ITA3D.com)  ManagementManagement  IT-avant-gardeIT-avant-garde  Virtualization (VMware)Virtualization (VMware)  Oracle, LinuxOracle, Linux

4. Virtual Reality Analytics Keynote by Joerg Osarek IT-avant-gardist, Business-IT-Architect Skilltower Institute Business Intelligence Stream at the DOAG Conference 2015 November 17th 2015, v1.L Nuremberg, Germany Virtual Reality Analytics Keynote by Joerg Osarek IT-avant-gardist, Business-IT-Architect Skilltower Institute Business Intelligence Stream at the DOAG Conference 2015 November 17th 2015, v1.L Nuremberg, Germany

5. 5© Skilltower Institute, 2016 Virtual Reality: The power of Immersion VR / MR puts tough guys under a spell unlike any other medium ranging from delight to pure horror Try it yourself after the keynote or visit our VR Meetup in Frankfurt.

6. 6© Skilltower Institute, 2016 What is happening at VR / MR? - VR is not just headsets! Display Technology  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers

7. 7© Skilltower Institute, 2016 What is happening at VR / MR? - VR is not just headsets! Display Technology  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap

8. 8© Skilltower Institute, 2016 What is happening at VR / MR? - VR is not just headsets! Display Technology Recording  2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap Google JumpGoogle Jump + Youtube VR+ Youtube VR JauntVR NeoJauntVR Neo Lightfield CamLightfield Cam Lytro ImmergeLytro Immerge

9. 9© Skilltower Institute, 2016 What is happening at VR / MR? - VR is not just headsets! Display Technology Recording Interacting 2015: Samsung Gear, Oculus DK2,2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++  2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer Version Playstation VR (Morpheus)Playstation VR (Morpheus) HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking) Microsoft Hololens for DevelopersMicrosoft Hololens for Developers FulldomesFulldomes Leia HolodisplayLeia Holodisplay Magic LeapMagic Leap Google JumpGoogle Jump + Youtube VR+ Youtube VR JauntVR NeoJauntVR Neo Lightfield CamLightfield Cam LeapMotionLeapMotion Fairy LightsFairy Lights TouchableTouchable HologramHologram VR SculptingVR Sculpting Google SoliGoogle Soli Radar ChipRadar Chip Disney DISHDisney DISH ILM X-LabsILM X-Labs Lytro ImmergeLytro Immerge

10. 10© Skilltower Institute, 2016 What is happening next? * Article at theverge.com from Rich McCormick on June 30, 2015.* http://www.theverge.com/2015/6/30/8873819/mark-zuckerberg-facebook-sending-emotions-soon  Mark Zuckerberg: „we'll be able to send emotions to each other soon“ … could look like this:

11. 11© Skilltower Institute, 2016 What is happening next? Quelle: Woman and pan: combined of two public domain images from www.pixabay.com  Mark Zuckerberg: „we'll be able to send emotions to each other soon“ … could look like this:

12. 12© Skilltower Institute, 2016 What is happening next? Quelle: Woman and pan: combined of two public domain images from www.pixabay.com , Quelle: Angry driver: Vladimir Mucibabic/123rf.com #4554701_l  Mark Zuckerberg: „we'll be able to send emotions to each other soon“ … could look like this: LIKE ?

13. 13© Skilltower Institute, 2016 VR Analytics comes in two flavours a) Visualization of analytics data in VR

14. 14© Skilltower Institute, 2016 VR Analytics comes in two flavours a) Visualization of analytics data in VR We don't cover this today. b) Analyze VR experiences in your DWH

15. 15© Skilltower Institute, 2016 Let's Play

16. 16© Skilltower Institute, 2016 Level 1: Your Mission BUILD ME THE PERFECT VR ANALYTICS PLATFORM. MUHAHAHA...

17. 17© Skilltower Institute, 2016 Level 3: Approaches for displaying VR in headsets Hybrid Rendering  Nozon.com Presenz  some light field tech Live 3D in Game engine  (Unity3D, Cryengine Unreal Engine 4, ...). Pre-rendered  YouTube VR or 360°  VR Player apps, ...

18. 18© Skilltower Institute, 2016 measurement data, e.g.:measurement data, e.g.: Position 5,3,1Position 5,3,1 Rotation 23°left, 18°upRotation 23°left, 18°up Speed of movementSpeed of movement (eye position, parallax)(eye position, parallax) ...... Mapping:Mapping: Position in VRPosition in VR Objects watchedObjects watched InteractionsInteractions …… Merging with otherMerging with other Data WarehouseData Warehouse ContentContent Enriched AnalysisEnriched Analysis determinedetermine meaningmeaning MeasureMeasure AnalyzeAnalyze ←← (Interactive live return path) ←(Interactive live return path) ← Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics?Meta Layer for VR Analytics?

19. 19© Skilltower Institute, 2016 Level 5: add more data sources like heart rate, voice, ... SmartWatch:SmartWatch: heart rateheart rate voice and moodvoice and mood analysisanalysis facial expressionfacial expression recognitionrecognition NLP* eyeNLP* eye movementsmovements *NLP = Neuro Linguistic Programming:*NLP = Neuro Linguistic Programming: an approach to communication, personal development, and psychotherapyan approach to communication, personal development, and psychotherapy created by Richard Bandler and John Grinder in California, United States in the 1970s.created by Richard Bandler and John Grinder in California, United States in the 1970s.

20. 20© Skilltower Institute, 2016 Level 5: facial expression analysis Science Fiction? Only for Headsets? www.affectiva.comwww.affectiva.com The video, that watches you.The video, that watches you. analysis of facial expressions and your moodanalysis of facial expressions and your mood with a simple webcam → Emotion Database with APIwith a simple webcam → Emotion Database with API

21. 21© Skilltower Institute, 2016 Mission accomplishedMission accomplished  measurement data → semantic layer  combination with additional data (heart rate, facial expressions, eye movement)  combination with classic data warehouse data streams  enables (NLP) conclusions close to thought reading and prediction of behaviour YES. YES. MUHAHAHA...

22. 22© Skilltower Institute, 2016 Level Up: Entering the USEMIR era  Q-GRINS technologies introduce artificial intelligence (strong AI) and hyper intelligence into our world. Corporations, organizations, countries, AIs and HIs will be able to read our thoughts.  Eventually we are confronted with U.SE.MIRU.SE.MIR – UUbiquitiousbiquitious SESEnsiblensible MIMIxedxedRRealityeality QuantumQuantum TechTech GeneticsGenetics RoboticsRobotics ITIT Nano-TechNano-Tech Space-TechSpace-Tech

23. 23© Skilltower Institute, 2016 I have an idea. Let's provide them with technology to read our thougts. Quelle: Wikimedia.org – Erstellt 1590 – Public Domain Who ought to know what about us? - a comparable encounterWho ought to know what about us? - a comparable encounter

24. 24© Skilltower Institute, 2016 LEVEL UP!LEVEL UP! INSERT COINSINSERT COINS TO CONTINUETO CONTINUE With great power comes great responsibility (Stan Lee) It is up to you now. Make your choice and shape our future.

31. Insights into cinematic VR - © 2015 by www.GordonsArca.de 31 I want to make the greatestI want to make the greatest VR movie of all times.VR movie of all times. Please fund my project.Please fund my project. Nobody did before.Nobody did before. Very risky to flop.Very risky to flop. ROI guarantee?!ROI guarantee?!

32. Insights into cinematic VR - © 2015 by www.GordonsArca.de 32 - screen version + VR version- screen version + VR version = 1.5 x shooting/work/costs= 1.5 x shooting/work/costs - budget splitting ratios change- budget splitting ratios change - VR analytics revenue stream- VR analytics revenue stream - crowd funding enrichment- crowd funding enrichment (build fan base first)(build fan base first) ...sounds...sounds reasonable...reasonable... ...Deal!...Deal!

34. Insights into cinematic VR - © 2015 by www.GordonsArca.de 34 Story check: story is: great, important, VR-responsible. Movie: good, VR: good recommended reading (not VR):recommended reading (not VR): Christopher Vogler: The writer's journeyChristopher Vogler: The writer's journey

35. Insights into cinematic VR - © 2015 by www.GordonsArca.de 35  VR is not just headsetsVR is not just headsets  Tech+standards evolveTech+standards evolve  focus on intermediatefocus on intermediate resultsresults recommended reading (standard pipeline, not VR):recommended reading (standard pipeline, not VR): Renee Dunlop: Production Pipeline Fundamentals for Film and GamesRenee Dunlop: Production Pipeline Fundamentals for Film and Games

37. Insights into cinematic VR - © 2015 by www.GordonsArca.de 37 - Hide the crew physically or- Hide the crew physically or - hide them digitally- hide them digitally (track, match, blend)(track, match, blend) - or create many things- or create many things completely in 3Dcompletely in 3D (actor scanning, rigging,(actor scanning, rigging, mocap/animating)mocap/animating) - Tip: use VR for preproduction- Tip: use VR for preproduction recommended reading (not VR):recommended reading (not VR): Steve Katz: Film Directing Shot by ShotSteve Katz: Film Directing Shot by Shot

38. Insights into cinematic VR - © 2015 by www.GordonsArca.de 38 Post ProductionPost Production  User testing/VR Analytics (unpredictable behaviour)User testing/VR Analytics (unpredictable behaviour)  spatial sound, air, temperature, ...spatial sound, air, temperature, ...  (No) Avatar and Frames of reference (cockpits...)(No) Avatar and Frames of reference (cockpits...)  moving cam, horizon, zooming, panning, trackingmoving cam, horizon, zooming, panning, tracking  guiding the eye, cutting in VR, behind tree trunk, ...guiding the eye, cutting in VR, behind tree trunk, ...  VR uncanny valley effectVR uncanny valley effect

40. Insights into cinematic VR - © 2015 by www.GordonsArca.de 40 YOU WIN!YOU WIN! keep in mind...keep in mind... standards are necessary andstandards are necessary and evolve fast.evolve fast. meanwhile focus onmeanwhile focus on intermediate results to stayintermediate results to stay open and flexible.open and flexible. VR as part of completely newVR as part of completely new mass market technology stackmass market technology stack gives usgives us GREAT POWERGREAT POWER andand GREAT RESPONSIBILITYGREAT RESPONSIBILITY..

41. Insights into cinematic VR - © 2015 by www.GordonsArca.de 41 Gordon's Arcade:Gordon's Arcade: we create amazing science fiction VR MOVIES.we create amazing science fiction VR MOVIES. currently working on:currently working on: Gordon's ArcadeGordon's Arcade VR MVR Movieovie PProducersroducers ClubClub  Early Insights and TrainingEarly Insights and Training  Producing VR ShortsProducing VR Shorts  Test and enhance the formulaTest and enhance the formula Want to be part of it? Write toWant to be part of it? Write to thethe book:book: www.cinematic-vr-formula.comwww.cinematic-vr-formula.com

42. Insights into cinematic VR - © 2015 by www.GordonsArca.de 42 www.GordonsArca.de – Triftstr. 30, 61350 Bad Homburg, Germany – www.skilltower.comwww.GordonsArca.de – Triftstr. 30, 61350 Bad Homburg, Germany – www.skilltower.com Your IT business scoutYour IT business scout for game changing technologiesfor game changing technologies We create amazingWe create amazing science fiction VR moviesscience fiction VR movies

43. Insights into cinematic VR - © 2015 by www.GordonsArca.de 43 www.GordonsArca.dewww.GordonsArca.de andand www.3futurez.comwww.3futurez.com andand www.GameW0rldz.comwww.GameW0rldz.com 3futurez3futurezTMTM , GameW0rldz, GameW0rldzTMTM and Gordon's Arcadeand Gordon's ArcadeTMTM and their logos are trademarks of Goand their logos are trademarks of Gordon's Arcaderdon's Arcade ;; Titelschutz accord. to Titelschutzanzeiger 03.2012Titelschutz accord. to Titelschutzanzeiger 03.2012 Story:Story: © by Chuck Ian Gordon, Gordon's Arcade© by Chuck Ian Gordon, Gordon's Arcade 3D modeling:3D modeling: Fabian Schempp, Chuck Ian Gordon, David McDermottFabian Schempp, Chuck Ian Gordon, David McDermott Images:Images: All postprocessing and all unmentioned work except public domain: © Chuck Ian GordonAll postprocessing and all unmentioned work except public domain: © Chuck Ian Gordon Title image (Natasha Angel with 3 planets): © Chuck Ian Gordon,Title image (Natasha Angel with 3 planets): © Chuck Ian Gordon, © Tobias Roetsch - www.gtgraphics.de, © #23733237 CHEN, PAO-CHIN – fotolia.com.© Tobias Roetsch - www.gtgraphics.de, © #23733237 CHEN, PAO-CHIN – fotolia.com. Main Font proudly purchased from Kevin Christopher:Main Font proudly purchased from Kevin Christopher: http://www.kcfonts.com/2011/12/my-girl-is-retro-font.htmlhttp://www.kcfonts.com/2011/12/my-girl-is-retro-font.html All other trademarks used and not mentioned belong to their trademark holdersAll other trademarks used and not mentioned belong to their trademark holders creditscredits