Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Mobile Virtual Reality - what is that and
how it works?
Alexey Rybakov,
Senior Engineer,
Technical Evangelist at DataArt
a...
Agenda
• 1. AR/MR/MR/VR/MVR?
• 2. Mobile Hardware
• 3. SDK/Tools/Development
AR is for Augmented Reality: What is that?
AR is for Augmented Reality: Devices,
Tools
AR Tools / SDK
• Vuforia
• EasyAR
• Wikitude
• ARToolKit
• Kudan
• Maxst
• Xzi...
AR is for Augmented Reality New Player: Apple ARKit
MR is for Mixed Reality: What is That?
MR is for Mixed Reality Devices: Hololens
• CPU: Intel 32-bit (1GHz)
• OS: Microsoft Holographics
• Memory:
• 2 GB RAM
• 1...
MR is for Mixed Reality Devices: Google Project
Tango
Lenovo Phab Pro
• SoC: Qualcomm® Snapdragon™
652 processor built for...
MR is for Mixed Reality
Tools
Mixed Reality Tools / SDK
• Microsoft Hololens dev programm
• Unity Hololens
• Google Tango ...
MR is for Merged Reality: What is That?
MR is for Merged Reality Devices: Intel Project
Alloy
• vision processor
• 7th core processor
• ultra wide-angle fisheye l...
MR is for Merged Reality Devices: Google Standalone VR
Merged Reality Tools ?
VR is for Virtual Reality: Basic Graphics Characteristics
• FOV ( Field of View)
• Refresh rate
• Display Resolution
• PPI...
VR is for Virtual Reality: FOV
VR is for Virtual Reality: Oculus
• FOV: 110x113
• Refresh Rate: 90Hz
• Resolution: 1200x1080
• PPI: 447
• Sensors: Accele...
VR is for Virtual Reality: HTC
Vive
FOV: 94Hx93V
Refresh Rate: 90Hz
Resolution: 1200x1080
PPI: 456PPi
Sensors: Acceleromet...
VR is for Virtual Reality: PS VR
FOV: 100
Refresh Rate: 90/120Hz
Resolution: 960x1080
Sensors: Accelerometer,
gyroscope, m...
VR is for Virtual Reality: Oculus Screen vs HTC Vive
VR is for Virtual Reality: PSVR Screen
Mobile VR - ?
Mobile VR - ?
Mobile VR - ?
Mobile VR - ?
Google cardboards world
FOV: 90-120
Refresh Rate: depends on device
Resolution: depends on phone
Sensors: Accelerometer,
g...
Google cardboards world
MVR: Google Cardboard Setup
VR Render
VR Render
VR Render: Lens correction data
VR Render: Lens correction data
VR Render: Lens distortion data
VR Render
Mobile VR - Controls
MVR is: Google Daydream View
FOV: 101
Refresh Rate: 60
Resolution:250x1440 /
FullHD (Both)
Sensors: Accelerometer,
gyrosco...
Daydream
Google Pixel / XL
Moto Z
Mate 9 Pro
ZTE Axon 7
Daydream: Coming Soon
Daydream: Controller
Google Daydream Tools: Unreal ( Branch )
Google Daydream Tools: Unity
Google Daydream
MVR is: Samsung Gear VR powered by Oculus Rift
FOV: 90-101
Refresh Rate: 50 - 60
Resolution: 2500x1440 (Both)
Sensors: Acc...
MVR is: Samsung Gear VR for Note
FOV: 101
Refresh Rate: depends on
device
Resolution: depends on phone
Sensors: Accelerome...
MVR is: Samsung Gear VR 2017
FOV: 101
Refresh Rate: depends on
device
Resolution: depends on
phone
Sensors: Accelerometer,...
Samsung Gear VR Pre-request
Samsung Gear VR: Controller
3-axis freedom of motion No depth movement
Sensors:Gyro+Accelerometer+Magnetometer,
SamplingRa...
Samsung Gear VR: Sample
Samsung Gear VR: Tools
• Unreal Engine
• Unreal Engine Oculus
Branch
• Unity + Oculus Tools
• Native Android Support
• Sam...
Samsung Gear VR: Unity Integration
Samsung Gear VR: Unity Integration
Samsung Gear VR: Unity Integration
Mobile VR Conclusion: It’s Cool
Mobile VR Conclusion: But
• You need performance!
• Performance on premium mobile is limited by capacity to
dissipate heat...
Q&A ?
Thank you!
al.rybakov@gmail.com
Upcoming SlideShare
Loading in …5
×

Мобильный Virtual Reality - что это такое и как работает / Алексей Рыбаков (DataArt)

172 views

Published on

РИТ++ 2017, AppsConf
Зал Касабланка, 6 июня, 18:00

Тезисы:
http://appsconf.ru/2017/abstracts/2635.html

Поговорим о Virtual/Augment/Mixed/Merged Reality - что это такое и как работает.

Более подробно рассмотрим Mobile VR:
- Samsung Gear VR Powered by Oculus Rift;
- Google DayDream и Cardboard;
и обсудим, как и с помощью какого инструментария можно разрабатывать приложения.

Published in: Engineering
  • Be the first to comment

  • Be the first to like this

Мобильный Virtual Reality - что это такое и как работает / Алексей Рыбаков (DataArt)

  1. 1. Mobile Virtual Reality - what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt alexey.rybakov@dataart.com
  2. 2. Agenda • 1. AR/MR/MR/VR/MVR? • 2. Mobile Hardware • 3. SDK/Tools/Development
  3. 3. AR is for Augmented Reality: What is that?
  4. 4. AR is for Augmented Reality: Devices, Tools AR Tools / SDK • Vuforia • EasyAR • Wikitude • ARToolKit • Kudan • Maxst • Xzimg • NyARToolkit
  5. 5. AR is for Augmented Reality New Player: Apple ARKit
  6. 6. MR is for Mixed Reality: What is That?
  7. 7. MR is for Mixed Reality Devices: Hololens • CPU: Intel 32-bit (1GHz) • OS: Microsoft Holographics • Memory: • 2 GB RAM • 1 GB HPU RAM • Storage: 64 GB (flash memory) • Display: 2.3 megapixel widescreen stereoscopic head- mounted display • Sound: Spatial sound technology
  8. 8. MR is for Mixed Reality Devices: Google Project Tango Lenovo Phab Pro • SoC: Qualcomm® Snapdragon™ 652 processor built for Tango • OS: Android™ 6.0, Marshmallow • Memory: 4 GB RAM memory, 64 GB • Display: 6..4" Quad HD (2560 x 1440) 2K IPS assertive display with 2.5D curved glass
  9. 9. MR is for Mixed Reality Tools Mixed Reality Tools / SDK • Microsoft Hololens dev programm • Unity Hololens • Google Tango SDK ( android / native) • Tango SDK for Unity
  10. 10. MR is for Merged Reality: What is That?
  11. 11. MR is for Merged Reality Devices: Intel Project Alloy • vision processor • 7th core processor • ultra wide-angle fisheye lenses, • 2 RealSense cameras, sensors, and battery.
  12. 12. MR is for Merged Reality Devices: Google Standalone VR
  13. 13. Merged Reality Tools ?
  14. 14. VR is for Virtual Reality: Basic Graphics Characteristics • FOV ( Field of View) • Refresh rate • Display Resolution • PPI ( Pixel per inch) • Lens type • Sensors
  15. 15. VR is for Virtual Reality: FOV
  16. 16. VR is for Virtual Reality: Oculus • FOV: 110x113 • Refresh Rate: 90Hz • Resolution: 1200x1080 • PPI: 447 • Sensors: Accelerometer, gyroscope, magnetometer
  17. 17. VR is for Virtual Reality: HTC Vive FOV: 94Hx93V Refresh Rate: 90Hz Resolution: 1200x1080 PPI: 456PPi Sensors: Accelerometer, gyroscope, magnetometer
  18. 18. VR is for Virtual Reality: PS VR FOV: 100 Refresh Rate: 90/120Hz Resolution: 960x1080 Sensors: Accelerometer, gyroscope, magnetometer
  19. 19. VR is for Virtual Reality: Oculus Screen vs HTC Vive
  20. 20. VR is for Virtual Reality: PSVR Screen
  21. 21. Mobile VR - ?
  22. 22. Mobile VR - ?
  23. 23. Mobile VR - ?
  24. 24. Mobile VR - ?
  25. 25. Google cardboards world FOV: 90-120 Refresh Rate: depends on device Resolution: depends on phone Sensors: Accelerometer, gyroscope, magnetometer Devices: Any Mobile Phone SDK • iOS • Android
  26. 26. Google cardboards world
  27. 27. MVR: Google Cardboard Setup
  28. 28. VR Render
  29. 29. VR Render
  30. 30. VR Render: Lens correction data
  31. 31. VR Render: Lens correction data
  32. 32. VR Render: Lens distortion data
  33. 33. VR Render
  34. 34. Mobile VR - Controls
  35. 35. MVR is: Google Daydream View FOV: 101 Refresh Rate: 60 Resolution:250x1440 / FullHD (Both) Sensors: Accelerometer, gyroscope, magnetometer Joystick SDK • Android
  36. 36. Daydream Google Pixel / XL Moto Z Mate 9 Pro ZTE Axon 7
  37. 37. Daydream: Coming Soon
  38. 38. Daydream: Controller
  39. 39. Google Daydream Tools: Unreal ( Branch )
  40. 40. Google Daydream Tools: Unity
  41. 41. Google Daydream
  42. 42. MVR is: Samsung Gear VR powered by Oculus Rift FOV: 90-101 Refresh Rate: 50 - 60 Resolution: 2500x1440 (Both) Sensors: Accelerometer, gyroscope, magnetometer Touch Panel Devices: Top Samsung Phones SDK • Android
  43. 43. MVR is: Samsung Gear VR for Note FOV: 101 Refresh Rate: depends on device Resolution: depends on phone Sensors: Accelerometer, gyroscope, magnetometer Touch Panel Devices: Samsung Notes SDK • Android
  44. 44. MVR is: Samsung Gear VR 2017 FOV: 101 Refresh Rate: depends on device Resolution: depends on phone Sensors: Accelerometer, gyroscope, magnetometer Joystick SDK • Android
  45. 45. Samsung Gear VR Pre-request
  46. 46. Samsung Gear VR: Controller 3-axis freedom of motion No depth movement Sensors:Gyro+Accelerometer+Magnetometer, SamplingRate @208Hz Indicator: 3-colorLED Battery:2xAAABattery(1000mAh,upto40dayswh en used on average for 2 hours a day) BT: 4.2 Blutooth Low Energy Touchpad/Trigger/Back & Home Keys/Volume Rocker
  47. 47. Samsung Gear VR: Sample
  48. 48. Samsung Gear VR: Tools • Unreal Engine • Unreal Engine Oculus Branch • Unity + Oculus Tools • Native Android Support • Samsung Platfrom SDK • Samsung Avatar SDK
  49. 49. Samsung Gear VR: Unity Integration
  50. 50. Samsung Gear VR: Unity Integration
  51. 51. Samsung Gear VR: Unity Integration
  52. 52. Mobile VR Conclusion: It’s Cool
  53. 53. Mobile VR Conclusion: But • You need performance! • Performance on premium mobile is limited by capacity to dissipate heat • Phones are not getting bigger • Segmentation ( Gear VR vs DayDream vs Cardboard phones)
  54. 54. Q&A ? Thank you! al.rybakov@gmail.com

×