I was invited to teach a workshop on 360 and VR180 video techniques and technology; explaining the equipment and demonstrating how it is used to better AR/VR applications in health, science, and medicine. The 3rd Annual VR and Healthcare Symposium took place in Tucson, Arizona, March 7-8, 2019, it's the most extensive global gathering exploring the research, applications, and opportunities in virtual, augmented and mixed reality in healthcare.

1. In Healthcare
VR Video

2. Sony
Ricoh
Pentax
HumanEyes
I m a g i n g I n d u s t r y
Jim Malcolm
Leader in Visual Innovation
C h a n g i n g C o n s u m e r B e h a v i o r

3. Visual Interaction
How we’re Working now

4. Creators & Consumers of Interactive Media
VR Applications to Professional CreatorsTraditional Creators
Just use phone/tablet 360 video 180VR/360VR 360VR++
Media for some applications consumed on mobile Media consumed on
mobile headsets
Media consumed on
all-in-one headsets
Media consumed on
tethered headsets at
home or in VR arcades

5. Creators & Consumers of Interactive Media
VR Applications to Professional CreatorsTraditional Creators
Just use phone/tablet 360 video 180VR/360VR 360VR++
Media for some applications consumed on mobile Media consumed on
mobile headsets
Media consumed on
all-in-one headsets
Media consumed on
tethered headsets at
home or in VR arcades
Screen
Experience
VR
Immersive
Experience
360
Experience

6. Virtual Reality
Near Field Screen

7. FORMATS
VR VIDEO. | 360 | VR180 | 3D180
VR Video (3D)
Google VR180
Facebook 3D180
Spherical 360 (2D)
Ambisonic
3D Audio
Unity
Unreal
.

8. File
Formats
T W O P R I M A R Y F O R M A T S

9. Public Service Announcement

10. Capture
C a m e r a T e c h n o l o g i e s
Spherical 360 VR 180VR Video

11. Typically Use Two Cameras
S i n g l e P o i n t o f v i e w
360

12. Huawei EnVizion 360
2K/30fps, 13MP (5K)
$178-$110
Compatible with select HUAWEI Mate &
P series, Samsung Galaxy series, and
other USB Type-C port smartphones.
Insta360 Air
2.5K/30fps, 4.5MP (3K)
$129-$109
2D 360, 3D 180 clip-on cameras or 360 embedded camera
4K/30fps – released in 2017.
Giroptic iO
2K/30fps, 6MP (4K)
$199-$99.95
Company Shut down
Protruly Darling smartphone with
built-in 360 camera
Protruly’s camera component supplier will be
adding their 360 camera module to other
smartphones that will be reportedly more
compact than ProTruly’s smartphone
4K video
$500-$600
Essential Smartphone + Essential
360 camera
launched by Android co-founder Andy Rubin's
(9/2017)
4K/30fps video (UHD)
2/2018 Essential Phone was a flop
$199 (phone $499)
Teleport VR
3D 180VR
$130-$85 indiegogo
ION360 U- for Samsung
Galaxy, iphone 7/Plus
4K/30fps video 7.4MP, live
streaming
$299-$80??
Failed to launch
Elephone REXSO
1K/30fps
$77
Discontinued
PanoClip – Arashi Vision
$40-$50 (for iphone) 6/2018

13. Theta V by Ricoh
4K/30fps, 14MP, in-camera stitching
$395
Insta360 One
4K/30fps, 24MP (60fps, 120fps)
$299
GoPro Fusion
5.2K/30 fps, 18MP, 3K/60
waterproof
$699
Garmin VRIB 360
5.7/30fps, 15MP, in-camera
stitching, waterproof
$799
KODAK PIXPR0 Orbit360
4K/30fps
$499.99 ($449 for 235 FOV, one lens)
GoPro Omni
8K/30fps, based on 6 GoPros
$4999-$2499
Samsung Gear 360
4K/24fps, 8.4MP
$104-$120
Yi Technology 360 VR
5.7K/30fps, 16MP, 4K/30fps
in-camera stitching
$399
Xiaomi MiJia 360
3.5K/30fps, 2.3/60fps, 18MP,
IP67
$299
Detu Twin 360
3K/30 fps, in-camera stitching
$98
Orah 4i Live
4K/30fps, 16MP, in-
camera stitching, post
software
$4999-$3000
2D 360 (Point & Shoot) Camera Market Players
Rylo
4K/30 fps, 6K photo
$499

14. Theta
4K/30fps, 14MP
$395
One
4K/30fps,24MP
$299
GoPro Fusion
5.2K/30fps, 18MP
waterproof
$699
Garmin VRIB
5.7/30fps, 15MP
$799
Samsung
4K/24fps,8.4MP
$104-$120
Yi
5.7K/30fps,
16MP
$399
Xiaomi MiJia
3.5K/30fps, 2.3/60fps,
18MP, IP67
$299
360fly 4K
2.8K/30fps,
16MP, 240 FOV
$499
KODAK
4K/30fps
$499.99
Nano
4K/30fps,20MP
$239
Detu Twin
3K/30fps,
$98
Rylo
4K/30fps
$499
6K
5K
4K
3K
2K
1K
$100 $200 $300 $400 $500 $600 $700 $800
Leading 2D 360 (Point & Shoot) Camera Market Players
4K/30fps – Standard in 2017
5.7K/30fps – Standard of 2018
Action Cameras
Consumer Cameras
VR Enthusiasts/Prosumer
Cameras
Vuze XR
5.7K/30fps,24MP
$499 – 9/2018

15. Monoscopic capture
and playback results
when only one single
point of view is
captured while
recording content.
N O T S O G O O D F O R V R H E A D S E T S

16. Typically Six or More Cameras
m u l t i p l e p o i n t s o f v i e w
VR Video

17. Parallax
P R E S E N T A T I O N 2 0 1 8
Parallax is a displacement or
difference in the apparent
position of an object viewed
along two different lines of sight
and is measured by the angle or
semi-angle of inclination
between those two lines. Due to
foreshortening, nearby objects
show a larger parallax than
farther objects when observed
from different positions, so
parallax can be used to
determine distances.

18. Parallax
P R E S E N T A T I O N 2 0 1 8
Parallax is a displacement or
difference in the apparent
position of an object viewed
along two different lines of sight
and is measured by the angle or
semi-angle of inclination
between those two lines. Due to
foreshortening, nearby objects
show a larger parallax than
farther objects when observed
from different positions, so
parallax can be used to
determine distances.

19. Jaunt VR
services for VR
$95,000
Facebook Surround 360
$15-000 - $30,000Z Cam S1 Pro
6K/30fps
$8,880
Kandao Obsidian S & R
8K 30fps, 6K/60fps, 4K/120fps
High dynamic range
$6,999
Samsung Round
VR Video 17 Camera
4K/30fps, IP67
$9,500
Yi Halo
Based on Yi cameras
8K/30fps, 6K/60fps
$17,000
Insta360 Pro
8K Camera Professional
$3,500
3D 360 Camera Market Players
Vuze+ by Humaneyes
4K/30fps, 16MB photo
$1195
Detu MAX
8K/30fps, 12K photo with depth
and AI
$3599 (end of 2018)
Insta360 Titan
10K/30 or 60fps, 5K/120fps
$12000 (summer 2018)
Z CAM V1 Pro
8K/30 mono, 7K/30 stereo,
$3800
Kandao Obsidian GO
4K 30fps, 16MP,
High dynamic range
$2,499

20. 6K
4K
$3000 $4000 $10000
3D 360 Camera Market Players
Z Cam S1 Pro
6K/30fps
$8,880
Kandao Obsidian
8K 30fps, 6K/60fps,
4K/120fps
High dynamic range
$6,999
Samsung Round
VR Video 17 Camera
4K/30fps, IP67
$9,500
Insta360 Pro
8K Camera
Professional
$3,500
Vuze+
4K/30fps,16MB
$999
12K
8K
$9000$8000$7000$6000$5000$2000$1000
Detu MAX
8K/30fps,
with depth and AI
$ 3599
Insta360 Titan
10K/30 or 60fps,
5K/120fps
$12000
Kandao Obsidian GO
4K 30fps, 16MP,
High dynamic range
$2,499
4K/30fps – Standard in 2017, 8K/30fps – Standard of 2018

21. Two Primary
360 VR Video
Camera Systems
C a m e r a D E S I G N
CAM 5
L/R
CAM
2
L/R
CAM3
L/R
CAM7
L/R
CAM
6
L/R
CAM 1
L/R
CAM
8L/R
CAM
4L/R
CAM 5
L/R
CAM 2
L/R
CAM3
L/R
CAM7
L/R
CAM6
L/R
CAM 1
L/R
CAM8
L/R
CAM4
L/R

22. Circular System
Computational 3D
C a m e r a D E S I G N
CAM 5
L/R
CAM
2
L/R
CAM3
L/R
CAM7
L/R
CAM
6
L/R
CAM 1
L/R
CAM
8L/R
CAM
4L/R

23. Parallel Optical Paths
“True” 3D Stereo
C a m e r a D E S I G N
CAM 5
L/R
CAM 2
L/R
CAM3
L/R
CAM7
L/R
CAM6
L/R
CAM 1
L/R
CAM8
L/R
CAM4
L/R

24. Typically Two Camera Systems
T W O P A R A L L E L P O I N T S O F V E W
VR180

25. Z Cam’s K1 Pro
6K/30fps, 4K/60fps
$2,995 pre-order
Google 180VR certified
Lucid cam
4K 3D 180VR
$499
Lenovo Mirage VR180
4K/30fps,
$299 (5/2018)
Google 180VR certified
QooCam (Kandao)
4K/30fps, 2.8/60fps, 2K/120fps,
4K photo, 4K live streaming
$399 (pre-order $369))
Yi Horizon VR180
5.7K/30fps, 5.7K photo, 4K
live streaming
$399? (summer 2018)
Google 180VR certified
Kodak
4K/30fps,
$500 - ???
3D 180 Camera payers and 2D 360/3D 180 cameras
SID by Weeview
3K/30fps, 32MP photo, live
streaming
$269
Vuze XR
5.7K/30fps, 4K/60fps, 24MP
$499 – 9/2018

26. 6K
5K
4K
3K
2K
1K
$100 $200 $300 $400 $500 $600 $700 $800
Z Cam’s K1 Pro
6K/30fps, 4K/60fps
$2,995
Lucid cam
4K 3D 180VR
$499
Yi Horizon
5.7K/30fps,20MP
$399
SID
3K/30fps, 32MP
$269
Lenovo Mirage
4K/30fps,
$299
3D 180 Camera payers and 2D 360/3D 180 cameras
QooCam (Kandao)
4k/30fps
$369-$399?
(May, 2018)
Vuze XR
5.7K/30fps, 4K/60fps,
24MP
$499 – 9/2018

27. VR 180
Parallel Optical
Paths
“True” 3D Stereo
C a m e r a D E S I G N
CAM 2
L/R
CAM 1
L/R

28. Applications • Training & Simulation
• Empathy
• Anxiety and Panic
• Pain Management
• Stress Disorders
• Meditation
• Relaxation
• Sensory Stimulation
• instigate social interactions
• Video Modeling
• Environmental Exposure
• De-escalation
• Patient Training

29. THE SHOOT

30. Story…
The New
Quality
S t o r y b o a r d

31. Blocking &
Branch Narrative
S t o r y b o a r d
Action
Camera
Personal Space
3D “Playground”
Background

32. < 2M “personal space”
•Intimate
•Within reach
•Impactful visuals
> 15MM ”environment”
•Background
2M – 15M = 3D “Playground”
•Action
•Dialog
•Suspense
•Discovery
0
2
4
6
8
10
12
1 3 6 9 12 15 20 21 22 23
3D Effect
Distance in Meters
Working with
Distance…

33. Note: The Vuze VR camera is much
more efficient in the horizontal plane
Microphones
Four MEMS 48 MHz non-compressed phones
Audio Format
Four non-compressed 16bit PCM
Add Zoom
Visual elements tell the story
• Sound is equally important in virtual reality
• Creates the emotional impact
• Adds emotion
1st order Ambisonics
Ambisonics is a full-sphere surround sound technique: in addition
to the horizontal plane, it covers sound sources above and below
the listener
3D Audio
Ambisonics

34. B r i n g i n g i t t o g e t h e r
Stitch
Manufacturer &
Third party solutions

35. B r i n g i n g i t t o g e t h e r
Post
Choose wisely

37. VR View

38. Color

39. Titles

40. Combine
2D & 3D

41. 3D Audio

42. Thank You
Linkedin.com/in/jimmalcolm
@jim_malcolm
Facebook.com/reflection360
jim@humaneyes.com