The document outlines different frameworks for 3DoF+ and 6DoF virtual reality systems. It discusses using single or multiple 360 degree images, 180 degree images, or spherical lightfield cameras as input. It also describes evaluating virtual views rendered from these inputs by comparing to single or multiple reference 360 degree or 180 degree views. The goal is to support increasingly immersive experiences from 3DoF+ to 6DoF by using different camera configurations and reference views for evaluation.

1. Overview of the framework
for 3DoF+ and 6DoF
Krzysztof Wegner
Mucha sp. z o.o.
Poland

2. 2
Output – single 360 view
360o
Classic VR systems needs one 360 image (video) of a real of
virtual environment which can be displayed directly on HDM

3. 3
Input – single 360 camera
360o
Input to the system can be single 360 view captured by
omnidirectional (360) camera or rendered form 3D model (game)

4. 4
Input – multiple 360 images (videos)
360o
360o
360o
For more immersive system like virtual tours input to the system can be multiple
360 view captured from different location is space.

5. 5
Input – single 180 image
180o
Input to the system can be single view less than 360 degree, captured from
single location, not covering entire sphere.

6. 6
Input – multiple 180 images
180o
180o
180o
Input to the system can be multiple view less than 360 degree, captured
from multiple location not covering entire sphere

7. 7
Input – multiple 180 images
180o
180
o
180
o
180o
Input to the system can be
multiple view less than 360
degree, captured from multiple
location covering entire sphere
Spherical LightField Camera

8. 8
Evaluation – single 360 camera
360o
1 – input 360 view
4 – reference 360 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
360o
360o
360o
360o
360o
Compare virtual view
rendered from input 360
view at location of
reference 360 view

9. 9
Evaluation – multiple 360 camera
360o
3 – input 360 views
4 – reference 360 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
360o
360o
360o
360o
360o
Compare virtual view
rendered from input 360
view at location of
reference 360 view
360o
360o

10. 10
Evaluation – single 180 cameras
180o
180o
180o
360o
Compare virtual view
rendered from input 180
view at location of
reference 180 view
1 – input 180 view
2 – reference 180 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view

11. 11
Evaluation – multiple 180 cameras
180o
180o
180o
360o
Compare virtual view
rendered from input 180
view at location of
reference 180 view
3 – input 180 views
2 – reference 180 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
180o
180o

12. 12
Evaluation – multiple 180 cameras
180o
180
o
180
o
180o
360o
8 – input 180 views
? – reference ??
1 – virtual 360 view –
rendered from input view

13. 13
Partial reference views
180o
180
o
180
o
180o
360o
4 – input 180 views
4 – reference 180 views
1 – virtual 360 view –
rendered from input view
Partial comparison
at reference 180
view location

14. 14
Full 360 reference views
180o
180
o
180
o
180o
360o
8 – input 180 views
2 – reference 360 views
1 – virtual 360 view –
rendered from input view
360o
360o
Full comparison at
reference 360 view
location

15. Conclusions
◼ Spherical LightField Camera, alows wide range
of viewer movement
◼ 3DoF+ capability
◼ Extension of existing technology