Overview of the 3DoF+ and 6Dof aqusition technology

1. Overview of the framework
for 3DoF+ and 6DoF
Krzysztof Wegner
Mucha sp. z o.o.
Poland

2. 2
Output – single 360 view
360o
Classic VR systems needs one 360 image (video) of a real of
virtual environment which can be displayed directly on HDM

3. 3
Input – single 360 camera
360o
Input to the system can be single 360 view captured by
omnidirectional (360) camera or rendered form 3D model (game)

4. 4
Input – multiple 360 images (videos)
360o
360o
360o
For more immersive system like virtual tours input to the system can be multiple
360 view captured from different location is space.

5. 5
Input – single 180 image
180o
Input to the system can be single view less than 360 degree, captured from
single location, not covering entire sphere.

6. 6
Input – multiple 180 images
180o
180o
180o
Input to the system can be multiple view less than 360 degree, captured
from multiple location not covering entire sphere

7. 7
Input – multiple 180 images
180o
180
o
180
o
180o
Input to the system can be
multiple view less than 360
degree, captured from multiple
location covering entire sphere
Spherical LightField Camera

8. 8
Evaluation – single 360 camera
360o
1 – input 360 view
4 – reference 360 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
360o
360o
360o
360o
360o
Compare virtual view
rendered from input 360
view at location of
reference 360 view

9. 9
Evaluation – multiple 360 camera
360o
3 – input 360 views
4 – reference 360 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
360o
360o
360o
360o
360o
Compare virtual view
rendered from input 360
view at location of
reference 360 view
360o
360o

10. 10
Evaluation – single 180 cameras
180o
180o
180o
360o
Compare virtual view
rendered from input 180
view at location of
reference 180 view
1 – input 180 view
2 – reference 180 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view

11. 11
Evaluation – multiple 180 cameras
180o
180o
180o
360o
Compare virtual view
rendered from input 180
view at location of
reference 180 view
3 – input 180 views
2 – reference 180 views for virtual view quality evaluation
1 – virtual 360 view – rendered from input view
180o
180o

12. 12
Evaluation – multiple 180 cameras
180o
180
o
180
o
180o
360o
8 – input 180 views
? – reference ??
1 – virtual 360 view –
rendered from input view

13. 13
Partial reference views
180o
180
o
180
o
180o
360o
4 – input 180 views
4 – reference 180 views
1 – virtual 360 view –
rendered from input view
Partial comparison
at reference 180
view location

14. 14
Full 360 reference views
180o
180
o
180
o
180o
360o
8 – input 180 views
2 – reference 360 views
1 – virtual 360 view –
rendered from input view
360o
360o
Full comparison at
reference 360 view
location

15. Conclusions
◼ Spherical LightField Camera, alows wide range
of viewer movement
◼ 3DoF+ capability
◼ Extension of existing technology