Proposed test materials for 3DoF+
or Omnidirectional 6DoF
Olgierd Stankiewicz1, Krzysztof Wegner1,
Adrian Dziembowski1, Mateusz Lorkiewicz1,
Marek Domański1
Gwangsoon Lee2, Jeongil Seo2,
1Chair of Multimedia Telecommunications and Microelectronics
Poznań University of Technology, Poland
2Electronics and Telecommunications Research Institute, Korea.
Scene and camera geometry
2
Scene and camera geometry
3
Perspective
Center
Perspective
Left
Perspective
Right
Scene and camera geometry
4
360o Perspective
Center
Perspective
Left
Perspective
Right
Scene and camera geometry
5
360o Perspective
Center
Perspective
Left
Perspective
Right
Scene and camera geometry
6
360o Perspective
Center
Perspective
Left
Perspective
Right
Data generation
7
36
0o
Perspective
Center
Perspective
Left
Perspective
Right
Set of images and depth maps
YUV 4:2:0 Normalized disparity
3D Scene
Blender
Metadata: Camera parameters
Scenes
 4 CG Scenes
 “Space 360”
 “House 360”
 “People 360”
 “Blocks 360”
 Presenting increasing challenge for prospective 6DoF
rendering technology
8
Space 360
 Scene consists of background (distant stars) and simple disjoint objects in
the foreground.
 The objects do not interact with each other, so therefore this scene should
be relatively simple to analyze and to use with various 3D scene
representations.
9
Space 360
 Scene consists of background (distant stars) and simple disjoint objects in
the foreground.
 The objects do not interact with each other, so therefore this scene should
be relatively simple to analyze and to use with various 3D scene
representations.
10
Space 360
 Scene consists of background (distant stars) and simple disjoint objects in
the foreground.
 The objects do not interact with each other, so therefore this scene should
be relatively simple to analyze and to use with various 3D scene
representations.
11
Space 360
 Scene consists of background (distant stars) and simple disjoint objects in
the foreground.
 The objects do not interact with each other, so therefore this scene should
be relatively simple to analyze and to use with various 3D scene
representations.
12
House 360
 Scene is an outdoor view
 In the main view there is a house standing next to a three. In the very
front of the scene there is a carpet surrounded by two plants. .
13
House 360
 Scene is an outdoor view
 In the main view there is a house standing next to a three. In the very
front of the scene there is a carpet surrounded by two plants. .
14
House 360
 Scene is an outdoor view
 In the main view there is a house standing next to a three. In the very
front of the scene there is a carpet surrounded by two plants. .
15
House 360
 Scene is an outdoor view
 In the main view there is a house standing next to a three. In the very
front of the scene there is a carpet surrounded by two plants. .
16
People 360
 Scene is placed in a meeting room, in which there are some people.
 The main focus of the scene is on two people who are standing in the
middle of the room and shaking hands. These people are at slightly
different distances from the cameras and are connected by shake of their
hands. Other people are standing around, except for one lady who is
sitting on a stool in corner of the room.
17
People 360
 Scene is placed in a meeting room, in which there are some people.
 The main focus of the scene is on two people who are standing in the
middle of the room and shaking hands. These people are at slightly
different distances from the cameras and are connected by shake of their
hands. Other people are standing around, except for one lady who is
sitting on a stool in corner of the room.
18
People 360
 Scene is placed in a meeting room, in which there are some people.
 The main focus of the scene is on two people who are standing in the
middle of the room and shaking hands. These people are at slightly
different distances from the cameras and are connected by shake of their
hands. Other people are standing around, except for one lady who is
sitting on a stool in corner of the room.
19
People 360
 Scene is placed in a meeting room, in which there are some people.
 The main focus of the scene is on two people who are standing in the
middle of the room and shaking hands. These people are at slightly
different distances from the cameras and are connected by shake of their
hands. Other people are standing around, except for one lady who is
sitting on a stool in corner of the room.
20
Blocks 360
 Scene focuses on a set of blocks placed on a table
 The blocks have different colors and letters imprinted on them. Some of
them re placed on top of others.
 Apart from the blocks on the table, there are also some chairs, doors and
paintings on the walls of the room. Also behind the viewer, there are
21
Blocks 360
 Scene focuses on a set of blocks placed on a table
 The blocks have different colors and letters imprinted on them. Some of
them re placed on top of others.
 Apart from the blocks on the table, there are also some chairs, doors and
paintings on the walls of the room. Also behind the viewer, there are
22
Blocks 360
 Scene focuses on a set of blocks placed on a table
 The blocks have different colors and letters imprinted on them. Some of
them re placed on top of others.
 Apart from the blocks on the table, there are also some chairs, doors and
paintings on the walls of the room. Also behind the viewer, there are
windows allowing to look on some skyscrapers.
23
Blocks 360
 Scene focuses on a set of blocks placed on a table
 The blocks have different colors and letters imprinted on them. Some of
them re placed on top of others.
 Apart from the blocks on the table, there are also some chairs, doors and
paintings on the walls of the room. Also behind the viewer, there are
windows allowing to look on some skyscrapers.
24
License
 The test materials remain the property of Poznan University of Technology
but they are licensed for free use within ISO/IEC JTC1/SC29/WG11
(MPEG) for the purposes of research and the development of standards.
These sequences can be also freely used for research purposes outside
MPEG. Any other use is prohibited unless an explicit permission is given by
Poznań University of Technology, Chair of Multimedia Telecommunications
and Microelectronics and/or Electronics and Telecommunications Research
Institute.
 Acknowledgements are appreciated if the material was used in research
and are required if the material is to be used in publications. The
acknowledgement should use the reference to this document.
Conclusions
 The abovementioned test materials can be made available upon request or
uploaded to MPEG repository.
 We can render any additional views upon request

New omnidirectional test sequences

  • 1.
    Proposed test materialsfor 3DoF+ or Omnidirectional 6DoF Olgierd Stankiewicz1, Krzysztof Wegner1, Adrian Dziembowski1, Mateusz Lorkiewicz1, Marek Domański1 Gwangsoon Lee2, Jeongil Seo2, 1Chair of Multimedia Telecommunications and Microelectronics Poznań University of Technology, Poland 2Electronics and Telecommunications Research Institute, Korea.
  • 2.
    Scene and camerageometry 2
  • 3.
    Scene and camerageometry 3 Perspective Center Perspective Left Perspective Right
  • 4.
    Scene and camerageometry 4 360o Perspective Center Perspective Left Perspective Right
  • 5.
    Scene and camerageometry 5 360o Perspective Center Perspective Left Perspective Right
  • 6.
    Scene and camerageometry 6 360o Perspective Center Perspective Left Perspective Right
  • 7.
    Data generation 7 36 0o Perspective Center Perspective Left Perspective Right Set ofimages and depth maps YUV 4:2:0 Normalized disparity 3D Scene Blender Metadata: Camera parameters
  • 8.
    Scenes  4 CGScenes  “Space 360”  “House 360”  “People 360”  “Blocks 360”  Presenting increasing challenge for prospective 6DoF rendering technology 8
  • 9.
    Space 360  Sceneconsists of background (distant stars) and simple disjoint objects in the foreground.  The objects do not interact with each other, so therefore this scene should be relatively simple to analyze and to use with various 3D scene representations. 9
  • 10.
    Space 360  Sceneconsists of background (distant stars) and simple disjoint objects in the foreground.  The objects do not interact with each other, so therefore this scene should be relatively simple to analyze and to use with various 3D scene representations. 10
  • 11.
    Space 360  Sceneconsists of background (distant stars) and simple disjoint objects in the foreground.  The objects do not interact with each other, so therefore this scene should be relatively simple to analyze and to use with various 3D scene representations. 11
  • 12.
    Space 360  Sceneconsists of background (distant stars) and simple disjoint objects in the foreground.  The objects do not interact with each other, so therefore this scene should be relatively simple to analyze and to use with various 3D scene representations. 12
  • 13.
    House 360  Sceneis an outdoor view  In the main view there is a house standing next to a three. In the very front of the scene there is a carpet surrounded by two plants. . 13
  • 14.
    House 360  Sceneis an outdoor view  In the main view there is a house standing next to a three. In the very front of the scene there is a carpet surrounded by two plants. . 14
  • 15.
    House 360  Sceneis an outdoor view  In the main view there is a house standing next to a three. In the very front of the scene there is a carpet surrounded by two plants. . 15
  • 16.
    House 360  Sceneis an outdoor view  In the main view there is a house standing next to a three. In the very front of the scene there is a carpet surrounded by two plants. . 16
  • 17.
    People 360  Sceneis placed in a meeting room, in which there are some people.  The main focus of the scene is on two people who are standing in the middle of the room and shaking hands. These people are at slightly different distances from the cameras and are connected by shake of their hands. Other people are standing around, except for one lady who is sitting on a stool in corner of the room. 17
  • 18.
    People 360  Sceneis placed in a meeting room, in which there are some people.  The main focus of the scene is on two people who are standing in the middle of the room and shaking hands. These people are at slightly different distances from the cameras and are connected by shake of their hands. Other people are standing around, except for one lady who is sitting on a stool in corner of the room. 18
  • 19.
    People 360  Sceneis placed in a meeting room, in which there are some people.  The main focus of the scene is on two people who are standing in the middle of the room and shaking hands. These people are at slightly different distances from the cameras and are connected by shake of their hands. Other people are standing around, except for one lady who is sitting on a stool in corner of the room. 19
  • 20.
    People 360  Sceneis placed in a meeting room, in which there are some people.  The main focus of the scene is on two people who are standing in the middle of the room and shaking hands. These people are at slightly different distances from the cameras and are connected by shake of their hands. Other people are standing around, except for one lady who is sitting on a stool in corner of the room. 20
  • 21.
    Blocks 360  Scenefocuses on a set of blocks placed on a table  The blocks have different colors and letters imprinted on them. Some of them re placed on top of others.  Apart from the blocks on the table, there are also some chairs, doors and paintings on the walls of the room. Also behind the viewer, there are 21
  • 22.
    Blocks 360  Scenefocuses on a set of blocks placed on a table  The blocks have different colors and letters imprinted on them. Some of them re placed on top of others.  Apart from the blocks on the table, there are also some chairs, doors and paintings on the walls of the room. Also behind the viewer, there are 22
  • 23.
    Blocks 360  Scenefocuses on a set of blocks placed on a table  The blocks have different colors and letters imprinted on them. Some of them re placed on top of others.  Apart from the blocks on the table, there are also some chairs, doors and paintings on the walls of the room. Also behind the viewer, there are windows allowing to look on some skyscrapers. 23
  • 24.
    Blocks 360  Scenefocuses on a set of blocks placed on a table  The blocks have different colors and letters imprinted on them. Some of them re placed on top of others.  Apart from the blocks on the table, there are also some chairs, doors and paintings on the walls of the room. Also behind the viewer, there are windows allowing to look on some skyscrapers. 24
  • 25.
    License  The testmaterials remain the property of Poznan University of Technology but they are licensed for free use within ISO/IEC JTC1/SC29/WG11 (MPEG) for the purposes of research and the development of standards. These sequences can be also freely used for research purposes outside MPEG. Any other use is prohibited unless an explicit permission is given by Poznań University of Technology, Chair of Multimedia Telecommunications and Microelectronics and/or Electronics and Telecommunications Research Institute.  Acknowledgements are appreciated if the material was used in research and are required if the material is to be used in publications. The acknowledgement should use the reference to this document.
  • 26.
    Conclusions  The abovementionedtest materials can be made available upon request or uploaded to MPEG repository.  We can render any additional views upon request