Next Generation Media Technologies

1. Multimedia
Representations
Adrian Munteanu

2. Research Activities
Multimedia Representations
 Compression Technologies
(Images, Video, 3D Graphics, 3D
Multimedia textures)
 Development of new algorithms,
customized solutions
 In-depth know-how of various
standards: JPEG-2000, H.26x,
MPEG-4, VCEG, etc.
 Focus on various application
domains for a broad range of imaging
modalities
2

3. Scalable Compression of Meshes
MESHES
What are meshes?
 Representations of 3D virtual objects
 Set of points
 Set of triangles, quads, …
called polygons
3

4. Scalable Compression of Meshes
 Resolution scalability
Example:
Resolution level 1 Resolution level 2
(original)
Resolution level 3 Resolution level 4
4

5. Scalable Compression of Meshes
Why scalability?
 Progressive reconstruction
 Level-Of-Detail (LOD)
LOD calls for resolution scalability!
5

6. Scalable Compression of Meshes
3xC Codec (Context-conditioned Composite Coding of meshes)
 Provides state-of-the-art compression performance
 Resolution scalable!
+30% compression +30% compression
Rabbit Igea
6

7. Scalable Compression of Meshes
Real world compression performance
Original Semi-regular Compressed
“Bob” Mesh (© Alcatel-Lucent) 140 KB (206:1)
28.13 MB
7

8. 3D video: from stereo to multi-view
Left
Stereo
Encoding
Right
8

9. 3D video: from stereo to multi-view
Autostereoscopic display
Left
Multiview
Center
Encoding
Right
9

10. Free Viewpoint Television

11. 3D Video: Compression
 Encode a pair of depth and texture information of
extreme left and extreme right cameras;
 Synthesize all middle views
11

12. 3D video: from stereo to multi-view
iMinds-FMI: hybrid 3D coding system
→ based on H.264/AVC and HEVC
multi-view
coding of
texture and
compatible depth
with
3D overhead
100%
installed
80%
base layer
support for
60%
stereo and
40%
autostereo
20% gains of
0% 35%
compared to
current MVC
technology
12

13. 13

14. Segmentation-based 3D Depth coding
 Encoding time: ~5 times smaller
 Subjective tests:
 Alternative for high-complexity codecs
14

15. Challenges for the future
 The imaging modalities are getting highly diversified
3D Video Depth maps
Holography
Multiview video Capsule endoscopy
High-quality 3D graphics