Brokerage 2007 presentation multimedia

336 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
336
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Brokerage 2007 presentation multimedia

  1. 1. Multimedia Content (Creation & Transfer) Rik Van de Walle Frank Van Reeth
  2. 2. Overview topics - main competences  Mobile multimedia applications  reduction impact network losses  transparent handover of multimedia sessions  hardware/software co-design multimedia systems 2
  3. 3. Overview topics - main competences  Advanced multimedia applications  (scalable) video compression  multimedia content adaptation & transcoding  video quality measurement and improvement (QoS)  iDTV applications  network-based virtual environments & applications  3D graphics & modelling  animation-based applications  speech synthesis  speech enhancement & recognition  optimized codec implementation (HW & SW) 3
  4. 4. Overview topics - main competences  Metadata technology  development of new metadata models  information retrieval (e.g., for key-shot detection)  object recognition & feature extraction 4
  5. 5. Overview topics - main competences  Standardization  leading role in standardization of  video coding - H.264/AVC & MPEG-4 SVC  MPEG-21 technology  image coding - JPEG  W3C multimedia semantics incubator  active participation in other standardization organs: W3C, JVT, VQEG  follow-up of DICOM, DVB, IFTA and ITU activities JPEG 5
  6. 6. Some examples  Selected results from IBBT projects in the domain of Multimedia Content (Creation and Transfer)  3D networked virtual environment  Free view point visual communication  GPU-assisted video processing 6
  7. 7. (1) 3D Networked Virtual Environment  Goal: sustain communication of long-term or chronically ill children (8-12) with classroom environment  Communication:  synchronous vs. asynchrounous attending lessons vs. reviewing lessons later on  social vs. educational friends at home vs. friends in school / during play-time vs. during teaching time  easy to use (i.e., image- and video-based)  Proof-of-concept  video chat based  3D networked virtual environment 7
  8. 8. (1) 3D Networked Virtual Environment  Existing solutions web based or video chat based: 8
  9. 9. (1) 3D Networked Virtual Environment  Targeted solution in ASCIT: 9
  10. 10. (2) Free-View Point Visual Communication Off-line, Real-Time (on powerful PCs) non-real-time, by simulation Raw Data recording File File Distributed Source Coding Viewpoint interpolation Encryption 3D Face to Face Video Conference Demo MPEG-4 MPEG-4 Decryption compression decoding Decoding Packetization LAN / Pers. Netw. x2 for bi-directional communication 10
  11. 11. (2) 3D Face to Face Video Conference: Face to Face – 2 persons: EYE GAZING PROBLEM EYE GAZING PROBLEM: Webcam Your participant does not look into your eyes because Computer of mismatch between Display webcam direction and display direction SOLUTION: Have a virtual camera “behind” the display, looking straight in the eyes of the participant 11
  12. 12. (2) 3D Face to Face Video Conference: “Virtual camera behind the display” Real cameras = Viewpoint interpolation = Virtual camera 12
  13. 13. (3) GPU-assisted video processing  Graphics Processing Unit (GPU)  originally designed for 3-D-graphics  today a powerful and programmable co-processor  General Purpose Computations (GPGPU)  data processing in parallel  development is a challenge  significant differences with CPU  conceptual and architectural  Current research  high-definition video decoding and processing 13
  14. 14. (3) GPU-assisted video processing  Accelerating video decoding  motion compensation in H.264/AVC  color space conversion (YCoCg-R)  Design of proprietary video codec  GPU-friendly  lossless and scalable  Post-processing effects  film grain reconstruction  noise reduction  error concealment 14

×