Your SlideShare is downloading. ×
  • Like
Brokerage 2007 presentation multimedia
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Brokerage 2007 presentation multimedia

  • 233 views
Published

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
233
On SlideShare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
1
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Multimedia Content (Creation & Transfer) Rik Van de Walle Frank Van Reeth
  • 2. Overview topics - main competences  Mobile multimedia applications  reduction impact network losses  transparent handover of multimedia sessions  hardware/software co-design multimedia systems 2
  • 3. Overview topics - main competences  Advanced multimedia applications  (scalable) video compression  multimedia content adaptation & transcoding  video quality measurement and improvement (QoS)  iDTV applications  network-based virtual environments & applications  3D graphics & modelling  animation-based applications  speech synthesis  speech enhancement & recognition  optimized codec implementation (HW & SW) 3
  • 4. Overview topics - main competences  Metadata technology  development of new metadata models  information retrieval (e.g., for key-shot detection)  object recognition & feature extraction 4
  • 5. Overview topics - main competences  Standardization  leading role in standardization of  video coding - H.264/AVC & MPEG-4 SVC  MPEG-21 technology  image coding - JPEG  W3C multimedia semantics incubator  active participation in other standardization organs: W3C, JVT, VQEG  follow-up of DICOM, DVB, IFTA and ITU activities JPEG 5
  • 6. Some examples  Selected results from IBBT projects in the domain of Multimedia Content (Creation and Transfer)  3D networked virtual environment  Free view point visual communication  GPU-assisted video processing 6
  • 7. (1) 3D Networked Virtual Environment  Goal: sustain communication of long-term or chronically ill children (8-12) with classroom environment  Communication:  synchronous vs. asynchrounous attending lessons vs. reviewing lessons later on  social vs. educational friends at home vs. friends in school / during play-time vs. during teaching time  easy to use (i.e., image- and video-based)  Proof-of-concept  video chat based  3D networked virtual environment 7
  • 8. (1) 3D Networked Virtual Environment  Existing solutions web based or video chat based: 8
  • 9. (1) 3D Networked Virtual Environment  Targeted solution in ASCIT: 9
  • 10. (2) Free-View Point Visual Communication Off-line, Real-Time (on powerful PCs) non-real-time, by simulation Raw Data recording File File Distributed Source Coding Viewpoint interpolation Encryption 3D Face to Face Video Conference Demo MPEG-4 MPEG-4 Decryption compression decoding Decoding Packetization LAN / Pers. Netw. x2 for bi-directional communication 10
  • 11. (2) 3D Face to Face Video Conference: Face to Face – 2 persons: EYE GAZING PROBLEM EYE GAZING PROBLEM: Webcam Your participant does not look into your eyes because Computer of mismatch between Display webcam direction and display direction SOLUTION: Have a virtual camera “behind” the display, looking straight in the eyes of the participant 11
  • 12. (2) 3D Face to Face Video Conference: “Virtual camera behind the display” Real cameras = Viewpoint interpolation = Virtual camera 12
  • 13. (3) GPU-assisted video processing  Graphics Processing Unit (GPU)  originally designed for 3-D-graphics  today a powerful and programmable co-processor  General Purpose Computations (GPGPU)  data processing in parallel  development is a challenge  significant differences with CPU  conceptual and architectural  Current research  high-definition video decoding and processing 13
  • 14. (3) GPU-assisted video processing  Accelerating video decoding  motion compensation in H.264/AVC  color space conversion (YCoCg-R)  Design of proprietary video codec  GPU-friendly  lossless and scalable  Post-processing effects  film grain reconstruction  noise reduction  error concealment 14