Bitstream- and hybrid-based video quality assessment for IPTVSavvas Argyropoulos, Alexander Raake, Peter List,           C...
Video quality assessment     TV-Content                  Transmission-                                 Subjective         ...
Quality of Experience                    Telekom Innovation Laboratories   3
Video quality assessment - Example                    Telekom Innovation Laboratories   4
Video quality assessmentFull-Reference        TV-Content                           Transmission-                          ...
Video quality assessmentReduced-Reference        TV-Content                     Transmission-                             ...
Video quality assessmentNo-Reference bitstream models        TV-Content                       Transmission-               ...
Video quality assessmentNo-Reference Hybrid (PVS+Bitstream)        TV-Content                      Transmission-          ...
Video quality assessmentSignal-based vs bitstream methods      Compressed, error-free                                 Comp...
Multi-layer perspective                                                                     Layer           Example metric...
Multi-layer model framework: T-V-model                                                     Raake et al., IEEE SPM Nov. 201...
P.120X.Y recommendations timeline      Jun.              Dec.           Apr.                  May.                Sep.    ...
Bit stream video quality model                                Video bitstream                                             ...
Error visibility assessment                      Telekom Innovation Laboratories   14
Error visibility assessment                      Telekom Innovation Laboratories   15
Packet loss visibility classification based on probability estimates                                                 DMOS ...
Classification of packet loss visibility                      6                                  invisible packet loss    ...
Bitstream video quality modelGeneral model                                       Additive model for distortions due to   ...
Bit stream video quality model                     Telekom Innovation Laboratories
Bit stream video quality model – Extracted features ErrorProp: Number of frames affected by the packet loss (calculation ...
Error maps estimation   Corrupted frames          Binary error maps          Error estimation                      Telekom...
Freezing degradation in P.1202.1  Freezing term for each freezing event i:         5       	                              ...
Hybrid models – error concealment impact on subjective quality                    Telekom Innovation Laboratories         23
Q&A                                        http://www.aipa.tu-berlin.de/                                      Alexander.Ra...
Upcoming SlideShare
Loading in …5
×

Bitstream and hybrid-based video quality assessment for IPTV monitoring

1,374 views

Published on

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,374
On SlideShare
0
From Embeds
0
Number of Embeds
367
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Bitstream and hybrid-based video quality assessment for IPTV monitoring

  1. 1. Bitstream- and hybrid-based video quality assessment for IPTVSavvas Argyropoulos, Alexander Raake, Peter List, Colloquium on Quality of Experience inMarie-Neige Garcia, Bernhard Feiten Multimedia Systems and Services,Assessment of IP-based Applications, 23 November, KlagenfurtTelekom Innovation Laboratories,TU Berlin, Germany Telekom Innovation Laboratories
  2. 2. Video quality assessment TV-Content Transmission- Subjective System quality- rating (T-V-) Estimated Model quality index Telekom Innovation Laboratories 2
  3. 3. Quality of Experience Telekom Innovation Laboratories 3
  4. 4. Video quality assessment - Example Telekom Innovation Laboratories 4
  5. 5. Video quality assessmentFull-Reference TV-Content Transmission- Subjective System quality- rating (T-V-) Estimated Model quality index Full-reference models  ITU-T J.144  SD  no transmission errors  ITU-T J.247  VGA, CIF, QCIF  ITU-T J.341  HD J.341 Telekom Innovation Laboratories 5
  6. 6. Video quality assessmentReduced-Reference TV-Content Transmission- Subjective System quality- rating Feature (T-V-) Estimated extraction Model quality index Reduced-reference models  ITU-T J.143  ITU-T J.246 Telekom Innovation Laboratories 6
  7. 7. Video quality assessmentNo-Reference bitstream models TV-Content Transmission- Subjective System quality- rating (T-V-) Estimated Model quality index No-reference bitstream models  ITU-T P.120X.Y  QCIF- HD  transmission errors Telekom Innovation Laboratories 7
  8. 8. Video quality assessmentNo-Reference Hybrid (PVS+Bitstream) TV-Content Transmission- Subjective System quality- rating (T-V-) Estimated Model quality index Hybrid models  VQEG – Hybrid, Hybrid-JEG  VGA, WVGA, HD Telekom Innovation Laboratories 8
  9. 9. Video quality assessmentSignal-based vs bitstream methods Compressed, error-free Compressed, lossy video Telekom Innovation Laboratories 9
  10. 10. Multi-layer perspective Layer Example metric user Picture Distortion TV ... ... video set-top box decoding Frame Degrad. duration ... ... de- packetization MPEG2-TS payload header... RTP payload IP ... Packet Packet loss rate UDP payload IP payload Telekom Innovation Laboratories 10 10
  11. 11. Multi-layer model framework: T-V-model Raake et al., IEEE SPM Nov. 2011 Telekom Innovation Laboratories 11
  12. 12. P.120X.Y recommendations timeline Jun. Dec. Apr. May. Sep. 2011 2012 2012 2012 2012Training  Model  Test  Model  Draft databases submission databases evaluation recommendation Telekom Innovation Laboratories 12
  13. 13. Bit stream video quality model Video bitstream Argyropoulos et al., IEEE QoMex 2011 Probe Bitstream decoding Visibility classifier bitrate Video quality assessment ˆ MOS Telekom Innovation Laboratories
  14. 14. Error visibility assessment Telekom Innovation Laboratories 14
  15. 15. Error visibility assessment Telekom Innovation Laboratories 15
  16. 16. Packet loss visibility classification based on probability estimates DMOS of erroneous sequences encoded at 4Mbps 3.5 A B 3 C D E 2.5 F 2 MOSclean - MOS 1.5 1 0.5 0 -0.5 0 10 20 30 40 50 60 70 Number of detected lossesPacket losses that are viewed only by a fraction of the viewers still have an effect on quality Non detectable ≠ invisible Telekom Innovation Laboratories
  17. 17. Classification of packet loss visibility 6 invisible packet loss 4 visible packet loss 2 mvdiff 0 -2 -4 1 -6 0.8 0.5 0.6 0.6 0.7 0.4 0.8 0.9 0.2 1 0 dMB number of impaired pixels Telekom Innovation Laboratories
  18. 18. Bitstream video quality modelGeneral model  Additive model for distortions due to QV  QCod  ItraV compression and transmission errorBitstream-based model IcodV  f  f size , MBtype , ACcoefs , fps  Freeze ItraV  f IcodV , # Froz. frm  Slicing ItraV  f IcodV , vis, ErrProp,ErrDeg  Telekom Innovation Laboratories
  19. 19. Bit stream video quality model Telekom Innovation Laboratories
  20. 20. Bit stream video quality model – Extracted features ErrorProp: Number of frames affected by the packet loss (calculation based on frame type) AvgMv: Average motion vector of the macroblocks that were lost (*) ResEnergy: Square of transform coefficients of the missing macroblocks MaxPartNr: Maximum number of partitions of the missing macroblocks EstError: Predicted error (in terms of MSE) due to the packet loss (in the frame where the loss occurred) LostMbs: Number of impaired macroblocks that were lost due to the packet loss (in the frame where the loss occurred) ErrorProp: Number of impaired pixels that were impaired due the packet loss and error propagation (computed by all affected frame) AvgMvDiff: Average motion vector difference(*) For the missing macroblocks, the information is obtained from the co-located macroblocks in the previous correctly received frame Telekom Innovation Laboratories
  21. 21. Error maps estimation Corrupted frames Binary error maps Error estimation Telekom Innovation Laboratories
  22. 22. Freezing degradation in P.1202.1 Freezing term for each freezing event i: 5 _ 1 4.0 ∙ _ _ Motion term for each freezing event i: ∙ . ∑ +1.0 _ Telekom Innovation Laboratories 22
  23. 23. Hybrid models – error concealment impact on subjective quality Telekom Innovation Laboratories 23
  24. 24. Q&A http://www.aipa.tu-berlin.de/ Alexander.Raake@telekom.de Savvas.Argyropoulos@telekom.de Marie-Neige.Garcia@telekom.de Peter.List@telekom.de Bernhard.Feiten@telekom.de Thank you! Telekom Innovation Laboratories 24

×