SlideShare a Scribd company logo
Workshop on “Monitoring Quality of
Service and Quality of Experience of Multimedia Services in
Broadband/Internet Networks”
(Maputo, Mozambique, 14-16 April 2014)
Perceptual Quality Evaluation
Of OTT Streaming Video Services
Joachim Pomy
Consultant@joachimpomy.de
OPTICOM, Germany
Perceptual Quality Evaluation
Of OTT Streaming Video Services
Dipl.-Ing. Michael Keyhl, MBA
Founder & CEO, OPTICOM, Germany
Session > OTT Technologies and Services <
Broadcast Engineering Conference | NAB Show 2014, Monday April 7
 Founded 1995 in Erlangen, Germany
 Spin-Off from the Fraunhofer-Institute IIS (Home of MP3)
 „Originators“ of Perceptual Audio Quality Measurement (1988)
 Co-Authors of Six Major International Standards
 Leading Source of Voice and Video Quality Test Products and
OEM Technology for Mobile and IP-based Network Testing
 > 100 Licensed OEM Customers
 > 40.000 Licensed PESQ Products
Who We Are
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 3
How Do You Measure Video Quality..
...to benchmark Multi-Screen QoE of ABR VoD OTT Services
as perceived
by subscribers?
How Do You Measure Video Quality?
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 4
How Do You Measure Video Quality..
...to benchmark Multi-Screen QoE of ABR VoD OTT Services
as perceived
by subscribers?
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 5
Conclusion 1:
Clear Need for a New Streaming Video
Quality Measurement Technique
Conclusion 2:
Newly Interpret Video Quality in the Context
of Multi-Screen Use Scenarios
Overview
1. ABR and Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 6
Overview
1. ABR and Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 7
Testing Typologies
Full Reference (FR)
 Principle: Differential Analysis
comparing Degraded with the Original
Source Video
 Access to Reference/Studio Source
 Pixel-based, Frame-by-Frame
Comparison
 e.g. OPTICOM‘s PEVQ/ITU-T J.247
+ Highest Accuracy and Repeatability
+ Standardized
‒ Processing Intensive
No-Reference (NR)
 Principle: Single-ended Analysis,
NO Information on the Original Source
Video
 Pixel-based, or
 NR/IP Transport Stream Analysis, only,
no Payload decoding
 Various Proprietary Metrics
‒ Low Accuracy „Estimates“ only
‒ Failed in Standardization
+ Lightweight, easy to apply
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 8
Video
Quality
Standards
developed
by VQEG
and ITU
based on
BT.500/P.910
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 9
SD TV
• ITU-T J.144 (03/2001-03/2004) <FR>
"Objective PerceptualVideoQuality MeasurementTechniquesfor
Digital Cable Television in thePresence ofa FullReference"
VQEG
MM
• ITU-TJ.246(08/2008) <RR>
"Perceptual Visual QualityMeasurementTechniquesfor MultimediaServicesover
Digital Cable Television Networks inthePresence ofa ReducedBandwidthReference"
• ITU-T J.247(08/2008) <FR>
"Objective PerceptualMultimediaVideo QualityMeasurementin the PresenceofaFull Reference"
VQEG
HD
• ITU-TJ.341 (01/2011) <FR>
"Objective PerceptualVideoQuality Measurementof HDTV for
DigitalCableTelevisionin thePresence ofaFull Reference"
• ITU-TJ.342 (04/2011) <RR>
"Objective VideoQualityMeasurementof HDTV for
Digital Cable Television in thePresence ofa ReducedReferenceSignal"
VQEG
Hybrid
• OngoingProject<FR, RR,NR>
Models havebeen submittedin2012 andtesting isunderway.Reportexpected2014..
ABR Video Streaming Techniques
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 10
Adaptive Video Streaming Techniques
RTP based
Adobe RTMP-based
Dynamic Streaming
(Flash)
Windows, Mac,
Linux, Solaris, not
on iDevices (Flash)
HTTP
based
Adobe
HTTP-based
Dynamic Streaming
Windows, Mac,
Linux, Solaris, not
on iDevices (Flash)
Apple
HTTP Live
Streaming
(HLS)
iDevices, Android
Microsoft
Smooth Streaming
(Silverlight)
Windows, Mac,
Windows Phone,
Connected TVs
MPEG DASH
Dynamic Adaptive
Streaming over
HTTP
Windows, Mac,
Connected TVs
(based on Jan Ozer:
‘Video Compression
for Flash, Apple
Devices and HTML5‘
[2011])
Example: YouTube Upload
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 11
Upload: V_Res 1920x1080, V_Fps 24, V_BitRate 8Mbit/s
Protocol V_Codec V_BitRate V_Res V_Fps A_Codec A_Bitrate Format PEVQ-S
PD MPEG4 60kbit/s 176x144 12 AAC 24kbit/s 3GP -
PD MPEG4 200kbit/s 320x180 24 AAC 32kbit/s 3GP -
PD FLV 300kbit/s 426x240 24 MP3 64kbit/s FLV 
PD - - - - OGG 96kbit/s WEBM -
PD VP8 600kbit/s 640x360 24 OGG 110kbit/s WEBM 
PD H.264 500kbit/s 640x360 24 AAC 96kbit/s MP4 
PD H.264 2Mbit/s 1280x720 24 AAC 192kbit/s MP4 
ABR - - - - AAC 128kbit/s MP4 -
ABR H.264 100kbit/s 256x144 15 - - MP4 -
ABR H.264 250kbit/s 426x240 24 - - MP4 
ABR H.264 400kbit/s 640x360 24 - - MP4 
ABR H.264 800kbit/s 854x480 24 - - MP4 
ABR H.264 1.6Mbit/s 1280x720 24 - - MP4 
ABR H.264 3Mbit/s 1920x1080 24 - - MP4 
Reference/Source
PD or ABR Protocols
Various Codecs at
Various Bitrates
Compare Various
Frame Sizes
Compare Different
Fps
Handle Common
Bitstream Formats
Only
PEVQ was
validated
for QCIF,
CIF, VGA,
SD, and HD
based on
BT.500/P.910
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 12
SD TV
• ITU-T J.144 (03/2001-03/2004) <FR>
"Objective PerceptualVideoQuality MeasurementTechniquesfor
Digital Cable Television in thePresence ofa FullReference"
VQEG
MM
• ITU-TJ.246(08/2008) <RR>
"Perceptual Visual QualityMeasurementTechniquesfor MultimediaServicesover
Digital Cable Television Networks inthePresence ofa ReducedBandwidthReference"
• ITU-T J.247(08/2008) <FR>
"Objective PerceptualMultimediaVideo QualityMeasurementin the PresenceofaFull Reference"
VQEG
HD
• ITU-TJ.341 (01/2011) <FR>
"Objective PerceptualVideoQuality Measurementof HDTV for
DigitalCableTelevisionin thePresence ofaFull Reference"
• ITU-TJ.342 (04/2011) <RR>
"Objective VideoQualityMeasurementof HDTV for
Digital Cable Television in thePresence ofa ReducedReferenceSignal"
VQEG
Hybrid
• OngoingProject<FR, RR,NR>
Models havebeen submittedin2012 andtesting isunderway.Reportexpected2014..
PEVQ 
PEVQ 
PEVQ 
Validation by Subjective Testing
 ITU-R BT.500: Originally
CRT TV-Quality Testing (SD)
 ITU-T P.910:
Multimedia (QCIF, CIF, VGA)
and IPTV (HD 720/1080)
 Mostly ACR Tests
 Test Sequences 8 – 15 sec
 5-Point Opinion Scale
 Averaging over a Large Enough
Test Population  MOS
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 13
Conclusion 4:
Need for New Subjective Testing -
Snapshots of 10 s Video are Inadequate
to Assess Re-Buffering and Long-term
Behavior of Streaming Video
Overview
1. Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 14
Stakeholders involved in a QoE Rivalry
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 15
Overview
1. Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 16
Defining a
4-layered
OTT
Quality
Model
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 17
Stakeholders‘ Different Quality Views
Stakeholders for OTT QoE… …and related Quality Layers
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 18
Overview
1. Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 19
OTT VQM Requirements
 VQM Should be related to the Content Quality as a
Reference
 Accurately score encoding and transcoding Artifacts
= Media Stream Quality
 Measure and compare the Picture Quality for different
Frame Sizes and Frame Rates
= Media Stream/Transmission Quality
 Continuously track the different Bit Rates and evaluate
how ‚smooth‘ the Player is able to interact with the
Server in a Congested Network = Transmission Quality
 Take into account Player and Device Characteristics as
well as Viewing Environment = Presentation Quality
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 20
Overview
1. Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 21
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 22
Overview
1. Existing Video Metrics and Standards
2. Stakeholders in the OTT QoE Rivalry
3. Defining an >OTT Quality Model<
4. Designing a Video Quality Measure for OTT
5. Introduction to PEVQ-S
6. Conclusions
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 23
Conclusions (1/2)
 Clear Need for a Streaming Video Quality Measurement Technique
which accurately evaluates Subscriber QoE
 We must reformulate QoE Concepts and newly interpret Video
Quality in the Context of Multi-Screen Use Scenarios
 Currently, no Standardized Subjective and Objective VQM Standard
exists for ABR Video Streaming
 PEVQ-S is proposed to leapfrog this Shortcoming, based on
advancing existing Standards, while maintaining maximum
Backward-Compatibility and Validated Accuracy
 PEVQ-S is suited to evaluate all 4 OTT Quality Layers:
Content, Media Stream, Transmission and Presentation Quality
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 24
Conclusions (2/2)
 PEVQ-S allows for Analysis of Common ABR Protocols and Formats,
Various Codecs at Various Bitrates
 PEVQ-S can analyze Video at Different Frame Sizes and Fps
 An Advanced Hybrid Architecture: (a) the PEVQ-S Media Stream
Quality Database and (b) the PEVQ-S Client Probe combines the
high Accuracy of a FR Measure with a Light-weight Realtime Client
Implementation, even on Android Smartphones
 Measures Current Video Quality (CVQ) MOS and Headroom for
Optimization for the Best Video Quality Available (BVQA) MOS
 PEVQ-S is made available as an OEM-Technology to leading OTT,
Middleware and T&M Vendors and soon to be found in Products
NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 25
Any questions ?
Joachim Pomy
consultant@joachimpomy.de

More Related Content

What's hot

An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)
Varun Ravi
 
VVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin BrossVVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin Bross
Mathias Wien
 
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
Mathias Wien
 
High Efficiency Video Coding
High Efficiency Video CodingHigh Efficiency Video Coding
High Efficiency Video Coding
Nayan Seth
 
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
MIPI Alliance
 
H.265ImprovedCE_over_H.264-HarmonicMay2014Final
H.265ImprovedCE_over_H.264-HarmonicMay2014FinalH.265ImprovedCE_over_H.264-HarmonicMay2014Final
H.265ImprovedCE_over_H.264-HarmonicMay2014FinalDonald Pian
 
20180306 VidMeet4 Bunji Yamamoto
20180306 VidMeet4 Bunji Yamamoto20180306 VidMeet4 Bunji Yamamoto
20180306 VidMeet4 Bunji Yamamoto
Bunji Yamamoto
 
Cvaa webinar 20120612
Cvaa webinar 20120612Cvaa webinar 20120612
Cvaa webinar 20120612Volicon
 
What Will TV Cost You? Putting a Price on HEVC Licenses
What Will TV Cost You? Putting a Price on HEVC Licenses  What Will TV Cost You? Putting a Price on HEVC Licenses
What Will TV Cost You? Putting a Price on HEVC Licenses
Erik Oliver
 
Perceptual evaluation of Immersive Media – From video quality towards a holi...
 Perceptual evaluation of Immersive Media – From video quality towards a holi... Perceptual evaluation of Immersive Media – From video quality towards a holi...
Perceptual evaluation of Immersive Media – From video quality towards a holi...
Alpen-Adria-Universität
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Touradj Ebrahimi
 
Algorithm and architecture design of the h.265 hevc intra encoder
Algorithm and architecture design of the h.265 hevc intra encoderAlgorithm and architecture design of the h.265 hevc intra encoder
Algorithm and architecture design of the h.265 hevc intra encoder
jpstudcorner
 
EARLY DAYS OF VIDEO CODING STANDARDIZATION
EARLY DAYS OF VIDEO CODING STANDARDIZATIONEARLY DAYS OF VIDEO CODING STANDARDIZATION
EARLY DAYS OF VIDEO CODING STANDARDIZATION
IMTC
 
Technology Update: Future of Broadcast according to EBU 2017
Technology Update: Future of Broadcast according to EBU 2017Technology Update: Future of Broadcast according to EBU 2017
Technology Update: Future of Broadcast according to EBU 2017
Media Perspectives
 
Bandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked StreamingBandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked Streaming
Alpen-Adria-Universität
 
The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...Videoguy
 
Egon Verharen (NPO) @ Technology Update strategische issues EBU
Egon Verharen (NPO) @ Technology Update strategische issues EBUEgon Verharen (NPO) @ Technology Update strategische issues EBU
Egon Verharen (NPO) @ Technology Update strategische issues EBU
Media Perspectives
 
HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?
Alpen-Adria-Universität
 
Towards User-centric Video Transmission in Next Generation Mobile Networks
Towards User-centric Video Transmission in Next Generation Mobile NetworksTowards User-centric Video Transmission in Next Generation Mobile Networks
Towards User-centric Video Transmission in Next Generation Mobile Networks
Förderverein Technische Fakultät
 
Digitization of the audio, video and film collections. Patrick Monette, Media...
Digitization of the audio, video and film collections. Patrick Monette, Media...Digitization of the audio, video and film collections. Patrick Monette, Media...
Digitization of the audio, video and film collections. Patrick Monette, Media...
FIAT/IFTA
 

What's hot (20)

An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)An Overview of High Efficiency Video Codec HEVC (H.265)
An Overview of High Efficiency Video Codec HEVC (H.265)
 
VVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin BrossVVC tutorial at ICME 2020 together with Benjamin Bross
VVC tutorial at ICME 2020 together with Benjamin Bross
 
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
PCS 2019 Panel on Emerging Video Coding Standards: Overview on the Emerging V...
 
High Efficiency Video Coding
High Efficiency Video CodingHigh Efficiency Video Coding
High Efficiency Video Coding
 
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
MPI DevCon Hsinchu City 2017: Next generation MIPI Physical Layer Design and ...
 
H.265ImprovedCE_over_H.264-HarmonicMay2014Final
H.265ImprovedCE_over_H.264-HarmonicMay2014FinalH.265ImprovedCE_over_H.264-HarmonicMay2014Final
H.265ImprovedCE_over_H.264-HarmonicMay2014Final
 
20180306 VidMeet4 Bunji Yamamoto
20180306 VidMeet4 Bunji Yamamoto20180306 VidMeet4 Bunji Yamamoto
20180306 VidMeet4 Bunji Yamamoto
 
Cvaa webinar 20120612
Cvaa webinar 20120612Cvaa webinar 20120612
Cvaa webinar 20120612
 
What Will TV Cost You? Putting a Price on HEVC Licenses
What Will TV Cost You? Putting a Price on HEVC Licenses  What Will TV Cost You? Putting a Price on HEVC Licenses
What Will TV Cost You? Putting a Price on HEVC Licenses
 
Perceptual evaluation of Immersive Media – From video quality towards a holi...
 Perceptual evaluation of Immersive Media – From video quality towards a holi... Perceptual evaluation of Immersive Media – From video quality towards a holi...
Perceptual evaluation of Immersive Media – From video quality towards a holi...
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
 
Algorithm and architecture design of the h.265 hevc intra encoder
Algorithm and architecture design of the h.265 hevc intra encoderAlgorithm and architecture design of the h.265 hevc intra encoder
Algorithm and architecture design of the h.265 hevc intra encoder
 
EARLY DAYS OF VIDEO CODING STANDARDIZATION
EARLY DAYS OF VIDEO CODING STANDARDIZATIONEARLY DAYS OF VIDEO CODING STANDARDIZATION
EARLY DAYS OF VIDEO CODING STANDARDIZATION
 
Technology Update: Future of Broadcast according to EBU 2017
Technology Update: Future of Broadcast according to EBU 2017Technology Update: Future of Broadcast according to EBU 2017
Technology Update: Future of Broadcast according to EBU 2017
 
Bandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked StreamingBandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked Streaming
 
The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...
 
Egon Verharen (NPO) @ Technology Update strategische issues EBU
Egon Verharen (NPO) @ Technology Update strategische issues EBUEgon Verharen (NPO) @ Technology Update strategische issues EBU
Egon Verharen (NPO) @ Technology Update strategische issues EBU
 
HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?HTTP Adaptive Streaming – Where Is It Heading?
HTTP Adaptive Streaming – Where Is It Heading?
 
Towards User-centric Video Transmission in Next Generation Mobile Networks
Towards User-centric Video Transmission in Next Generation Mobile NetworksTowards User-centric Video Transmission in Next Generation Mobile Networks
Towards User-centric Video Transmission in Next Generation Mobile Networks
 
Digitization of the audio, video and film collections. Patrick Monette, Media...
Digitization of the audio, video and film collections. Patrick Monette, Media...Digitization of the audio, video and film collections. Patrick Monette, Media...
Digitization of the audio, video and film collections. Patrick Monette, Media...
 

Viewers also liked

ABCS - Student Housing White Paper
ABCS - Student Housing White PaperABCS - Student Housing White Paper
ABCS - Student Housing White PaperAlex McGowan
 
Mi primer plantilla
Mi primer plantillaMi primer plantilla
Mi primer plantilla
Juan Antamba
 
Fcr 112 Gerencia y herramienta de la calidad
Fcr 112 Gerencia y herramienta de la calidadFcr 112 Gerencia y herramienta de la calidad
Fcr 112 Gerencia y herramienta de la calidadgilma07usb
 
Fci 122 la aviación militar en la primera y segunda guerra mundial
Fci 122 la aviación militar en la primera y segunda guerra mundialFci 122 la aviación militar en la primera y segunda guerra mundial
Fci 122 la aviación militar en la primera y segunda guerra mundialgilma07usb
 
Fcx 111 Ambiente, biodiversidad y sostenibilidad
Fcx 111 Ambiente, biodiversidad y sostenibilidadFcx 111 Ambiente, biodiversidad y sostenibilidad
Fcx 111 Ambiente, biodiversidad y sostenibilidadgilma07usb
 
Book : IT through Experiential Learning
Book : IT through Experiential LearningBook : IT through Experiential Learning
Book : IT through Experiential Learning
S_Shiralkar
 
Fcl 131 organizaciones inteligentes
Fcl 131 organizaciones inteligentesFcl 131 organizaciones inteligentes
Fcl 131 organizaciones inteligentesgilma07usb
 
урок компютерна мережa
урок компютерна мережaурок компютерна мережa
урок компютерна мережa
ttattucca
 
Fci 181 Etica y uso de las nuevas tecnologias de la informacion
Fci 181 Etica y uso de las nuevas tecnologias de la informacionFci 181 Etica y uso de las nuevas tecnologias de la informacion
Fci 181 Etica y uso de las nuevas tecnologias de la informaciongilma07usb
 
презентація до уроку 5клас
презентація до уроку 5класпрезентація до уроку 5клас
презентація до уроку 5клас
ttattucca
 
Fca 113 nuevo formato
Fca 113 nuevo formatoFca 113 nuevo formato
Fca 113 nuevo formatogilma07usb
 
поездка в Болдино
поездка в Болдинопоездка в Болдино
поездка в Болдино
lavrenteva
 
Fcr 111 toma de decisiones gerenciales
Fcr 111 toma de decisiones gerencialesFcr 111 toma de decisiones gerenciales
Fcr 111 toma de decisiones gerencialesgilma07usb
 
Energia folleto rollup
Energia folleto rollupEnergia folleto rollup
Energia folleto rollup
Biovisual Ftg Biovisual
 
Pasos para una idea de negocio.
Pasos para una idea de negocio.Pasos para una idea de negocio.
Pasos para una idea de negocio.
Max Lapa Puma
 
Generació de còpies electròniques autèntiques
Generació de còpies electròniques autèntiquesGeneració de còpies electròniques autèntiques
Generació de còpies electròniques autèntiques
Joan Carles Batalla
 
August 2016
August 2016 August 2016
Expresión corporal y rítmica 205
Expresión corporal y rítmica  205Expresión corporal y rítmica  205
Expresión corporal y rítmica 205
BonyLopez
 

Viewers also liked (19)

ABCS - Student Housing White Paper
ABCS - Student Housing White PaperABCS - Student Housing White Paper
ABCS - Student Housing White Paper
 
Mi primer plantilla
Mi primer plantillaMi primer plantilla
Mi primer plantilla
 
Fcr 112 Gerencia y herramienta de la calidad
Fcr 112 Gerencia y herramienta de la calidadFcr 112 Gerencia y herramienta de la calidad
Fcr 112 Gerencia y herramienta de la calidad
 
Fci 122 la aviación militar en la primera y segunda guerra mundial
Fci 122 la aviación militar en la primera y segunda guerra mundialFci 122 la aviación militar en la primera y segunda guerra mundial
Fci 122 la aviación militar en la primera y segunda guerra mundial
 
Fcx 111 Ambiente, biodiversidad y sostenibilidad
Fcx 111 Ambiente, biodiversidad y sostenibilidadFcx 111 Ambiente, biodiversidad y sostenibilidad
Fcx 111 Ambiente, biodiversidad y sostenibilidad
 
Book : IT through Experiential Learning
Book : IT through Experiential LearningBook : IT through Experiential Learning
Book : IT through Experiential Learning
 
customer service isaac
customer service isaaccustomer service isaac
customer service isaac
 
Fcl 131 organizaciones inteligentes
Fcl 131 organizaciones inteligentesFcl 131 organizaciones inteligentes
Fcl 131 organizaciones inteligentes
 
урок компютерна мережa
урок компютерна мережaурок компютерна мережa
урок компютерна мережa
 
Fci 181 Etica y uso de las nuevas tecnologias de la informacion
Fci 181 Etica y uso de las nuevas tecnologias de la informacionFci 181 Etica y uso de las nuevas tecnologias de la informacion
Fci 181 Etica y uso de las nuevas tecnologias de la informacion
 
презентація до уроку 5клас
презентація до уроку 5класпрезентація до уроку 5клас
презентація до уроку 5клас
 
Fca 113 nuevo formato
Fca 113 nuevo formatoFca 113 nuevo formato
Fca 113 nuevo formato
 
поездка в Болдино
поездка в Болдинопоездка в Болдино
поездка в Болдино
 
Fcr 111 toma de decisiones gerenciales
Fcr 111 toma de decisiones gerencialesFcr 111 toma de decisiones gerenciales
Fcr 111 toma de decisiones gerenciales
 
Energia folleto rollup
Energia folleto rollupEnergia folleto rollup
Energia folleto rollup
 
Pasos para una idea de negocio.
Pasos para una idea de negocio.Pasos para una idea de negocio.
Pasos para una idea de negocio.
 
Generació de còpies electròniques autèntiques
Generació de còpies electròniques autèntiquesGeneració de còpies electròniques autèntiques
Generació de còpies electròniques autèntiques
 
August 2016
August 2016 August 2016
August 2016
 
Expresión corporal y rítmica 205
Expresión corporal y rítmica  205Expresión corporal y rítmica  205
Expresión corporal y rítmica 205
 

Similar to S8 p2 2014-maputo-s8-pomy

FutureComm 2010: Video Quality Analysis and Measurement
FutureComm 2010: Video Quality Analysis and MeasurementFutureComm 2010: Video Quality Analysis and Measurement
FutureComm 2010: Video Quality Analysis and MeasurementRADVISION Ltd.
 
Voice and Video over IP Communications: Assessing and Improving User Experience
Voice and Video over IP Communications: Assessing and Improving User ExperienceVoice and Video over IP Communications: Assessing and Improving User Experience
Voice and Video over IP Communications: Assessing and Improving User Experience
RADVISION Ltd.
 
Improving Video Quality in Your Network
Improving Video Quality in Your NetworkImproving Video Quality in Your Network
Improving Video Quality in Your Network
RADVISION Ltd.
 
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
Alpen-Adria-Universität
 
Adaptive Streaming of Traditional and Omnidirectional Media
Adaptive Streaming of Traditional and Omnidirectional MediaAdaptive Streaming of Traditional and Omnidirectional Media
Adaptive Streaming of Traditional and Omnidirectional Media
Alpen-Adria-Universität
 
Video Standards - Key Insights
Video Standards - Key InsightsVideo Standards - Key Insights
Video Standards - Key Insights
Chetan Manchanda
 
Radvision webinar: Making Real Time Video Work Over The Internet
Radvision webinar: Making Real Time Video Work Over The InternetRadvision webinar: Making Real Time Video Work Over The Internet
Radvision webinar: Making Real Time Video Work Over The Internet
RADVISION Ltd.
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
ijma
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
ijma
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
ijma
 
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
ijma
 
China OTT
China OTTChina OTT
China OTT
Reza Rassool
 
MPEG for the past, present and future of television.ppt
MPEG for the past, present and future of television.pptMPEG for the past, present and future of television.ppt
MPEG for the past, present and future of television.ppt
tavallaeimostafa
 
P9000 p-017o (argon general presentation - june 2014)
P9000 p-017o (argon general presentation - june 2014)P9000 p-017o (argon general presentation - june 2014)
P9000 p-017o (argon general presentation - june 2014)
Clifford Dive
 
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...Unified Communications Online
 
Video Codecs and the Future by Vince Puglia
Video Codecs and the Future by Vince PugliaVideo Codecs and the Future by Vince Puglia
Video Codecs and the Future by Vince Puglia
Dialogic Inc.
 
09a video compstream_intro_trd_23-nov-2005v0_2
09a video compstream_intro_trd_23-nov-2005v0_209a video compstream_intro_trd_23-nov-2005v0_2
09a video compstream_intro_trd_23-nov-2005v0_2Pptblog Pptblogcom
 
Optimising video delivery - Brightcove PLAY 2019
Optimising video delivery - Brightcove PLAY 2019Optimising video delivery - Brightcove PLAY 2019
Optimising video delivery - Brightcove PLAY 2019
Jeremy Brown
 
The Evolution of the Content Delivery Network
The Evolution of the Content Delivery NetworkThe Evolution of the Content Delivery Network
The Evolution of the Content Delivery Network
Cisco Service Provider
 
Eyeball Messenger SDK V10.0 Developer Reference Guide
Eyeball Messenger SDK V10.0 Developer Reference GuideEyeball Messenger SDK V10.0 Developer Reference Guide
Eyeball Messenger SDK V10.0 Developer Reference Guide
Eyeball Networks
 

Similar to S8 p2 2014-maputo-s8-pomy (20)

FutureComm 2010: Video Quality Analysis and Measurement
FutureComm 2010: Video Quality Analysis and MeasurementFutureComm 2010: Video Quality Analysis and Measurement
FutureComm 2010: Video Quality Analysis and Measurement
 
Voice and Video over IP Communications: Assessing and Improving User Experience
Voice and Video over IP Communications: Assessing and Improving User ExperienceVoice and Video over IP Communications: Assessing and Improving User Experience
Voice and Video over IP Communications: Assessing and Improving User Experience
 
Improving Video Quality in Your Network
Improving Video Quality in Your NetworkImproving Video Quality in Your Network
Improving Video Quality in Your Network
 
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
Video Coding for Large-Scale HTTP Adaptive Streaming Deployments: State of th...
 
Adaptive Streaming of Traditional and Omnidirectional Media
Adaptive Streaming of Traditional and Omnidirectional MediaAdaptive Streaming of Traditional and Omnidirectional Media
Adaptive Streaming of Traditional and Omnidirectional Media
 
Video Standards - Key Insights
Video Standards - Key InsightsVideo Standards - Key Insights
Video Standards - Key Insights
 
Radvision webinar: Making Real Time Video Work Over The Internet
Radvision webinar: Making Real Time Video Work Over The InternetRadvision webinar: Making Real Time Video Work Over The Internet
Radvision webinar: Making Real Time Video Work Over The Internet
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
 
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
COMPARISON OF CINEPAK, INTEL, MICROSOFT VIDEO AND INDEO CODEC FOR VIDEO COMPR...
 
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
Comparison of Cinepak, Intel, Microsoft Video and Indeo Codec for Video Compr...
 
China OTT
China OTTChina OTT
China OTT
 
MPEG for the past, present and future of television.ppt
MPEG for the past, present and future of television.pptMPEG for the past, present and future of television.ppt
MPEG for the past, present and future of television.ppt
 
P9000 p-017o (argon general presentation - june 2014)
P9000 p-017o (argon general presentation - june 2014)P9000 p-017o (argon general presentation - june 2014)
P9000 p-017o (argon general presentation - june 2014)
 
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
 
Video Codecs and the Future by Vince Puglia
Video Codecs and the Future by Vince PugliaVideo Codecs and the Future by Vince Puglia
Video Codecs and the Future by Vince Puglia
 
09a video compstream_intro_trd_23-nov-2005v0_2
09a video compstream_intro_trd_23-nov-2005v0_209a video compstream_intro_trd_23-nov-2005v0_2
09a video compstream_intro_trd_23-nov-2005v0_2
 
Optimising video delivery - Brightcove PLAY 2019
Optimising video delivery - Brightcove PLAY 2019Optimising video delivery - Brightcove PLAY 2019
Optimising video delivery - Brightcove PLAY 2019
 
The Evolution of the Content Delivery Network
The Evolution of the Content Delivery NetworkThe Evolution of the Content Delivery Network
The Evolution of the Content Delivery Network
 
Eyeball Messenger SDK V10.0 Developer Reference Guide
Eyeball Messenger SDK V10.0 Developer Reference GuideEyeball Messenger SDK V10.0 Developer Reference Guide
Eyeball Messenger SDK V10.0 Developer Reference Guide
 

Recently uploaded

road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
Robbie Edward Sayers
 
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdfCOLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
Kamal Acharya
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
Jayaprasanna4
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
bakpo1
 
Event Management System Vb Net Project Report.pdf
Event Management System Vb Net  Project Report.pdfEvent Management System Vb Net  Project Report.pdf
Event Management System Vb Net Project Report.pdf
Kamal Acharya
 
Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
seandesed
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
Kamal Acharya
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
abh.arya
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
Kamal Acharya
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
SamSarthak3
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 

Recently uploaded (20)

road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdfCOLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
 
ethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.pptethical hacking in wireless-hacking1.ppt
ethical hacking in wireless-hacking1.ppt
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
 
Event Management System Vb Net Project Report.pdf
Event Management System Vb Net  Project Report.pdfEvent Management System Vb Net  Project Report.pdf
Event Management System Vb Net Project Report.pdf
 
Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 

S8 p2 2014-maputo-s8-pomy

  • 1. Workshop on “Monitoring Quality of Service and Quality of Experience of Multimedia Services in Broadband/Internet Networks” (Maputo, Mozambique, 14-16 April 2014) Perceptual Quality Evaluation Of OTT Streaming Video Services Joachim Pomy Consultant@joachimpomy.de OPTICOM, Germany
  • 2. Perceptual Quality Evaluation Of OTT Streaming Video Services Dipl.-Ing. Michael Keyhl, MBA Founder & CEO, OPTICOM, Germany Session > OTT Technologies and Services < Broadcast Engineering Conference | NAB Show 2014, Monday April 7
  • 3.  Founded 1995 in Erlangen, Germany  Spin-Off from the Fraunhofer-Institute IIS (Home of MP3)  „Originators“ of Perceptual Audio Quality Measurement (1988)  Co-Authors of Six Major International Standards  Leading Source of Voice and Video Quality Test Products and OEM Technology for Mobile and IP-based Network Testing  > 100 Licensed OEM Customers  > 40.000 Licensed PESQ Products Who We Are NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 3
  • 4. How Do You Measure Video Quality.. ...to benchmark Multi-Screen QoE of ABR VoD OTT Services as perceived by subscribers? How Do You Measure Video Quality? NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 4
  • 5. How Do You Measure Video Quality.. ...to benchmark Multi-Screen QoE of ABR VoD OTT Services as perceived by subscribers? NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 5 Conclusion 1: Clear Need for a New Streaming Video Quality Measurement Technique Conclusion 2: Newly Interpret Video Quality in the Context of Multi-Screen Use Scenarios
  • 6. Overview 1. ABR and Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 6
  • 7. Overview 1. ABR and Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 7
  • 8. Testing Typologies Full Reference (FR)  Principle: Differential Analysis comparing Degraded with the Original Source Video  Access to Reference/Studio Source  Pixel-based, Frame-by-Frame Comparison  e.g. OPTICOM‘s PEVQ/ITU-T J.247 + Highest Accuracy and Repeatability + Standardized ‒ Processing Intensive No-Reference (NR)  Principle: Single-ended Analysis, NO Information on the Original Source Video  Pixel-based, or  NR/IP Transport Stream Analysis, only, no Payload decoding  Various Proprietary Metrics ‒ Low Accuracy „Estimates“ only ‒ Failed in Standardization + Lightweight, easy to apply NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 8
  • 9. Video Quality Standards developed by VQEG and ITU based on BT.500/P.910 NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 9 SD TV • ITU-T J.144 (03/2001-03/2004) <FR> "Objective PerceptualVideoQuality MeasurementTechniquesfor Digital Cable Television in thePresence ofa FullReference" VQEG MM • ITU-TJ.246(08/2008) <RR> "Perceptual Visual QualityMeasurementTechniquesfor MultimediaServicesover Digital Cable Television Networks inthePresence ofa ReducedBandwidthReference" • ITU-T J.247(08/2008) <FR> "Objective PerceptualMultimediaVideo QualityMeasurementin the PresenceofaFull Reference" VQEG HD • ITU-TJ.341 (01/2011) <FR> "Objective PerceptualVideoQuality Measurementof HDTV for DigitalCableTelevisionin thePresence ofaFull Reference" • ITU-TJ.342 (04/2011) <RR> "Objective VideoQualityMeasurementof HDTV for Digital Cable Television in thePresence ofa ReducedReferenceSignal" VQEG Hybrid • OngoingProject<FR, RR,NR> Models havebeen submittedin2012 andtesting isunderway.Reportexpected2014..
  • 10. ABR Video Streaming Techniques NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 10 Adaptive Video Streaming Techniques RTP based Adobe RTMP-based Dynamic Streaming (Flash) Windows, Mac, Linux, Solaris, not on iDevices (Flash) HTTP based Adobe HTTP-based Dynamic Streaming Windows, Mac, Linux, Solaris, not on iDevices (Flash) Apple HTTP Live Streaming (HLS) iDevices, Android Microsoft Smooth Streaming (Silverlight) Windows, Mac, Windows Phone, Connected TVs MPEG DASH Dynamic Adaptive Streaming over HTTP Windows, Mac, Connected TVs (based on Jan Ozer: ‘Video Compression for Flash, Apple Devices and HTML5‘ [2011])
  • 11. Example: YouTube Upload NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 11 Upload: V_Res 1920x1080, V_Fps 24, V_BitRate 8Mbit/s Protocol V_Codec V_BitRate V_Res V_Fps A_Codec A_Bitrate Format PEVQ-S PD MPEG4 60kbit/s 176x144 12 AAC 24kbit/s 3GP - PD MPEG4 200kbit/s 320x180 24 AAC 32kbit/s 3GP - PD FLV 300kbit/s 426x240 24 MP3 64kbit/s FLV  PD - - - - OGG 96kbit/s WEBM - PD VP8 600kbit/s 640x360 24 OGG 110kbit/s WEBM  PD H.264 500kbit/s 640x360 24 AAC 96kbit/s MP4  PD H.264 2Mbit/s 1280x720 24 AAC 192kbit/s MP4  ABR - - - - AAC 128kbit/s MP4 - ABR H.264 100kbit/s 256x144 15 - - MP4 - ABR H.264 250kbit/s 426x240 24 - - MP4  ABR H.264 400kbit/s 640x360 24 - - MP4  ABR H.264 800kbit/s 854x480 24 - - MP4  ABR H.264 1.6Mbit/s 1280x720 24 - - MP4  ABR H.264 3Mbit/s 1920x1080 24 - - MP4  Reference/Source PD or ABR Protocols Various Codecs at Various Bitrates Compare Various Frame Sizes Compare Different Fps Handle Common Bitstream Formats
  • 12. Only PEVQ was validated for QCIF, CIF, VGA, SD, and HD based on BT.500/P.910 NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 12 SD TV • ITU-T J.144 (03/2001-03/2004) <FR> "Objective PerceptualVideoQuality MeasurementTechniquesfor Digital Cable Television in thePresence ofa FullReference" VQEG MM • ITU-TJ.246(08/2008) <RR> "Perceptual Visual QualityMeasurementTechniquesfor MultimediaServicesover Digital Cable Television Networks inthePresence ofa ReducedBandwidthReference" • ITU-T J.247(08/2008) <FR> "Objective PerceptualMultimediaVideo QualityMeasurementin the PresenceofaFull Reference" VQEG HD • ITU-TJ.341 (01/2011) <FR> "Objective PerceptualVideoQuality Measurementof HDTV for DigitalCableTelevisionin thePresence ofaFull Reference" • ITU-TJ.342 (04/2011) <RR> "Objective VideoQualityMeasurementof HDTV for Digital Cable Television in thePresence ofa ReducedReferenceSignal" VQEG Hybrid • OngoingProject<FR, RR,NR> Models havebeen submittedin2012 andtesting isunderway.Reportexpected2014.. PEVQ  PEVQ  PEVQ 
  • 13. Validation by Subjective Testing  ITU-R BT.500: Originally CRT TV-Quality Testing (SD)  ITU-T P.910: Multimedia (QCIF, CIF, VGA) and IPTV (HD 720/1080)  Mostly ACR Tests  Test Sequences 8 – 15 sec  5-Point Opinion Scale  Averaging over a Large Enough Test Population  MOS NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 13 Conclusion 4: Need for New Subjective Testing - Snapshots of 10 s Video are Inadequate to Assess Re-Buffering and Long-term Behavior of Streaming Video
  • 14. Overview 1. Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 14
  • 15. Stakeholders involved in a QoE Rivalry NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 15
  • 16. Overview 1. Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 16
  • 17. Defining a 4-layered OTT Quality Model NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 17
  • 18. Stakeholders‘ Different Quality Views Stakeholders for OTT QoE… …and related Quality Layers NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 18
  • 19. Overview 1. Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 19
  • 20. OTT VQM Requirements  VQM Should be related to the Content Quality as a Reference  Accurately score encoding and transcoding Artifacts = Media Stream Quality  Measure and compare the Picture Quality for different Frame Sizes and Frame Rates = Media Stream/Transmission Quality  Continuously track the different Bit Rates and evaluate how ‚smooth‘ the Player is able to interact with the Server in a Congested Network = Transmission Quality  Take into account Player and Device Characteristics as well as Viewing Environment = Presentation Quality NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 20
  • 21. Overview 1. Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 21
  • 22. NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 22
  • 23. Overview 1. Existing Video Metrics and Standards 2. Stakeholders in the OTT QoE Rivalry 3. Defining an >OTT Quality Model< 4. Designing a Video Quality Measure for OTT 5. Introduction to PEVQ-S 6. Conclusions NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 23
  • 24. Conclusions (1/2)  Clear Need for a Streaming Video Quality Measurement Technique which accurately evaluates Subscriber QoE  We must reformulate QoE Concepts and newly interpret Video Quality in the Context of Multi-Screen Use Scenarios  Currently, no Standardized Subjective and Objective VQM Standard exists for ABR Video Streaming  PEVQ-S is proposed to leapfrog this Shortcoming, based on advancing existing Standards, while maintaining maximum Backward-Compatibility and Validated Accuracy  PEVQ-S is suited to evaluate all 4 OTT Quality Layers: Content, Media Stream, Transmission and Presentation Quality NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 24
  • 25. Conclusions (2/2)  PEVQ-S allows for Analysis of Common ABR Protocols and Formats, Various Codecs at Various Bitrates  PEVQ-S can analyze Video at Different Frame Sizes and Fps  An Advanced Hybrid Architecture: (a) the PEVQ-S Media Stream Quality Database and (b) the PEVQ-S Client Probe combines the high Accuracy of a FR Measure with a Light-weight Realtime Client Implementation, even on Android Smartphones  Measures Current Video Quality (CVQ) MOS and Headroom for Optimization for the Best Video Quality Available (BVQA) MOS  PEVQ-S is made available as an OEM-Technology to leading OTT, Middleware and T&M Vendors and soon to be found in Products NAB Show 2014, Broadcast Engineering Conference, 07 April 2014 © 2014 Michael Keyhl, www.opticom.de 25
  • 26. Any questions ? Joachim Pomy consultant@joachimpomy.de