SlideShare a Scribd company logo
1 of 12
Download to read offline
ERICSSON
TECHNOLOGY
C H A R T I N G T H E F U T U R E O F I N N O V A T I O N | # 6 ∙ 2 0 1 7
LEVERAGING
STANDARDSFOR
VIDEO QoE
✱ VIDEO QUALITY OF EXPERIENCE
2 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
GUNNAR HEIKKILÄ,
JÖRGEN GUSTAFSSON
In 2016, Ericsson ConsumerLab found that
the average person watches 90 minutes
more TV and video every day than they did
in 2012 [1]. While traditionally broadcast
linear TV is still popular with many viewers,
internet-based TV and video delivery and
video on demand (VOD) services are all
growing rapidly. In fact, 20 percent of video
consumption occurred on handheld devices
in 2016 [1].
■Asusersbecomemoreaccustomedtovideo
streamingservices,theirqualityexpectations
rise,presentingabigchallengeformediaservice
providers(MSPs)andmobilenetworkoperators
(MNOs).Whiledeliveringhigh-qualityvideo
overafixedconnectioncanbedifficult,doingso
wirelesslyisamuchmoredemandingundertaking.
Yetby2022,75percentofallmobiledatatrafficis
expectedtocomefromvideo,accordingtothe2016
EricssonMobilityReport[2].
At the same time, TV screens are getting
larger, which requires higher video resolution.
High definition (HD) is now the new baseline,
and ultra high definition (UHD) is coming to
both fixed and mobile devices, demanding higher
bandwidth. To provide a consistently high QoE
– particularly in wireless cases with significant
fluctuations in available bandwidth – both MSPs
and MNOs must have a clear understanding of
which impairments their users are experiencing
and be able to accurately assess their perception
of video quality.
‘How happy are our users with their video experience?’ has become a vital
question for mobile network operators and media service providers alike.
New standards for QoE testing have the potential to help them ensure that
they are able to meet user expectations for the service that will account for
three-quarters of mobile network traffic in five years’ time.
VideoQoELEVERAGING STANDARDS
TO MEET RISING USER EXPECTATIONS
VIDEO QUALITY OF EXPERIENCE ✱
3JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW
AdaptiveHTTP-basedstreaming
AdaptiveHTTP-basedvideostreamingvariants
suchasDASHandHLSarethedominantvideo
deliverymethodusedtoday.Theirstreaming
serversprovideseveralversionsofthesamevideo,
eachseparatelyencodedtooffervaryinglevelsof
quality.Thestreamingclientintheuser’sphone,
tabletorPCdynamicallyswitchesbetweenthe
differentversionsduringplayoutdependingonhow
muchnetworkbitrateisavailable.
Iftheavailablenetworkbitrateishigh,theclient
willdownloadthebest-qualityversion.Ifthebitrate
suddenlydrops,theclientwillswitchtoalower-
qualityversionuntilconditionsimprove.The
purposeofthisistoavoidstalling(whentheclient
stopsplayoutintermittentlytofillitsvideobuffer)–
whichisknowntoannoyusers.
Whiletheabilitytoswitchintermittentlybetween
versionsofavideosignificantlydecreasestheriskof
stalling,thequalityvariationsthatthisleadstocan
alsobeannoyingfortheuser.Figure1providesan
exampleofaworst-casescenariowithbothquality
variationsandastallingevent,whichwouldresult
inanoveralllow-qualityexperiencefortheuser.
Subjectivequality
ITU-T P.910 [3] is the recognized standard for
performing subjective video quality tests. The
tests are carried out in a lab equipped with
mobile phones, tablets, PCs or TVs, where
a number of videos are shown to a group of
individuals. Each individual then grades each
video according to their subjective perception of
its quality, selecting one of the following scores:
5 (excellent), 4 (very good), 3 (good), 2 (fair) or 1
(poor). Finally, the average score for each video
is calculated. This number is known as the mean
opinion score (MOS).
The video sequences are typically produced
in a lab environment so that all types of
impairments can be included. High-quality
sports, nature and news videos are used as a
starting point. Impairments (codec settings,
rate and resolution changes, initial buffering,
stalling and so on) are then emulated by varying
the bitrate over a certain range, for example,
or placing stalling events of different lengths at
various points in the videos.
Thetestsaredesignedtomakeanalysisas
accurateandstraightforwardaspossible.Devising
subjectivetestsisatimeconsumingandexpensive
process,though,andlabtestscan’tassessexactly
whatanMNO’srealusersareexperiencing.The
bestwaytoovercomethesechallengesisbyusing
objectivequalityalgorithms.
THE TESTS ARE
DESIGNED TO MAKE
ANALYSIS AS ACCURATE
AND STRAIGHTFORWARD
AS POSSIBLE
Terms and abbreviations
APN–AccessPointName|AVC–advancedvideocoding|DASH–DynamicAdaptiveStreamingoverHTTP|
DM–devicemanagement|eNB–eNodeB(LTEbasestation)|ETSI–EuropeanTelecommunicationsStandards
Institute|HD–highdefinition|HEVC–HighEfficiencyVideoCoding|HLS–HTTPLiveStreaming|HTTP–Hypertext
TransferProtocol|ITU-T–InternationalTelecommunicationUnionTelecommunicationStandardizationSector|
MNO–mobilenetworkoperator|MOS–meanopinionscore|MPD–mediapresentationdescription|MSP–media
serviceprovider|OMA–OpenMobileAlliance|Pa–short-termaudiopredictor|Pq–long-termqualitypredictor|
Pv–short-termvideopredictor|QoE–qualityofexperience|RRC–RadioResourceControl|SMS–shortmessage
service|UHD–ultrahighdefinition|VOD–videoondemand|VP9–Anopen-sourcevideoformatandcodec
✱ VIDEO QUALITY OF EXPERIENCE
4 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
Figure 1 A 60-second video with quality variations (resolution) and a three-second stall in the middle
VIDEO QUALITY OF EXPERIENCE ✱
5JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW
Objectivequality
Asthewordingsuggests,objectivequality
algorithms(alsoknownasobjectivemodels)are
designedtomimicthebehaviorandperceptionof
humans.Thegoalistoproducethesamescoresas
theMOSvaluesthatwouldresultfromrunninga
subjectivetestonthesamevideos.
Manydifferenttypesofobjectivemodelscan
beadopted,dependingontheintendedusage
andthekindofinputdataemployed.Thoseusing
themostlimitedsetofinputparametersbasethe
objectivequalityestimationonencodingrates,
videoresolution,framerates,codecsandstalling
information,asthesefactorsprovidetheminimum
amountofinformationaboutthevideoplayout
thatisrequiredtoestimateaqualityscore.More
complexmodelsmightusethecompleteencoded
videobitstream,oreventhefullreceivedvideo
signal,tofurtherincreasetheestimationaccuracy.
Theobjectivemodelsdescribedaboveare
no-referencemodels,whereinputistakenonly
fromthereceivingendofthemediadistribution
chain.Full-referencemodelscanalsobeadopted,
wherethevideooriginallytransmittedis
comparedwiththeonethatisreceived.Another
variantisthereduced-referencemodel,where
theoriginalvideoisnotneededforreference,but
certaininformationaboutitismadeavailableto
themodel.
Traditionally,objectivemodelsareusedto
evaluatequalitybasedonrelativelyshortvideo
sequences:approximately10secondslong.
However,withadaptivevideostreaming,where
qualitycanvarysignificantlyduringagiven
session,themodelmustalsoassesshowthislong-
termvariationaffectsuserperception.Todothis,
modelevaluationofmuchlongervideosequences
(uptoseveralminutes)isrequired.
Ideally,differentlevelsofcomplexityshouldbe
usablebyasinglemodel–thatis,fromonlyafew
inputparametersuptothefullbitstream,depending
ondeployment.Thisisthescopethatapplieswith
thenewno-referenceITU-TP.1203standard.
StandardizationofITU-TP.1203
TheP.1203standard[4]wasdevelopedaspart
ofanITU-Tcompetitionbetweenparticipating
proponents(Ericssonandsixothercompanies),
whereeachonesentinitsproposedquality
models.Themodelsthatperformedbestwere
thenusedasabaselinetocreatethefinalstandard.
Aninternalmodelarchitecturewasalsodefinedto
facilitatethecreationofamodelthatwouldbeas
flexibleaspossible.
Architecture
Thestandardincludesmodulesforestimatingshort-
termaudioandvideoquality,andanintegration
moduleestimatingthefinalsessionqualitydueto
adaptationandstalling,asshowninFigure2.
Theshort-termvideoandaudiopredictor(Pv
andPa)modulescontinuouslyestimatetheshort-
termaudioandvideoqualityscoresforone-second
piecesofcontent.Thismeansthatfora60-second
video,therewillbe60audioscoresand60video
scores.ThesePvandPamodulesarespecificto
eachtypeofcodec.
ThePvandPamodulesoperateinuptofour
differentmodes,dependingonhowdetailedthe
inputisfromtheparameterextraction.Forthe
leastcomplexmode,themaininputsarerelatedto
resolution,bitrateandframerate,whilethemost
complexmodeperformsadvancedanalysisofthe
videopayload.
Theshort-termscoresfromthosemodules
arefedintothelong-termqualitypredictor(Pq)
module,togetherwithanystallinginformation,
andthefinalsessionqualityscoreforthetotal
videosessionisthenestimated.ThePqmodule
alsoproducesanumberofdiagnosticoutputs,
sothattheunderlyingcausesofthescorecanbe
analyzed.ThePqmoduleisnotmode-orcodec-
dependentandisthereforecommonforallcases.
IDEALLY, DIFFERENT
LEVELS OF COMPLEXITY
SHOULD BE USABLE BY A
SINGLE MODEL
✱ VIDEO QUALITY OF EXPERIENCE
6 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
Figure 2 ITU-T P.1203 architecture
VIDEO QUALITY OF EXPERIENCE ✱
7JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW
Training
InthedevelopmentandstandardizationofP.1203,
alargenumberofsubjectivetestdatabaseswere
created,eachcontainingvideosthatweregraded
byatleast24testindividuals.Animportantgoal
setinthedevelopmentofP.1203wastohandlethe
long-termperceivedeffectsofstallingeventsand
qualityadaptations.
Thus,incontrasttotraditionalsubjectivetests
inwhichafew10-secondvideosaretypically
repeated,thevideosusedforP.1203wereall
uniqueandbetweenoneandfiveminutes
long.Itwasimportanttoavoidrepetitionand
continuouslypresentnewtestvideosthatthe
viewersfoundinterestingenoughtopayattention
tothroughouttheplayout.Thetestsweredoneon
mobiledevicesaswellasoncomputermonitors
andTVscreens,tocoverallthedifferentusecases.
Validation
SincethedevelopmentoftheP.1203standardization
wasrunasacompetition,theperformanceofthe
differentproponentmodelsrequiredvalidation,
andthevalidationcouldnotbecarriedoutonany
existingdatabases.Instead,afterthesubmissionof
alloftheproponents’candidatemodelstoITU-T,
alltheproponentsworkedtogethertodesigna
newsetofdatabases,witheachstepdistributed
todifferentproponentssothatnonehadcomplete
controloveranyindividualdatabase.
Thenewsetofvalidationdatabaseswere
thenusedtoevaluatethemodels,andthetop-
performingoneswereselectedtoformthe
P.1203standard.Incaseswheretherespective
performanceofseveralproponentmoduleswasso
closethatastatisticaltestcouldnottellthemapart,
themodulesweremergedtoformasinglestandard
withoutalternativeimplementations.
Finalmodel
WhilethePvandPamodulesweredevelopedusing
traditionalanalyticalmethodsandimplementedas
aseriesofmathematicalfunctions,thePqmodule
ismoreadvanced.Thismoduleisdividedinto
twoseparateestimationalgorithms:oneusing
atraditionalfunctionalapproachandtheother
basedonmachine-learningconcepts.
Thefunctionalvariantmodelshuman
perception,asinfluencedbytheeffectofquality
oscillations,deepqualitydips,repeatedquality
orstallingartifactsandtheabilitytomemorize.
Alloftheseeffectsaredescribedbymathematical
functions(astheyareforthePvandPamodules),
whicharethencombinedtoestimatetheuser’stotal
perceptionofquality.
Machinelearningisamethodthatsolvesa
problemwiththesupportofself-learningcomputer
algorithms.Itiswellsuitedforproblemswherethe
relationshipbetweentheinputandtheoutputis
complex,asinthePqmodule.Duringthedesign
andtrainingphase,thealgorithmsautomatically
identifyhowvariouscharacteristicsoftheinput
data(Pv/Pascoresandstallingparameters)
arereflectedinchangestotheoutputdata(the
testpanelMOSvalues).Thealgorithmthen
automaticallybuildsablack-boxalgorithm,which
implementsthefinalmachine-trainedsolutionand
estimatestheuserscore.
ThefinalPqMOSestimateisaweightedaverage
oftheoutputfromthetraditionalfunctional
algorithmandthemachine-learning-basedone.
OneoftheadvantagesofusingtwodifferentPq
algorithmsisthattheyhavestatisticallyindependent
estimationerrors,andwhenthetwoscoresare
averaged,theactualerrorbecomessmaller.
Futurestandardizationwork
ThevideomodulecurrentlysupportsH.264/
AVCvideocodecsuptoHD(1920x1080).Anew
workitemhasbeenstartedinITU-T,whichwill
resultinarecommendationthatalsosupports
H.265/HEVCandVP9videocodecsuptoUHD
resolution(3840x2160).Thisworkitemisrunning
inasimilarfashiontoP.1203,withacompetition
givingparticipatingcompaniestheopportunityto
submittheirownproposedmodels.
✱ VIDEO QUALITY OF EXPERIENCE
8 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
Implementingaqualitymodel
Successfulimplementationofaqualitymodelis
dependentonaccesstotheinputdatarequiredby
themodelitself.Themostdemandingmodels,such
asfull-referencevariants,areusuallyimplemented
closetothevideostreamingclient,insidethedevice,
sothatthecompletereceivedvideocanbecompared
withtheonesent.Thisistypicallydoneformanual
testingscenarios,whereaspecialtestphoneisused
inwhichaqualitymodelhasbeenimplemented.
Thismethodisnotfeasibleforpassive
measurements,wherealloralargepartoflivevideo
trafficismonitored,somodelinputdataneedsto
becollectedinanotherway.Forexample,anMNO
thatwantstogainabetterunderstandingofits
overallperceivedvideostreamingqualitywould
needtocollectdatafromallstreamingsessions.
Onewayofdoingthiswouldbetointerceptthe
trafficatcertainnetworknodesandusethetraffic
contentandpatterntotrytoinferwhichserviceis
beingusedandthequalitylevelbeingdelivered.
Thiscanbedifficult,however,owingtothefact
thatmanyservicesarenowencrypted,which
significantlylimitsaccesstothedatarequiredtodo
adetailedqualityestimation.
Onewaytoovercomethischallengeiswiththe
helpofthestreamingclient,whichhasfullknowledge
ofwhatishappeningduringthevideosession.A
feedbacklinkfromthestreamingclientcanbeused
toreportselectedmetricstothenetwork(orthe
originalstreamingserver)wherethequalitycanbe
estimated.Thistechniqueisalreadyusedinternally
formanystreamingservices.Forexample,whena
userclicksonavideolinkontheinternet,theclient
typicallycontinuouslymeasuresdifferentmetrics
andsendsthemtotheserver.Unfortunatelyfor
MNOs,though,thesefeedbackchannelsareusually
encryptedandavailableonlytotheMSP.Evenif
anMSPweretomakethemetricsavailabletothe
MNO,theywouldstillbeproprietary,anditwould
bedifficultfortheMNOtocomparethemduetothe
factthatthecontentandlevelofdetailtypicallydiffer
betweenMSPs.
3GPPQoEreporting
Theusefulnessofhavingastandardizedclient
feedbackmechanismhasbeenrecognizedby3GPP,
anditstechnicalspecificationTS26.247describes
howthiscanbeimplementedforaDASHstreaming
client[5].The3GPPconceptiscalledQoEreporting,
asthemetricscollectedandreportedarerelated
specificallytothequalityofthesession.Sensitiveor
integrity-relateddatasuchastheuser’spositionand
thecontentviewedcannotbereported.
Thebasicconceptisthatthestreamingclient
canreceiveaQoEconfigurationthatspecifiesthe
metricstobecollected,howoftencollectionwill
occur,whenreportingwillbedoneandwhichentity
toreportto.TherearethreewaystosendaQoE
configurationtotheclienttofacilitatedifferent
deploymentcases:
1.Mediapresentationdescription
Inthiscase,theclientdownloadsamedia
presentationdescription(MPD)whenstreaming
starts.TheMPDspecifieshowthemediais
structuredandhowtheclientcanaccessand
downloadthemediachunks.TheMPDcanalso
containaQoEconfigurationthatmakesitpossible
togetfeedbackfromtheclient.SincetheMPD
isusuallycontrolledbythecontentorservice
provider,theQoEreportsfromtheclientare
typicallyconfiguredtogobacktotheirserversand
arenotalwaysvisibletotheMNO.
2.OpenMobileAllianceDeviceManagement
OpenMobileAllianceDeviceManagement
(OMA-DM)hasdefinedmethodsforhowan
MNOcanconfigurecertainaspectsofconnected
devicessuchasAPNs,SMSserversandsoon.
ThesemethodsalsoincludeanoptionalQoE
THE USEFULNESS OF
HAVING A STANDARDIZED
CLIENT FEEDBACK
MECHANISM HAS BEEN
RECOGNIZED BY 3GPP
VIDEO QUALITY OF EXPERIENCE ✱
9JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW
Figure 3 Example of a video QoE microservice
✱ VIDEO QUALITY OF EXPERIENCE
10 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
configurationthatactivatesQoEreportingfrom
theclient.However,notallMNOsdeployOMA-
DMintheirnetworks.
3.RadioResourceControl
TheRadioResourceControl(RRC)protocol[6]
isusedbetweentheeNBandthemobiledevice
tocontrolthecommunicationintheRAN.The
possibilityofincludingaQoEconfigurationwas
addedin3GPPrel-14,givingMNOstheabilityto
useRRCtoactivateQoEreporting.Asaresult,
theQoEconfigurationcanbehandledlikemany
othertypesofRAN-relatedconfigurationsand
measurements.
TheQoEmetricsreportedbytheclientineach
ofthesethreemethodsarewellalignedwiththe
inputrequirementsinP.1203.Thismeansthat,
inprinciple,anyofthemwouldenableanMNO
togainagoodoverviewofthevideostreaming
qualityexperiencedbyitsusers.Beforethiscan
happen,though,thenewstandardswillneedto
bedeployedbothinthenetworkandintheclients.
DeploymentofvideoQoEestimation
Thedeliveryofover-the-topvideotodaymost
commonlyusesacloud-basedmicroservices
platformwithinbuiltvideo-qualityestimation
features.TheP.1203algorithmforestimatingvideo
qualityismostsuitableforimplementationasa
microservicethatestimatesvideoquality(interms
ofMOS)forallvideostreamsandforallindividual
videostreamingsessions.Iftheestimatedvideo
qualitydistributionshowsthatthereisaquality
issue,arootcauseanalysiscanbecarriedoutandthe
necessarymeasurescanbetakentoimprovequality.
Whenrunningamediaservice,andproviding
thevideoclientaspartoftheservice,theinput
parameterstotheP.1203algorithmaretakendirectly
fromthevideoclientthathasallthedetailsabout
theplayoutofthestreamandreportedoverthe
networktoananalyticsbackend.Figure3outlines
anexampleofsuchanimplementation,inwhich
playereventsarereportedtoastreamprocessing
system(Kafka)wherethevideoQoEiscalculated
inavideoQoEmicroservice.Theoutputfromthe
videoQoEcalculationisthenpostedbackintothe
streamprocessingsystemtobeusedformonitoring,
visualization,rootcauseanalysisandotherpurposes.
ForanMNO,thestandardarchitectureisto
installaprobeinsidethenetwork–inthecore
network,forexample.Theprobemonitorsvideo
trafficusingshallowordeeppacketinspection
andgathersinformationthatcanbeusedasinput
toaQoEestimationalgorithm(P.1203).Ifavideo
serviceisnotencrypted,therelevantmetrics
andeventsfromthevideostreamscanoftenbe
measuredorestimated.Thetaskbecomesmore
challengingifthevideostreamsareencrypted,but
qualityestimationsofthesevideostreamscanstill
bedonetosomeextentbyusingacombinationof
probesandstandardizedandproprietaryalgorithms
andmodels.However,theabilitytoreportquality-
relatedmetricsdirectfromthevideoclientsenables
muchmoreaccurateestimationofquality.
Conclusion
MNOsandMSPsstandtogainagreatdealfrom
developingabetterunderstandingofhowusers
experience video quality, and the ITU-T P.1203
and 3GPP TS 26.247 standards provides the
framework that is necessary to help them do so.
Implementation of these standards by MNOs,
MSPs and device manufacturers will enable
the efficient and accurate estimation of video
QoE required to meet continuously rising user
expectations.Thestandard’ssmarthandlingof
theeffectsofstallingeventsandqualityadaptations
makesitwellsuitedtoovercomethechallenges
presentedbyVODandbyadaptivevideo
streaminginparticular.
THE INPUT PARA­-
­METERS TO THE P.1203
ALGORITHM ARE TAKEN
DIRECTLY FROM THE
VIDEO CLIENT
VIDEO QUALITY OF EXPERIENCE ✱
11JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW
Gunnar Heikkilä
◆ is a senior specialist in
machine intelligence at
Ericsson Research. Since
1996, he has focused
on user experience
quality assessment and
measurements, including
standardization in 3GPP,
ETSI and ITU-T. He joined
Ericsson in 1987 and has
previously worked with
control system software
for military defense radar
systems, and with software
design for synchronous
digital hierarchy optical
fiber transmission systems.
Heikkilä holds an M.Sc.
in computer science
from Luleå University of
Technology, Sweden.
Jörgen Gustafsson
◆ is a research manager at
Ericsson Research, heading
a research team in the areas
of machine learning and
QoE. The research is applied
to a number of areas, such as
media, operations support
systems/business support
systems, the Internet of
Things and more. He joined
Ericsson in 1993. He is
co-rapporteurofQuestion
14 in ITU-T Study Group
12, where leading and
global standards on
parametric models and
toolsformultimediaquality
assessment are being
developed, including the
latest standards on quality
assessment of adaptive
streaming.HeholdsanM.Sc.
in computer science from
LinköpingUniversity,Sweden.
theauthors
1.	 EricssonConsumerLabreport,TVandMedia2016,availableat:https://www.ericsson.com/networked-
society/trends-and-insights/consumerlab/consumer-insights/reports/tv-and-media-2016
2.	 EricssonMobilityReport,November2016,availableat:https://www.ericsson.com/en/mobility-report
3.	 ITU-TP.910,April2008,Subjectivevideoqualityassessmentmethodsformultimediaapplications,availableat:
http://www.itu.int/itu-t/recommendations/rec.aspx?rec=9317
4.	 ITU-TP.1203,November2016,Parametricbitstream-basedqualityassessmentofprogressive
downloadandadaptiveaudiovisualstreamingservicesoverreliabletransport,availableat:
http://www.itu.int/itu-t/recommendations/rec.aspx?rec=13158
5.	 3GPP TS 26.247, January 2015, Transparent end-to-end Packet-switched Streaming Service (PSS);
Progressive Download and Dynamic Adaptive Streaming over HTTP (3GP-DASH), available at:
http://www.3gpp.org/DynaReport/26247.htm
6.	 3GPP TS 25.331, January 2016, Radio Resource Control (RRC); Protocol specification, available at:
http://www.3gpp.org/DynaReport/25331.htm
References:
✱ VIDEO QUALITY OF EXPERIENCE
12 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017
ISSN 0014-0171
284 23-3300 | Uen
© Ericsson AB 2017 Ericsson
SE-164 83 Stockholm, Sweden
Phone: +46 10 719 0000

More Related Content

What's hot

Edge computing: Cord build 17 telefonica use cases
Edge computing: Cord build 17 telefonica use casesEdge computing: Cord build 17 telefonica use cases
Edge computing: Cord build 17 telefonica use casesPatrick Lopez
 
Ericsson 5G Radio Dot Infographic
Ericsson 5G Radio Dot InfographicEricsson 5G Radio Dot Infographic
Ericsson 5G Radio Dot InfographicEricsson
 
Ericsson Technology Review: Versatile Video Coding explained – the future of ...
Ericsson Technology Review: Versatile Video Coding explained – the future of ...Ericsson Technology Review: Versatile Video Coding explained – the future of ...
Ericsson Technology Review: Versatile Video Coding explained – the future of ...Ericsson
 
Telefónica Edge Computing Case Study
Telefónica Edge Computing Case StudyTelefónica Edge Computing Case Study
Telefónica Edge Computing Case StudyDavid Artuñedo
 
Ericsson Technology Review - issue 2, 2017
Ericsson Technology Review - issue 2, 2017Ericsson Technology Review - issue 2, 2017
Ericsson Technology Review - issue 2, 2017Ericsson
 
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson
 
Ericsson Technology Review - Issue 1, 2018
Ericsson Technology Review - Issue 1, 2018Ericsson Technology Review - Issue 1, 2018
Ericsson Technology Review - Issue 1, 2018Ericsson
 
{Ca} SDN NFV in wireless networks 2015 for LTE world Summit
{Ca} SDN NFV in wireless networks 2015 for LTE world Summit{Ca} SDN NFV in wireless networks 2015 for LTE world Summit
{Ca} SDN NFV in wireless networks 2015 for LTE world SummitPatrick Lopez
 
5 g as a service (5gaas)
5 g as a service (5gaas)5 g as a service (5gaas)
5 g as a service (5gaas)Luke Wang
 
Turn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformTurn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformEricsson
 
Assuring VNF image integrity and host sealing in telco cloud
Assuring VNF image integrity and host sealing in telco cloudAssuring VNF image integrity and host sealing in telco cloud
Assuring VNF image integrity and host sealing in telco cloudShankar Lal
 
Ericsson Technology Review - Issue 2, 2018
Ericsson Technology Review - Issue 2, 2018Ericsson Technology Review - Issue 2, 2018
Ericsson Technology Review - Issue 2, 2018Ericsson
 
Ericsson Support Services
Ericsson Support Services Ericsson Support Services
Ericsson Support Services Ericsson
 
Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Mainstay
 
Edge Computing risks and Opportunities for Telco and hyperscalers
Edge Computing risks and Opportunities for Telco and hyperscalersEdge Computing risks and Opportunities for Telco and hyperscalers
Edge Computing risks and Opportunities for Telco and hyperscalersPatrick Lopez
 
Cumbre PR/AR sobre el mercado Telco en America Latina
Cumbre PR/AR sobre el mercado Telco en America LatinaCumbre PR/AR sobre el mercado Telco en America Latina
Cumbre PR/AR sobre el mercado Telco en America LatinaFelipe Lamus
 
Red Hat Summit 2017 – Telco Cloud Transformation
Red Hat Summit 2017 – Telco Cloud TransformationRed Hat Summit 2017 – Telco Cloud Transformation
Red Hat Summit 2017 – Telco Cloud TransformationEricsson
 
Orchestration in Action
Orchestration in ActionOrchestration in Action
Orchestration in ActionEricsson
 
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...Cisco Service Provider
 

What's hot (20)

Edge computing: Cord build 17 telefonica use cases
Edge computing: Cord build 17 telefonica use casesEdge computing: Cord build 17 telefonica use cases
Edge computing: Cord build 17 telefonica use cases
 
Ericsson 5G Radio Dot Infographic
Ericsson 5G Radio Dot InfographicEricsson 5G Radio Dot Infographic
Ericsson 5G Radio Dot Infographic
 
Ericsson Technology Review: Versatile Video Coding explained – the future of ...
Ericsson Technology Review: Versatile Video Coding explained – the future of ...Ericsson Technology Review: Versatile Video Coding explained – the future of ...
Ericsson Technology Review: Versatile Video Coding explained – the future of ...
 
Jonathan Newton - Vodafone
Jonathan Newton - VodafoneJonathan Newton - Vodafone
Jonathan Newton - Vodafone
 
Telefónica Edge Computing Case Study
Telefónica Edge Computing Case StudyTelefónica Edge Computing Case Study
Telefónica Edge Computing Case Study
 
Ericsson Technology Review - issue 2, 2017
Ericsson Technology Review - issue 2, 2017Ericsson Technology Review - issue 2, 2017
Ericsson Technology Review - issue 2, 2017
 
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
 
Ericsson Technology Review - Issue 1, 2018
Ericsson Technology Review - Issue 1, 2018Ericsson Technology Review - Issue 1, 2018
Ericsson Technology Review - Issue 1, 2018
 
{Ca} SDN NFV in wireless networks 2015 for LTE world Summit
{Ca} SDN NFV in wireless networks 2015 for LTE world Summit{Ca} SDN NFV in wireless networks 2015 for LTE world Summit
{Ca} SDN NFV in wireless networks 2015 for LTE world Summit
 
5 g as a service (5gaas)
5 g as a service (5gaas)5 g as a service (5gaas)
5 g as a service (5gaas)
 
Turn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformTurn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G Platform
 
Assuring VNF image integrity and host sealing in telco cloud
Assuring VNF image integrity and host sealing in telco cloudAssuring VNF image integrity and host sealing in telco cloud
Assuring VNF image integrity and host sealing in telco cloud
 
Ericsson Technology Review - Issue 2, 2018
Ericsson Technology Review - Issue 2, 2018Ericsson Technology Review - Issue 2, 2018
Ericsson Technology Review - Issue 2, 2018
 
Ericsson Support Services
Ericsson Support Services Ericsson Support Services
Ericsson Support Services
 
Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16
 
Edge Computing risks and Opportunities for Telco and hyperscalers
Edge Computing risks and Opportunities for Telco and hyperscalersEdge Computing risks and Opportunities for Telco and hyperscalers
Edge Computing risks and Opportunities for Telco and hyperscalers
 
Cumbre PR/AR sobre el mercado Telco en America Latina
Cumbre PR/AR sobre el mercado Telco en America LatinaCumbre PR/AR sobre el mercado Telco en America Latina
Cumbre PR/AR sobre el mercado Telco en America Latina
 
Red Hat Summit 2017 – Telco Cloud Transformation
Red Hat Summit 2017 – Telco Cloud TransformationRed Hat Summit 2017 – Telco Cloud Transformation
Red Hat Summit 2017 – Telco Cloud Transformation
 
Orchestration in Action
Orchestration in ActionOrchestration in Action
Orchestration in Action
 
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...
Cisco Service Provider Vision and Strategy: Business Transforming Through Inn...
 

Similar to Ericsson Technology Review: Video QoE: leveraging standards to meet rising user expectations

Reaching a Broader Audience
Reaching a Broader AudienceReaching a Broader Audience
Reaching a Broader AudienceVideoguy
 
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobilebitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and MobileBitmovin Inc
 
Any DVD Converter for iPod
 Any DVD Converter for iPod Any DVD Converter for iPod
Any DVD Converter for iPodcrysatal16
 
Iptv Third Wave Revenue Telco (Henri Setiawan)
Iptv   Third Wave Revenue Telco (Henri Setiawan)Iptv   Third Wave Revenue Telco (Henri Setiawan)
Iptv Third Wave Revenue Telco (Henri Setiawan)Henri Setiawan
 
Introducing PRESTOplay SDKs
Introducing PRESTOplay SDKsIntroducing PRESTOplay SDKs
Introducing PRESTOplay SDKscastLabs
 
ViewPlus Business Plan 1999
ViewPlus Business Plan 1999ViewPlus Business Plan 1999
ViewPlus Business Plan 1999Bernard Moon
 
IPTV with multiscreen: how to effectively deploy a connected TV strategy
IPTV with multiscreen: how to effectively deploy a connected TV strategyIPTV with multiscreen: how to effectively deploy a connected TV strategy
IPTV with multiscreen: how to effectively deploy a connected TV strategyVidya S Nath
 
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...Unified Communications Online
 
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...Cisco Service Provider
 
Nxv Presentation Value Nov 09
Nxv Presentation Value Nov 09Nxv Presentation Value Nov 09
Nxv Presentation Value Nov 09markwsmith7
 
Ott video services
Ott video servicesOtt video services
Ott video servicesaikihook
 
Sensio corporate brochure
Sensio corporate brochureSensio corporate brochure
Sensio corporate brochureSENSIO
 
Optimizing IPTV Experience: Seamless Streaming Across Multiple Devices
Optimizing IPTV Experience: Seamless Streaming Across Multiple DevicesOptimizing IPTV Experience: Seamless Streaming Across Multiple Devices
Optimizing IPTV Experience: Seamless Streaming Across Multiple DevicesXtreamehdtv
 
InAVate_March13_IPTVEssentials
InAVate_March13_IPTVEssentialsInAVate_March13_IPTVEssentials
InAVate_March13_IPTVEssentialsgenycaloisi
 
Qing niu technology_increasing_throughput_performance
Qing niu technology_increasing_throughput_performanceQing niu technology_increasing_throughput_performance
Qing niu technology_increasing_throughput_performancexband
 
IBM VideoCharger and Digital Library MediaBase.doc
IBM VideoCharger and Digital Library MediaBase.docIBM VideoCharger and Digital Library MediaBase.doc
IBM VideoCharger and Digital Library MediaBase.docVideoguy
 
O Super Guia de Media Live Streaming
O Super Guia de Media Live StreamingO Super Guia de Media Live Streaming
O Super Guia de Media Live StreamingPaulo Cristóvão
 
Architecting a Video Encoding Strategy Designed For Growth
Architecting a Video Encoding Strategy Designed For GrowthArchitecting a Video Encoding Strategy Designed For Growth
Architecting a Video Encoding Strategy Designed For GrowthZencoder
 

Similar to Ericsson Technology Review: Video QoE: leveraging standards to meet rising user expectations (20)

Reaching a Broader Audience
Reaching a Broader AudienceReaching a Broader Audience
Reaching a Broader Audience
 
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobilebitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
 
Any DVD Converter for iPod
 Any DVD Converter for iPod Any DVD Converter for iPod
Any DVD Converter for iPod
 
SVSi_Networked AV
SVSi_Networked AVSVSi_Networked AV
SVSi_Networked AV
 
Iptv Third Wave Revenue Telco (Henri Setiawan)
Iptv   Third Wave Revenue Telco (Henri Setiawan)Iptv   Third Wave Revenue Telco (Henri Setiawan)
Iptv Third Wave Revenue Telco (Henri Setiawan)
 
Introducing PRESTOplay SDKs
Introducing PRESTOplay SDKsIntroducing PRESTOplay SDKs
Introducing PRESTOplay SDKs
 
ViewPlus Business Plan 1999
ViewPlus Business Plan 1999ViewPlus Business Plan 1999
ViewPlus Business Plan 1999
 
IPTV with multiscreen: how to effectively deploy a connected TV strategy
IPTV with multiscreen: how to effectively deploy a connected TV strategyIPTV with multiscreen: how to effectively deploy a connected TV strategy
IPTV with multiscreen: how to effectively deploy a connected TV strategy
 
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
RADVISION Video Conferencing Time Tunnel at the Collaboration and Messaging S...
 
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...
An SDN Based Approach To Measuring And Optimizing ABR Video Quality Of Experi...
 
OTTCon 2010: ShiFt Happens Part 2
OTTCon 2010: ShiFt Happens Part 2OTTCon 2010: ShiFt Happens Part 2
OTTCon 2010: ShiFt Happens Part 2
 
Nxv Presentation Value Nov 09
Nxv Presentation Value Nov 09Nxv Presentation Value Nov 09
Nxv Presentation Value Nov 09
 
Ott video services
Ott video servicesOtt video services
Ott video services
 
Sensio corporate brochure
Sensio corporate brochureSensio corporate brochure
Sensio corporate brochure
 
Optimizing IPTV Experience: Seamless Streaming Across Multiple Devices
Optimizing IPTV Experience: Seamless Streaming Across Multiple DevicesOptimizing IPTV Experience: Seamless Streaming Across Multiple Devices
Optimizing IPTV Experience: Seamless Streaming Across Multiple Devices
 
InAVate_March13_IPTVEssentials
InAVate_March13_IPTVEssentialsInAVate_March13_IPTVEssentials
InAVate_March13_IPTVEssentials
 
Qing niu technology_increasing_throughput_performance
Qing niu technology_increasing_throughput_performanceQing niu technology_increasing_throughput_performance
Qing niu technology_increasing_throughput_performance
 
IBM VideoCharger and Digital Library MediaBase.doc
IBM VideoCharger and Digital Library MediaBase.docIBM VideoCharger and Digital Library MediaBase.doc
IBM VideoCharger and Digital Library MediaBase.doc
 
O Super Guia de Media Live Streaming
O Super Guia de Media Live StreamingO Super Guia de Media Live Streaming
O Super Guia de Media Live Streaming
 
Architecting a Video Encoding Strategy Designed For Growth
Architecting a Video Encoding Strategy Designed For GrowthArchitecting a Video Encoding Strategy Designed For Growth
Architecting a Video Encoding Strategy Designed For Growth
 

More from Ericsson

Ericsson Technology Review: issue 2, 2020
 Ericsson Technology Review: issue 2, 2020 Ericsson Technology Review: issue 2, 2020
Ericsson Technology Review: issue 2, 2020Ericsson
 
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...Ericsson Technology Review: Integrated access and backhaul – a new type of wi...
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...Ericsson
 
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...Ericsson
 
Ericsson Technology Review: The future of cloud computing: Highly distributed...
Ericsson Technology Review: The future of cloud computing: Highly distributed...Ericsson Technology Review: The future of cloud computing: Highly distributed...
Ericsson Technology Review: The future of cloud computing: Highly distributed...Ericsson
 
Ericsson Technology Review: Optimizing UICC modules for IoT applications
Ericsson Technology Review: Optimizing UICC modules for IoT applicationsEricsson Technology Review: Optimizing UICC modules for IoT applications
Ericsson Technology Review: Optimizing UICC modules for IoT applicationsEricsson
 
Ericsson Technology Review: issue 1, 2020
Ericsson Technology Review: issue 1, 2020Ericsson Technology Review: issue 1, 2020
Ericsson Technology Review: issue 1, 2020Ericsson
 
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economy
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economyEricsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economy
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economyEricsson
 
Ericsson Technology Review: 5G migration strategy from EPS to 5G system
Ericsson Technology Review: 5G migration strategy from EPS to 5G systemEricsson Technology Review: 5G migration strategy from EPS to 5G system
Ericsson Technology Review: 5G migration strategy from EPS to 5G systemEricsson
 
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystem
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystemEricsson Technology Review: Creating the next-generation edge-cloud ecosystem
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystemEricsson
 
Ericsson Technology Review: Issue 2/2019
Ericsson Technology Review: Issue 2/2019Ericsson Technology Review: Issue 2/2019
Ericsson Technology Review: Issue 2/2019Ericsson
 
Ericsson Technology Review: Spotlight on the Internet of Things
Ericsson Technology Review: Spotlight on the Internet of ThingsEricsson Technology Review: Spotlight on the Internet of Things
Ericsson Technology Review: Spotlight on the Internet of ThingsEricsson
 
Ericsson Technology Review - Technology Trends 2019
Ericsson Technology Review - Technology Trends 2019Ericsson Technology Review - Technology Trends 2019
Ericsson Technology Review - Technology Trends 2019Ericsson
 
Ericsson Technology Review: Driving transformation in the automotive and road...
Ericsson Technology Review: Driving transformation in the automotive and road...Ericsson Technology Review: Driving transformation in the automotive and road...
Ericsson Technology Review: Driving transformation in the automotive and road...Ericsson
 
SD-WAN Orchestration
SD-WAN OrchestrationSD-WAN Orchestration
SD-WAN OrchestrationEricsson
 
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...Ericsson Technology Review: 5G-TSN integration meets networking requirements ...
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...Ericsson
 
Ericsson Technology Review: Meeting 5G latency requirements with inactive state
Ericsson Technology Review: Meeting 5G latency requirements with inactive stateEricsson Technology Review: Meeting 5G latency requirements with inactive state
Ericsson Technology Review: Meeting 5G latency requirements with inactive stateEricsson
 
Ericsson Technology Review: Cloud-native application design in the telecom do...
Ericsson Technology Review: Cloud-native application design in the telecom do...Ericsson Technology Review: Cloud-native application design in the telecom do...
Ericsson Technology Review: Cloud-native application design in the telecom do...Ericsson
 
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...Ericsson Technology Review: Service exposure: a critical capability in a 5G w...
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...Ericsson
 
Ericsson Technology Review - Issue 1, 2019
Ericsson Technology Review - Issue 1, 2019Ericsson Technology Review - Issue 1, 2019
Ericsson Technology Review - Issue 1, 2019Ericsson
 
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...Ericsson
 

More from Ericsson (20)

Ericsson Technology Review: issue 2, 2020
 Ericsson Technology Review: issue 2, 2020 Ericsson Technology Review: issue 2, 2020
Ericsson Technology Review: issue 2, 2020
 
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...Ericsson Technology Review: Integrated access and backhaul – a new type of wi...
Ericsson Technology Review: Integrated access and backhaul – a new type of wi...
 
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...
Ericsson Technology Review: Critical IoT connectivity: Ideal for time-critica...
 
Ericsson Technology Review: The future of cloud computing: Highly distributed...
Ericsson Technology Review: The future of cloud computing: Highly distributed...Ericsson Technology Review: The future of cloud computing: Highly distributed...
Ericsson Technology Review: The future of cloud computing: Highly distributed...
 
Ericsson Technology Review: Optimizing UICC modules for IoT applications
Ericsson Technology Review: Optimizing UICC modules for IoT applicationsEricsson Technology Review: Optimizing UICC modules for IoT applications
Ericsson Technology Review: Optimizing UICC modules for IoT applications
 
Ericsson Technology Review: issue 1, 2020
Ericsson Technology Review: issue 1, 2020Ericsson Technology Review: issue 1, 2020
Ericsson Technology Review: issue 1, 2020
 
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economy
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economyEricsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economy
Ericsson Technology Review: 5G BSS: Evolving BSS to fit the 5G economy
 
Ericsson Technology Review: 5G migration strategy from EPS to 5G system
Ericsson Technology Review: 5G migration strategy from EPS to 5G systemEricsson Technology Review: 5G migration strategy from EPS to 5G system
Ericsson Technology Review: 5G migration strategy from EPS to 5G system
 
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystem
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystemEricsson Technology Review: Creating the next-generation edge-cloud ecosystem
Ericsson Technology Review: Creating the next-generation edge-cloud ecosystem
 
Ericsson Technology Review: Issue 2/2019
Ericsson Technology Review: Issue 2/2019Ericsson Technology Review: Issue 2/2019
Ericsson Technology Review: Issue 2/2019
 
Ericsson Technology Review: Spotlight on the Internet of Things
Ericsson Technology Review: Spotlight on the Internet of ThingsEricsson Technology Review: Spotlight on the Internet of Things
Ericsson Technology Review: Spotlight on the Internet of Things
 
Ericsson Technology Review - Technology Trends 2019
Ericsson Technology Review - Technology Trends 2019Ericsson Technology Review - Technology Trends 2019
Ericsson Technology Review - Technology Trends 2019
 
Ericsson Technology Review: Driving transformation in the automotive and road...
Ericsson Technology Review: Driving transformation in the automotive and road...Ericsson Technology Review: Driving transformation in the automotive and road...
Ericsson Technology Review: Driving transformation in the automotive and road...
 
SD-WAN Orchestration
SD-WAN OrchestrationSD-WAN Orchestration
SD-WAN Orchestration
 
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...Ericsson Technology Review: 5G-TSN integration meets networking requirements ...
Ericsson Technology Review: 5G-TSN integration meets networking requirements ...
 
Ericsson Technology Review: Meeting 5G latency requirements with inactive state
Ericsson Technology Review: Meeting 5G latency requirements with inactive stateEricsson Technology Review: Meeting 5G latency requirements with inactive state
Ericsson Technology Review: Meeting 5G latency requirements with inactive state
 
Ericsson Technology Review: Cloud-native application design in the telecom do...
Ericsson Technology Review: Cloud-native application design in the telecom do...Ericsson Technology Review: Cloud-native application design in the telecom do...
Ericsson Technology Review: Cloud-native application design in the telecom do...
 
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...Ericsson Technology Review: Service exposure: a critical capability in a 5G w...
Ericsson Technology Review: Service exposure: a critical capability in a 5G w...
 
Ericsson Technology Review - Issue 1, 2019
Ericsson Technology Review - Issue 1, 2019Ericsson Technology Review - Issue 1, 2019
Ericsson Technology Review - Issue 1, 2019
 
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...
Ericsson Technology Review: Boosting smart manufacturing with 5G wireless con...
 

Recently uploaded

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 

Recently uploaded (20)

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 

Ericsson Technology Review: Video QoE: leveraging standards to meet rising user expectations

  • 1. ERICSSON TECHNOLOGY C H A R T I N G T H E F U T U R E O F I N N O V A T I O N | # 6 ∙ 2 0 1 7 LEVERAGING STANDARDSFOR VIDEO QoE
  • 2. ✱ VIDEO QUALITY OF EXPERIENCE 2 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 GUNNAR HEIKKILÄ, JÖRGEN GUSTAFSSON In 2016, Ericsson ConsumerLab found that the average person watches 90 minutes more TV and video every day than they did in 2012 [1]. While traditionally broadcast linear TV is still popular with many viewers, internet-based TV and video delivery and video on demand (VOD) services are all growing rapidly. In fact, 20 percent of video consumption occurred on handheld devices in 2016 [1]. ■Asusersbecomemoreaccustomedtovideo streamingservices,theirqualityexpectations rise,presentingabigchallengeformediaservice providers(MSPs)andmobilenetworkoperators (MNOs).Whiledeliveringhigh-qualityvideo overafixedconnectioncanbedifficult,doingso wirelesslyisamuchmoredemandingundertaking. Yetby2022,75percentofallmobiledatatrafficis expectedtocomefromvideo,accordingtothe2016 EricssonMobilityReport[2]. At the same time, TV screens are getting larger, which requires higher video resolution. High definition (HD) is now the new baseline, and ultra high definition (UHD) is coming to both fixed and mobile devices, demanding higher bandwidth. To provide a consistently high QoE – particularly in wireless cases with significant fluctuations in available bandwidth – both MSPs and MNOs must have a clear understanding of which impairments their users are experiencing and be able to accurately assess their perception of video quality. ‘How happy are our users with their video experience?’ has become a vital question for mobile network operators and media service providers alike. New standards for QoE testing have the potential to help them ensure that they are able to meet user expectations for the service that will account for three-quarters of mobile network traffic in five years’ time. VideoQoELEVERAGING STANDARDS TO MEET RISING USER EXPECTATIONS
  • 3. VIDEO QUALITY OF EXPERIENCE ✱ 3JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW AdaptiveHTTP-basedstreaming AdaptiveHTTP-basedvideostreamingvariants suchasDASHandHLSarethedominantvideo deliverymethodusedtoday.Theirstreaming serversprovideseveralversionsofthesamevideo, eachseparatelyencodedtooffervaryinglevelsof quality.Thestreamingclientintheuser’sphone, tabletorPCdynamicallyswitchesbetweenthe differentversionsduringplayoutdependingonhow muchnetworkbitrateisavailable. Iftheavailablenetworkbitrateishigh,theclient willdownloadthebest-qualityversion.Ifthebitrate suddenlydrops,theclientwillswitchtoalower- qualityversionuntilconditionsimprove.The purposeofthisistoavoidstalling(whentheclient stopsplayoutintermittentlytofillitsvideobuffer)– whichisknowntoannoyusers. Whiletheabilitytoswitchintermittentlybetween versionsofavideosignificantlydecreasestheriskof stalling,thequalityvariationsthatthisleadstocan alsobeannoyingfortheuser.Figure1providesan exampleofaworst-casescenariowithbothquality variationsandastallingevent,whichwouldresult inanoveralllow-qualityexperiencefortheuser. Subjectivequality ITU-T P.910 [3] is the recognized standard for performing subjective video quality tests. The tests are carried out in a lab equipped with mobile phones, tablets, PCs or TVs, where a number of videos are shown to a group of individuals. Each individual then grades each video according to their subjective perception of its quality, selecting one of the following scores: 5 (excellent), 4 (very good), 3 (good), 2 (fair) or 1 (poor). Finally, the average score for each video is calculated. This number is known as the mean opinion score (MOS). The video sequences are typically produced in a lab environment so that all types of impairments can be included. High-quality sports, nature and news videos are used as a starting point. Impairments (codec settings, rate and resolution changes, initial buffering, stalling and so on) are then emulated by varying the bitrate over a certain range, for example, or placing stalling events of different lengths at various points in the videos. Thetestsaredesignedtomakeanalysisas accurateandstraightforwardaspossible.Devising subjectivetestsisatimeconsumingandexpensive process,though,andlabtestscan’tassessexactly whatanMNO’srealusersareexperiencing.The bestwaytoovercomethesechallengesisbyusing objectivequalityalgorithms. THE TESTS ARE DESIGNED TO MAKE ANALYSIS AS ACCURATE AND STRAIGHTFORWARD AS POSSIBLE Terms and abbreviations APN–AccessPointName|AVC–advancedvideocoding|DASH–DynamicAdaptiveStreamingoverHTTP| DM–devicemanagement|eNB–eNodeB(LTEbasestation)|ETSI–EuropeanTelecommunicationsStandards Institute|HD–highdefinition|HEVC–HighEfficiencyVideoCoding|HLS–HTTPLiveStreaming|HTTP–Hypertext TransferProtocol|ITU-T–InternationalTelecommunicationUnionTelecommunicationStandardizationSector| MNO–mobilenetworkoperator|MOS–meanopinionscore|MPD–mediapresentationdescription|MSP–media serviceprovider|OMA–OpenMobileAlliance|Pa–short-termaudiopredictor|Pq–long-termqualitypredictor| Pv–short-termvideopredictor|QoE–qualityofexperience|RRC–RadioResourceControl|SMS–shortmessage service|UHD–ultrahighdefinition|VOD–videoondemand|VP9–Anopen-sourcevideoformatandcodec
  • 4. ✱ VIDEO QUALITY OF EXPERIENCE 4 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 Figure 1 A 60-second video with quality variations (resolution) and a three-second stall in the middle
  • 5. VIDEO QUALITY OF EXPERIENCE ✱ 5JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW Objectivequality Asthewordingsuggests,objectivequality algorithms(alsoknownasobjectivemodels)are designedtomimicthebehaviorandperceptionof humans.Thegoalistoproducethesamescoresas theMOSvaluesthatwouldresultfromrunninga subjectivetestonthesamevideos. Manydifferenttypesofobjectivemodelscan beadopted,dependingontheintendedusage andthekindofinputdataemployed.Thoseusing themostlimitedsetofinputparametersbasethe objectivequalityestimationonencodingrates, videoresolution,framerates,codecsandstalling information,asthesefactorsprovidetheminimum amountofinformationaboutthevideoplayout thatisrequiredtoestimateaqualityscore.More complexmodelsmightusethecompleteencoded videobitstream,oreventhefullreceivedvideo signal,tofurtherincreasetheestimationaccuracy. Theobjectivemodelsdescribedaboveare no-referencemodels,whereinputistakenonly fromthereceivingendofthemediadistribution chain.Full-referencemodelscanalsobeadopted, wherethevideooriginallytransmittedis comparedwiththeonethatisreceived.Another variantisthereduced-referencemodel,where theoriginalvideoisnotneededforreference,but certaininformationaboutitismadeavailableto themodel. Traditionally,objectivemodelsareusedto evaluatequalitybasedonrelativelyshortvideo sequences:approximately10secondslong. However,withadaptivevideostreaming,where qualitycanvarysignificantlyduringagiven session,themodelmustalsoassesshowthislong- termvariationaffectsuserperception.Todothis, modelevaluationofmuchlongervideosequences (uptoseveralminutes)isrequired. Ideally,differentlevelsofcomplexityshouldbe usablebyasinglemodel–thatis,fromonlyafew inputparametersuptothefullbitstream,depending ondeployment.Thisisthescopethatapplieswith thenewno-referenceITU-TP.1203standard. StandardizationofITU-TP.1203 TheP.1203standard[4]wasdevelopedaspart ofanITU-Tcompetitionbetweenparticipating proponents(Ericssonandsixothercompanies), whereeachonesentinitsproposedquality models.Themodelsthatperformedbestwere thenusedasabaselinetocreatethefinalstandard. Aninternalmodelarchitecturewasalsodefinedto facilitatethecreationofamodelthatwouldbeas flexibleaspossible. Architecture Thestandardincludesmodulesforestimatingshort- termaudioandvideoquality,andanintegration moduleestimatingthefinalsessionqualitydueto adaptationandstalling,asshowninFigure2. Theshort-termvideoandaudiopredictor(Pv andPa)modulescontinuouslyestimatetheshort- termaudioandvideoqualityscoresforone-second piecesofcontent.Thismeansthatfora60-second video,therewillbe60audioscoresand60video scores.ThesePvandPamodulesarespecificto eachtypeofcodec. ThePvandPamodulesoperateinuptofour differentmodes,dependingonhowdetailedthe inputisfromtheparameterextraction.Forthe leastcomplexmode,themaininputsarerelatedto resolution,bitrateandframerate,whilethemost complexmodeperformsadvancedanalysisofthe videopayload. Theshort-termscoresfromthosemodules arefedintothelong-termqualitypredictor(Pq) module,togetherwithanystallinginformation, andthefinalsessionqualityscoreforthetotal videosessionisthenestimated.ThePqmodule alsoproducesanumberofdiagnosticoutputs, sothattheunderlyingcausesofthescorecanbe analyzed.ThePqmoduleisnotmode-orcodec- dependentandisthereforecommonforallcases. IDEALLY, DIFFERENT LEVELS OF COMPLEXITY SHOULD BE USABLE BY A SINGLE MODEL
  • 6. ✱ VIDEO QUALITY OF EXPERIENCE 6 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 Figure 2 ITU-T P.1203 architecture
  • 7. VIDEO QUALITY OF EXPERIENCE ✱ 7JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW Training InthedevelopmentandstandardizationofP.1203, alargenumberofsubjectivetestdatabaseswere created,eachcontainingvideosthatweregraded byatleast24testindividuals.Animportantgoal setinthedevelopmentofP.1203wastohandlethe long-termperceivedeffectsofstallingeventsand qualityadaptations. Thus,incontrasttotraditionalsubjectivetests inwhichafew10-secondvideosaretypically repeated,thevideosusedforP.1203wereall uniqueandbetweenoneandfiveminutes long.Itwasimportanttoavoidrepetitionand continuouslypresentnewtestvideosthatthe viewersfoundinterestingenoughtopayattention tothroughouttheplayout.Thetestsweredoneon mobiledevicesaswellasoncomputermonitors andTVscreens,tocoverallthedifferentusecases. Validation SincethedevelopmentoftheP.1203standardization wasrunasacompetition,theperformanceofthe differentproponentmodelsrequiredvalidation, andthevalidationcouldnotbecarriedoutonany existingdatabases.Instead,afterthesubmissionof alloftheproponents’candidatemodelstoITU-T, alltheproponentsworkedtogethertodesigna newsetofdatabases,witheachstepdistributed todifferentproponentssothatnonehadcomplete controloveranyindividualdatabase. Thenewsetofvalidationdatabaseswere thenusedtoevaluatethemodels,andthetop- performingoneswereselectedtoformthe P.1203standard.Incaseswheretherespective performanceofseveralproponentmoduleswasso closethatastatisticaltestcouldnottellthemapart, themodulesweremergedtoformasinglestandard withoutalternativeimplementations. Finalmodel WhilethePvandPamodulesweredevelopedusing traditionalanalyticalmethodsandimplementedas aseriesofmathematicalfunctions,thePqmodule ismoreadvanced.Thismoduleisdividedinto twoseparateestimationalgorithms:oneusing atraditionalfunctionalapproachandtheother basedonmachine-learningconcepts. Thefunctionalvariantmodelshuman perception,asinfluencedbytheeffectofquality oscillations,deepqualitydips,repeatedquality orstallingartifactsandtheabilitytomemorize. Alloftheseeffectsaredescribedbymathematical functions(astheyareforthePvandPamodules), whicharethencombinedtoestimatetheuser’stotal perceptionofquality. Machinelearningisamethodthatsolvesa problemwiththesupportofself-learningcomputer algorithms.Itiswellsuitedforproblemswherethe relationshipbetweentheinputandtheoutputis complex,asinthePqmodule.Duringthedesign andtrainingphase,thealgorithmsautomatically identifyhowvariouscharacteristicsoftheinput data(Pv/Pascoresandstallingparameters) arereflectedinchangestotheoutputdata(the testpanelMOSvalues).Thealgorithmthen automaticallybuildsablack-boxalgorithm,which implementsthefinalmachine-trainedsolutionand estimatestheuserscore. ThefinalPqMOSestimateisaweightedaverage oftheoutputfromthetraditionalfunctional algorithmandthemachine-learning-basedone. OneoftheadvantagesofusingtwodifferentPq algorithmsisthattheyhavestatisticallyindependent estimationerrors,andwhenthetwoscoresare averaged,theactualerrorbecomessmaller. Futurestandardizationwork ThevideomodulecurrentlysupportsH.264/ AVCvideocodecsuptoHD(1920x1080).Anew workitemhasbeenstartedinITU-T,whichwill resultinarecommendationthatalsosupports H.265/HEVCandVP9videocodecsuptoUHD resolution(3840x2160).Thisworkitemisrunning inasimilarfashiontoP.1203,withacompetition givingparticipatingcompaniestheopportunityto submittheirownproposedmodels.
  • 8. ✱ VIDEO QUALITY OF EXPERIENCE 8 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 Implementingaqualitymodel Successfulimplementationofaqualitymodelis dependentonaccesstotheinputdatarequiredby themodelitself.Themostdemandingmodels,such asfull-referencevariants,areusuallyimplemented closetothevideostreamingclient,insidethedevice, sothatthecompletereceivedvideocanbecompared withtheonesent.Thisistypicallydoneformanual testingscenarios,whereaspecialtestphoneisused inwhichaqualitymodelhasbeenimplemented. Thismethodisnotfeasibleforpassive measurements,wherealloralargepartoflivevideo trafficismonitored,somodelinputdataneedsto becollectedinanotherway.Forexample,anMNO thatwantstogainabetterunderstandingofits overallperceivedvideostreamingqualitywould needtocollectdatafromallstreamingsessions. Onewayofdoingthiswouldbetointerceptthe trafficatcertainnetworknodesandusethetraffic contentandpatterntotrytoinferwhichserviceis beingusedandthequalitylevelbeingdelivered. Thiscanbedifficult,however,owingtothefact thatmanyservicesarenowencrypted,which significantlylimitsaccesstothedatarequiredtodo adetailedqualityestimation. Onewaytoovercomethischallengeiswiththe helpofthestreamingclient,whichhasfullknowledge ofwhatishappeningduringthevideosession.A feedbacklinkfromthestreamingclientcanbeused toreportselectedmetricstothenetwork(orthe originalstreamingserver)wherethequalitycanbe estimated.Thistechniqueisalreadyusedinternally formanystreamingservices.Forexample,whena userclicksonavideolinkontheinternet,theclient typicallycontinuouslymeasuresdifferentmetrics andsendsthemtotheserver.Unfortunatelyfor MNOs,though,thesefeedbackchannelsareusually encryptedandavailableonlytotheMSP.Evenif anMSPweretomakethemetricsavailabletothe MNO,theywouldstillbeproprietary,anditwould bedifficultfortheMNOtocomparethemduetothe factthatthecontentandlevelofdetailtypicallydiffer betweenMSPs. 3GPPQoEreporting Theusefulnessofhavingastandardizedclient feedbackmechanismhasbeenrecognizedby3GPP, anditstechnicalspecificationTS26.247describes howthiscanbeimplementedforaDASHstreaming client[5].The3GPPconceptiscalledQoEreporting, asthemetricscollectedandreportedarerelated specificallytothequalityofthesession.Sensitiveor integrity-relateddatasuchastheuser’spositionand thecontentviewedcannotbereported. Thebasicconceptisthatthestreamingclient canreceiveaQoEconfigurationthatspecifiesthe metricstobecollected,howoftencollectionwill occur,whenreportingwillbedoneandwhichentity toreportto.TherearethreewaystosendaQoE configurationtotheclienttofacilitatedifferent deploymentcases: 1.Mediapresentationdescription Inthiscase,theclientdownloadsamedia presentationdescription(MPD)whenstreaming starts.TheMPDspecifieshowthemediais structuredandhowtheclientcanaccessand downloadthemediachunks.TheMPDcanalso containaQoEconfigurationthatmakesitpossible togetfeedbackfromtheclient.SincetheMPD isusuallycontrolledbythecontentorservice provider,theQoEreportsfromtheclientare typicallyconfiguredtogobacktotheirserversand arenotalwaysvisibletotheMNO. 2.OpenMobileAllianceDeviceManagement OpenMobileAllianceDeviceManagement (OMA-DM)hasdefinedmethodsforhowan MNOcanconfigurecertainaspectsofconnected devicessuchasAPNs,SMSserversandsoon. ThesemethodsalsoincludeanoptionalQoE THE USEFULNESS OF HAVING A STANDARDIZED CLIENT FEEDBACK MECHANISM HAS BEEN RECOGNIZED BY 3GPP
  • 9. VIDEO QUALITY OF EXPERIENCE ✱ 9JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW Figure 3 Example of a video QoE microservice
  • 10. ✱ VIDEO QUALITY OF EXPERIENCE 10 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 configurationthatactivatesQoEreportingfrom theclient.However,notallMNOsdeployOMA- DMintheirnetworks. 3.RadioResourceControl TheRadioResourceControl(RRC)protocol[6] isusedbetweentheeNBandthemobiledevice tocontrolthecommunicationintheRAN.The possibilityofincludingaQoEconfigurationwas addedin3GPPrel-14,givingMNOstheabilityto useRRCtoactivateQoEreporting.Asaresult, theQoEconfigurationcanbehandledlikemany othertypesofRAN-relatedconfigurationsand measurements. TheQoEmetricsreportedbytheclientineach ofthesethreemethodsarewellalignedwiththe inputrequirementsinP.1203.Thismeansthat, inprinciple,anyofthemwouldenableanMNO togainagoodoverviewofthevideostreaming qualityexperiencedbyitsusers.Beforethiscan happen,though,thenewstandardswillneedto bedeployedbothinthenetworkandintheclients. DeploymentofvideoQoEestimation Thedeliveryofover-the-topvideotodaymost commonlyusesacloud-basedmicroservices platformwithinbuiltvideo-qualityestimation features.TheP.1203algorithmforestimatingvideo qualityismostsuitableforimplementationasa microservicethatestimatesvideoquality(interms ofMOS)forallvideostreamsandforallindividual videostreamingsessions.Iftheestimatedvideo qualitydistributionshowsthatthereisaquality issue,arootcauseanalysiscanbecarriedoutandthe necessarymeasurescanbetakentoimprovequality. Whenrunningamediaservice,andproviding thevideoclientaspartoftheservice,theinput parameterstotheP.1203algorithmaretakendirectly fromthevideoclientthathasallthedetailsabout theplayoutofthestreamandreportedoverthe networktoananalyticsbackend.Figure3outlines anexampleofsuchanimplementation,inwhich playereventsarereportedtoastreamprocessing system(Kafka)wherethevideoQoEiscalculated inavideoQoEmicroservice.Theoutputfromthe videoQoEcalculationisthenpostedbackintothe streamprocessingsystemtobeusedformonitoring, visualization,rootcauseanalysisandotherpurposes. ForanMNO,thestandardarchitectureisto installaprobeinsidethenetwork–inthecore network,forexample.Theprobemonitorsvideo trafficusingshallowordeeppacketinspection andgathersinformationthatcanbeusedasinput toaQoEestimationalgorithm(P.1203).Ifavideo serviceisnotencrypted,therelevantmetrics andeventsfromthevideostreamscanoftenbe measuredorestimated.Thetaskbecomesmore challengingifthevideostreamsareencrypted,but qualityestimationsofthesevideostreamscanstill bedonetosomeextentbyusingacombinationof probesandstandardizedandproprietaryalgorithms andmodels.However,theabilitytoreportquality- relatedmetricsdirectfromthevideoclientsenables muchmoreaccurateestimationofquality. Conclusion MNOsandMSPsstandtogainagreatdealfrom developingabetterunderstandingofhowusers experience video quality, and the ITU-T P.1203 and 3GPP TS 26.247 standards provides the framework that is necessary to help them do so. Implementation of these standards by MNOs, MSPs and device manufacturers will enable the efficient and accurate estimation of video QoE required to meet continuously rising user expectations.Thestandard’ssmarthandlingof theeffectsofstallingeventsandqualityadaptations makesitwellsuitedtoovercomethechallenges presentedbyVODandbyadaptivevideo streaminginparticular. THE INPUT PARA­- ­METERS TO THE P.1203 ALGORITHM ARE TAKEN DIRECTLY FROM THE VIDEO CLIENT
  • 11. VIDEO QUALITY OF EXPERIENCE ✱ 11JUNE 27, 2017 ✱ ERICSSON TECHNOLOGY REVIEW Gunnar Heikkilä ◆ is a senior specialist in machine intelligence at Ericsson Research. Since 1996, he has focused on user experience quality assessment and measurements, including standardization in 3GPP, ETSI and ITU-T. He joined Ericsson in 1987 and has previously worked with control system software for military defense radar systems, and with software design for synchronous digital hierarchy optical fiber transmission systems. Heikkilä holds an M.Sc. in computer science from Luleå University of Technology, Sweden. Jörgen Gustafsson ◆ is a research manager at Ericsson Research, heading a research team in the areas of machine learning and QoE. The research is applied to a number of areas, such as media, operations support systems/business support systems, the Internet of Things and more. He joined Ericsson in 1993. He is co-rapporteurofQuestion 14 in ITU-T Study Group 12, where leading and global standards on parametric models and toolsformultimediaquality assessment are being developed, including the latest standards on quality assessment of adaptive streaming.HeholdsanM.Sc. in computer science from LinköpingUniversity,Sweden. theauthors 1. EricssonConsumerLabreport,TVandMedia2016,availableat:https://www.ericsson.com/networked- society/trends-and-insights/consumerlab/consumer-insights/reports/tv-and-media-2016 2. EricssonMobilityReport,November2016,availableat:https://www.ericsson.com/en/mobility-report 3. ITU-TP.910,April2008,Subjectivevideoqualityassessmentmethodsformultimediaapplications,availableat: http://www.itu.int/itu-t/recommendations/rec.aspx?rec=9317 4. ITU-TP.1203,November2016,Parametricbitstream-basedqualityassessmentofprogressive downloadandadaptiveaudiovisualstreamingservicesoverreliabletransport,availableat: http://www.itu.int/itu-t/recommendations/rec.aspx?rec=13158 5. 3GPP TS 26.247, January 2015, Transparent end-to-end Packet-switched Streaming Service (PSS); Progressive Download and Dynamic Adaptive Streaming over HTTP (3GP-DASH), available at: http://www.3gpp.org/DynaReport/26247.htm 6. 3GPP TS 25.331, January 2016, Radio Resource Control (RRC); Protocol specification, available at: http://www.3gpp.org/DynaReport/25331.htm References:
  • 12. ✱ VIDEO QUALITY OF EXPERIENCE 12 ERICSSON TECHNOLOGY REVIEW ✱ JUNE 27, 2017 ISSN 0014-0171 284 23-3300 | Uen © Ericsson AB 2017 Ericsson SE-164 83 Stockholm, Sweden Phone: +46 10 719 0000