Multimedia applications, mainly video streaming services, are currently the dominant source of network load worldwide. In recent Video-on-Demand (VoD) and live video streaming services, traditional streaming delivery techniques have been replaced by adaptive solutions based on the HTTP protocol. Current trends toward high-resolution (e.g., 8K) and/or low- latency VoD and live video streaming pose new challenges to end-to-end (E2E) bandwidth demand and have stringent delay requirements. To do this, video providers typically rely on Content Delivery Networks (CDNs) to ensure that they provide scalable video streaming services. To support future streaming scenarios involving millions of users, it is necessary to increase the CDNs’ efficiency. It is widely agreed that these requirements may be satisfied by adopting emerging networking techniques to present Network-Assisted Video Streaming (NAVS) methods. Motivated by this, this thesis goes one step beyond traditional pure client- based HAS algorithms by incorporating (an) in-network component(s) with a broader view of the network to present completely transparent NAVS solutions for HAS clients.
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsAlpen-Adria-Universität
5G and 6G networks are expected to support various novel emerging adaptive video streaming services (e.g., live, VoD, immersive media, and online gaming) with versatile Quality of Experience (QoE) requirements such as high bitrate, low latency, and sufficient reliability. It is widely agreed that these requirements can be satisfied by adopting emerging networking paradigms like Software-Defined Networking (SDN), Network Function Virtualization (NFV), and edge computing. Previous studies have leveraged these paradigms to present network-assisted video streaming frameworks, but mostly in isolation without devising chains of Virtualized Network Functions (VNFs) that consider the QoE requirements of various types of Multimedia Services (MS). To bridge the aforementioned gaps, we first introduce a set of multimedia VNFs at the edge of an SDN-enabled network, form diverse Service Function Chains (SFCs) based on the QoE requirements of different MS services. We then propose SARENA, an SFC-enabled ArchitectuRe for adaptive VidEo StreamiNg Applications. Next, we formulate the problem as a central scheduling optimization model executed at the SDN controller. We also present a lightweight heuristic solution consisting of two phases that run on the SDN controller and edge servers to alleviate the time complexity of the optimization model in
large-scale scenarios. Finally, we design a large-scale cloud-based testbed, including 250 HTTP Adaptive Streaming (HAS) players requesting two popular MS applications (i.e., live and VoD), conduct various experiments, and compare its effectiveness with baseline systems. Experimental results illustrate that SARENA outperforms baseline schemes in terms of users’ QoE by at least 39.6%, latency by 29.3%, and network utilization by 30% in both MS services.
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningAlpen-Adria-Universität
Video is evolving into a crucial tool as daily lives are increasingly centered around visual communication. The demand for better video content is constantly rising, from entertainment to business meetings. The delivery of video content to users is of utmost significance. HTTP adaptive streaming, in which the video content adjusts to the changing network circumstances, has become the de-facto method for delivering internet video.
As video technology continues to advance, it presents a number of challenges, one of which is the large amount of data required to describe a video accurately. To address this issue, it is necessary to have a powerful video encoding tool. Historically, these efforts have relied on hand-crafted tools and heuristics. However, with the recent advances in machine learning, there has been increasing exploration into using these techniques to enhance video coding performance.
This thesis proposes eight contributions that enhance video coding performance for HTTP adaptive streaming using machine learning.
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningEkrem Çetinkaya
Thesis Presentation - Ekrem Çetinkaya
Video is evolving into a crucial tool as daily lives are increasingly centered around visual communication. The demand for better video content is constantly rising, from entertainment to business meetings. The delivery of video content to users is of utmost significance. HTTP adaptive streaming, in which the video content adjusts to the changing network circumstances, has become the de-facto method for delivering internet video. As video technology continues to advance, it presents a number of challenges, one of which is the large amount of data required to describe a video accurately. To address this issue, it is necessary to have a powerful video encoding tool. Historically, these efforts have relied on hand-crafted tools and heuristics. However, with the recent advances in machine learning, there has been increasing exploration into using these techniques to enhance video coding performance. This thesis proposes eight contributions that enhance video coding performance for HTTP adaptive streaming using machine learning.
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video StreamingAlpen-Adria-Universität
Recently, HTTP Adaptive Streaming (HAS) has become the dominant video delivery technology over the Internet. In HAS, clients have full control over the media streaming and adaptation processes. Lack of coordination among the clients and lack of awareness of the network conditions may lead to sub-optimal user experience, and resource utilization in a pure client-based HAS adaptation scheme. Software-Defined Networking (SDN) has recently been considered to enhance the video streaming process. In this paper, we leverage the capability of SDN and Network Function Virtualization (NFV) to introduce an edge- and SDN-assisted video streaming framework called ES-HAS. We employ virtualized edge components to collect HAS clients’ requests and retrieve networking information in a time-slotted manner. These components then perform an optimization model in a time-slotted manner to efficiently serve clients’ requests by selecting an optimal cache server (with the shortest fetch time). In case of a cache miss, a client’s request is served (i) by an optimal replacement quality (only better quality levels with minimum deviation) from a cache server, or (ii) by the originally requested quality level from the origin server. This approach is validated through experiments on a large-scale testbed, and the performance of our framework is compared to pure client-based strategies and the SABR system [11]. Although SABR and ES-HAS show (almost) identical performance in the number of quality switches, ES-HAS outperforms SABR in terms of playback bitrate and the number of stalls by at least 70% and 40%, respectively.
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video StreamingAlpen-Adria-Universität
With the increasing demand for video streaming applications, HTTP Adaptive Streaming (HAS) technology has become the dominant video delivery technique over the Internet. Current HAS solutions only consider either client- or server-side optimization, which causes many problems in achieving high-quality video, leading to sub-optimal users’ experience and network resource utilization. Recent studies have revealed that network-assisted HAS techniques, by providing a comprehensive view of the network, can lead to more significant gains in HAS system performance. In this paper, we leverage the capability of Software-Define Networking (SDN), Network Function Virtualization (NFV), and edge computing to introduce a CDN-Aware QoE Optimization in SDN-Assisted Adaptive Video Streaming framework called CSDN. We employ virtualized edge entities to collect various information items (e.g., user-, client, CDN- and network-level information) in a time-slotted method. These components then run an optimization model with a new server/segment selection approach in a time-slotted fashion to serve the clients’ requests by selecting optimal cache servers (in terms of fetch and transcoding times). In case of a cache miss, a client’s request is served (i) by an optimal replacement quality (only better quality levels with minimum deviation) from a cache server, (ii) by a quality transcoded from an optimal replacement quality at the edge, or (iii) by the originally requested quality level from the origin server. By means of comprehensive experiments conducted on a real-world large-scale testbed, we demonstrate that CSDN outperforms the state-of-the-art in terms of playback bitrate, the number of quality switches, the number of stalls, and bandwidth usage by at least 7.5%, 19%, 19%, and 63%, respectively.
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsAlpen-Adria-Universität
5G and 6G networks are expected to support various novel emerging adaptive video streaming services (e.g., live, VoD, immersive media, and online gaming) with versatile Quality of Experience (QoE) requirements such as high bitrate, low latency, and sufficient reliability. It is widely agreed that these requirements can be satisfied by adopting emerging networking paradigms like Software-Defined Networking (SDN), Network Function Virtualization (NFV), and edge computing. Previous studies have leveraged these paradigms to present network-assisted video streaming frameworks, but mostly in isolation without devising chains of Virtualized Network Functions (VNFs) that consider the QoE requirements of various types of Multimedia Services (MS). To bridge the aforementioned gaps, we first introduce a set of multimedia VNFs at the edge of an SDN-enabled network, form diverse Service Function Chains (SFCs) based on the QoE requirements of different MS services. We then propose SARENA, an SFC-enabled ArchitectuRe for adaptive VidEo StreamiNg Applications. Next, we formulate the problem as a central scheduling optimization model executed at the SDN controller. We also present a lightweight heuristic solution consisting of two phases that run on the SDN controller and edge servers to alleviate the time complexity of the optimization model in
large-scale scenarios. Finally, we design a large-scale cloud-based testbed, including 250 HTTP Adaptive Streaming (HAS) players requesting two popular MS applications (i.e., live and VoD), conduct various experiments, and compare its effectiveness with baseline systems. Experimental results illustrate that SARENA outperforms baseline schemes in terms of users’ QoE by at least 39.6%, latency by 29.3%, and network utilization by 30% in both MS services.
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningAlpen-Adria-Universität
Video is evolving into a crucial tool as daily lives are increasingly centered around visual communication. The demand for better video content is constantly rising, from entertainment to business meetings. The delivery of video content to users is of utmost significance. HTTP adaptive streaming, in which the video content adjusts to the changing network circumstances, has become the de-facto method for delivering internet video.
As video technology continues to advance, it presents a number of challenges, one of which is the large amount of data required to describe a video accurately. To address this issue, it is necessary to have a powerful video encoding tool. Historically, these efforts have relied on hand-crafted tools and heuristics. However, with the recent advances in machine learning, there has been increasing exploration into using these techniques to enhance video coding performance.
This thesis proposes eight contributions that enhance video coding performance for HTTP adaptive streaming using machine learning.
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningEkrem Çetinkaya
Thesis Presentation - Ekrem Çetinkaya
Video is evolving into a crucial tool as daily lives are increasingly centered around visual communication. The demand for better video content is constantly rising, from entertainment to business meetings. The delivery of video content to users is of utmost significance. HTTP adaptive streaming, in which the video content adjusts to the changing network circumstances, has become the de-facto method for delivering internet video. As video technology continues to advance, it presents a number of challenges, one of which is the large amount of data required to describe a video accurately. To address this issue, it is necessary to have a powerful video encoding tool. Historically, these efforts have relied on hand-crafted tools and heuristics. However, with the recent advances in machine learning, there has been increasing exploration into using these techniques to enhance video coding performance. This thesis proposes eight contributions that enhance video coding performance for HTTP adaptive streaming using machine learning.
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video StreamingAlpen-Adria-Universität
Recently, HTTP Adaptive Streaming (HAS) has become the dominant video delivery technology over the Internet. In HAS, clients have full control over the media streaming and adaptation processes. Lack of coordination among the clients and lack of awareness of the network conditions may lead to sub-optimal user experience, and resource utilization in a pure client-based HAS adaptation scheme. Software-Defined Networking (SDN) has recently been considered to enhance the video streaming process. In this paper, we leverage the capability of SDN and Network Function Virtualization (NFV) to introduce an edge- and SDN-assisted video streaming framework called ES-HAS. We employ virtualized edge components to collect HAS clients’ requests and retrieve networking information in a time-slotted manner. These components then perform an optimization model in a time-slotted manner to efficiently serve clients’ requests by selecting an optimal cache server (with the shortest fetch time). In case of a cache miss, a client’s request is served (i) by an optimal replacement quality (only better quality levels with minimum deviation) from a cache server, or (ii) by the originally requested quality level from the origin server. This approach is validated through experiments on a large-scale testbed, and the performance of our framework is compared to pure client-based strategies and the SABR system [11]. Although SABR and ES-HAS show (almost) identical performance in the number of quality switches, ES-HAS outperforms SABR in terms of playback bitrate and the number of stalls by at least 70% and 40%, respectively.
CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video StreamingAlpen-Adria-Universität
With the increasing demand for video streaming applications, HTTP Adaptive Streaming (HAS) technology has become the dominant video delivery technique over the Internet. Current HAS solutions only consider either client- or server-side optimization, which causes many problems in achieving high-quality video, leading to sub-optimal users’ experience and network resource utilization. Recent studies have revealed that network-assisted HAS techniques, by providing a comprehensive view of the network, can lead to more significant gains in HAS system performance. In this paper, we leverage the capability of Software-Define Networking (SDN), Network Function Virtualization (NFV), and edge computing to introduce a CDN-Aware QoE Optimization in SDN-Assisted Adaptive Video Streaming framework called CSDN. We employ virtualized edge entities to collect various information items (e.g., user-, client, CDN- and network-level information) in a time-slotted method. These components then run an optimization model with a new server/segment selection approach in a time-slotted fashion to serve the clients’ requests by selecting optimal cache servers (in terms of fetch and transcoding times). In case of a cache miss, a client’s request is served (i) by an optimal replacement quality (only better quality levels with minimum deviation) from a cache server, (ii) by a quality transcoded from an optimal replacement quality at the edge, or (iii) by the originally requested quality level from the origin server. By means of comprehensive experiments conducted on a real-world large-scale testbed, we demonstrate that CSDN outperforms the state-of-the-art in terms of playback bitrate, the number of quality switches, the number of stalls, and bandwidth usage by at least 7.5%, 19%, 19%, and 63%, respectively.
Vignesh V Menon is invited to talk on "Video Coding for HTTP Adaptive Streaming" on the Research@Lunch, which is a research webinar series by Humanitarian Technology (HuT) Labs, Amrita Vishwa Vidyapeetham University, India, exclusively for Ph.D. Scholars, UG, and PG Researchers in India. This talk will introduce the basics of video codecs and highlight the scope of HAS-related research on video encoding.
Invited talk on “Video Coding for HTTP Adaptive Streaming” on the Research@Lunch, which is a research webinar series by Humanitarian Technology (HuT) Labs, Amrita Vishwa Vidyapeetham University, India, exclusively for Ph.D. Scholars, UG, and PG Researchers in India. This talk introduced the basics of video codecs and highlighted the scope of HAS-related research on video encoding.
Time: August 14, 10.00AM-10.30AM (CEST) or 1.30PM- 2.00PM (IST)
Collaborative Edge-Assisted Systems for HTTP Adaptive Video StreamingAlpen-Adria-Universität
The proliferation of novel video streaming technologies, advancement of networking paradigms, and steadily increasing numbers of users who prefer to watch video content over the Internet rather than using classical TV have made video the predominant traffic on the Internet. However, designing cost-effective, scalable, and flexible architectures that support low-latency and high-quality video streaming is still a challenge for both over-the-top (OTT) and ISP companies. In this talk, we first introduce the principles of video streaming and the existing challenges. We then review several 5G/6G networking paradigms and explain how we can leverage networking technologies to form collaborative network-assisted video streaming systems for improving users’ quality of experience (QoE) and network utilization.
In this contribution, we present selected novel approaches and results of our research work in the \ATHENA Christian Doppler Laboratory (Adaptive Streaming over HTTP and Emerging Networked Multimedia Services), a major research project at our department jointly funded by public sources and industry. By putting this work also into the context of related ongoing research activities, we aim at working out where HTTP Adaptive Streaming is currently heading.
Abstract: Rapid growth in multimedia streaming traffic over the Internet motivates the research and further investigation of the video coding performance of such services in terms of speed and Quality of Experience (QoE). HTTP Adaptive Streaming (HAS) is today’s de-facto standard to deliver clients the highest possible video quality. In HAS, the same video content is encoded at multiple bitrates, resolutions, framerates, and coding formats called representations. This study aims to (i) provide fast and compression-efficient multi-bitrate, multi-resolution representations, (ii) provide fast and compression-efficient multi-codec representations, (iii) improve the encoding efficiency of Video on Demand (VoD) streaming using content-adaptive encoding optimizations, and (iv) provide encoding schemes with optimizations per-title for live streaming applications to decrease the storage or delivery costs or/and increase QoE.
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...Alpen-Adria-Universität
Nowadays, HTTP Adaptive Streaming (HAS) has become the de-facto standard for delivering video over the Internet. More users have started generating and delivering high-quality live streams (usually 4K resolution) through popular online streaming platforms, resulting in a rise in live streaming traffic. Typically, the video contents are generated by streamers and watched by many audiences, geographically distributed in various locations far away from the streamers. The resource limitation in the network (e.g., bandwidth) is a challenging issue for network and video providers to meet the users’ requested quality. This dissertation leverages edge computing capabilities and in-network intelligence to design, implement, and evaluate approaches to optimize Quality of Experience (QoE) and end-to-end (E2E) latency of live HAS. In addition, improving transcoding performance and optimizing the cost of running live HAS services and the network’s backhaul utilization are considered. Motivated by the mentioned issue, the dissertation proposes five contributions in two classes: optimizing resource utilization and light-weight transcoding.
QoS Constrained H.264/SVC video streaming over Multicast Ad Hoc NetworksIJERA Editor
Support for QoS enabled multimedia transmission over multicast ad hoc network is necessary these days.
Researchers have developed various encoding/decoding schemes which can efficiently deliver the multimedia
contents over wireless networks. In case of ad hoc networks, performance of routing protocol depends upon
different factors i.e. traffic type being used for wireless transmission, dynamic network behavior, bandwidth and
computational power of nodes etc. It is essential to investigate the performance of multicast routing protocol
using various data types because they may consume huge network resources thus results in degradation of
transmission quality. In case of multicast group communication, Audio/Video data stream can cause extra
overhead on network performance and it is quite difficult to maintain Quality of Services for such type of data.
H.264 offers a rich codec library for Scalable Video Coding, to transfer SVC video traffic efficiently over
wireless networks. In this paper, we will analyze the performance of MAODV and PUMA routing protocols
using H.264/SVC video streaming traffic under the various QoS constraints such as Throughput, PDR, Delay,
Routing Load and Jitter etc.
Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.
Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual RealityWen-Chih Lo
Published in NOSSDAV'17 on June 2017.
We study the problem of predicting the Field-of-Views (FoVs) of viewers watching 360° videos using commodity Head-Mounted Displays (HMDs). Existing solutions either use the viewer's current orientation to approximate the FoVs in the future, or extrapolate future FoVs using the historical orientations and dead-reckoning algorithms. In this paper, we develop fixation prediction networks that concurrently leverage sensor- and content-related features to predict the viewer fixation in the future, which is quite different from the solutions in the literature. The sensor-related features include HMD orientations, while the content-related features include image saliency maps and motion maps. We build a 360° video streaming testbed to HMDs, and recruit twenty-five viewers to watch ten 360° videos. We then train and validate two design alternatives of our proposed networks, which allows us to identify the better-performing design with the optimal parameter settings.
Trace-driven simulation results show the merits of our proposed fixation prediction networks compared to the existing solutions, including: (i) lower consumed bandwidth, (ii) shorter initial buffering time, and (iii) short running time.
QoE- and Energy-aware Content Consumption for HTTP Adaptive StreamingDanieleLorenzi6
Video streaming services account for the majority of today’s traffic on the Internet, and according to recent studies, this share is expected to continue growing. This implies that many people around the globe utilize video streaming services on a daily basis to fruit video content. Given this broad utilization, research in video streaming is recently moving towards energy-aware approaches, which aim at the minimization of the energy consumption of the devices involved. On the other side, the perception of quality delivered to the user plays an important role, and the advent of HTTP Adaptive Streaming (HAS) changed the way quality is perceived. The focus moved from the Quality of Service (QoS) towards the Quality of Experience (QoE) of the user taking part in the streaming session. Therefore video streaming services need to develop Adaptive BitRate (ABR) techniques to deal with different network environments on the client side or appropriate end-to-end strategies to provide high QoE to the users. The scope of this doctoral study is within the end-to-end environment with a focus on the end-users domain, referred to as the player environment, including video content consumption and interactivity. This thesis aims to investigate and develop different techniques to increase the delivered QoE to the users and reduce the energy consumption of the end devices in HAS context. We present four main research questions to target the related challenges in the domain of content consumption for HAS systems.
Multi-Criteria Optimization of Content Delivery within the Future Media Internetjbruneauqueyreix
Ph.D defence slide. Improving multimedia delivery over the and end-users' Quality of Experience with multiple source streaming and hybrid peer-to-peer multi-server.
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instancesAlpen-Adria-Universität
Video streaming constitutes 65 % of global internet traffic, prompting an investigation into its energy consumption and CO2 emissions. Video encoding, a computationally intensive part of streaming, has moved to cloud computing for its scalability and flexibility. However, cloud data centers’ energy consumption, especially video encoding, poses environmental challenges. This paper presents VEED, a FAIR Video Encoding Energy and CO2 Emissions Dataset for Amazon Web Services (AWS) EC2 instances. Additionally, the dataset also contains the duration, CPU utilization, and cost of the encoding. To prepare this dataset, we introduce a model and conduct a benchmark to estimate the energy and CO2 emissions of different Amazon EC2 instances during the encoding of 500 video segments with various complexities and resolutions using Advanced Video Coding (AVC)
and High-Efficiency Video Coding (HEVC). VEED and its analysis can provide valuable insights for video researchers and engineers to model energy consumption, manage energy resources, and distribute workloads, contributing to the sustainability of cloud-based video encoding and making them cost-effective. VEED is available at Github.
Addressing climate change requires a global decrease in greenhouse gas (GHG) emissions. In today’s digital landscape, video streaming significantly influences internet traffic, driven by the widespread use of mobile devices and the rising popularity of streaming plat-
forms. This trend emphasizes the importance of evaluating energy consumption and the development of sustainable and eco-friendly video streaming solutions with a low Carbon Dioxide (CO2) footprint. We developed a specialized tool, released as an open-source library called GREEM , addressing this pressing concern. This tool measures video encoding and decoding energy consumption and facilitates benchmark tests. It monitors the computational impact on hardware resources and offers various analysis cases. GREEM is helpful for developers, researchers, service providers, and policy makers interested in minimizing the energy consumption of video encoding and streaming.
More Related Content
Similar to Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, SDN, and MEC
Vignesh V Menon is invited to talk on "Video Coding for HTTP Adaptive Streaming" on the Research@Lunch, which is a research webinar series by Humanitarian Technology (HuT) Labs, Amrita Vishwa Vidyapeetham University, India, exclusively for Ph.D. Scholars, UG, and PG Researchers in India. This talk will introduce the basics of video codecs and highlight the scope of HAS-related research on video encoding.
Invited talk on “Video Coding for HTTP Adaptive Streaming” on the Research@Lunch, which is a research webinar series by Humanitarian Technology (HuT) Labs, Amrita Vishwa Vidyapeetham University, India, exclusively for Ph.D. Scholars, UG, and PG Researchers in India. This talk introduced the basics of video codecs and highlighted the scope of HAS-related research on video encoding.
Time: August 14, 10.00AM-10.30AM (CEST) or 1.30PM- 2.00PM (IST)
Collaborative Edge-Assisted Systems for HTTP Adaptive Video StreamingAlpen-Adria-Universität
The proliferation of novel video streaming technologies, advancement of networking paradigms, and steadily increasing numbers of users who prefer to watch video content over the Internet rather than using classical TV have made video the predominant traffic on the Internet. However, designing cost-effective, scalable, and flexible architectures that support low-latency and high-quality video streaming is still a challenge for both over-the-top (OTT) and ISP companies. In this talk, we first introduce the principles of video streaming and the existing challenges. We then review several 5G/6G networking paradigms and explain how we can leverage networking technologies to form collaborative network-assisted video streaming systems for improving users’ quality of experience (QoE) and network utilization.
In this contribution, we present selected novel approaches and results of our research work in the \ATHENA Christian Doppler Laboratory (Adaptive Streaming over HTTP and Emerging Networked Multimedia Services), a major research project at our department jointly funded by public sources and industry. By putting this work also into the context of related ongoing research activities, we aim at working out where HTTP Adaptive Streaming is currently heading.
Abstract: Rapid growth in multimedia streaming traffic over the Internet motivates the research and further investigation of the video coding performance of such services in terms of speed and Quality of Experience (QoE). HTTP Adaptive Streaming (HAS) is today’s de-facto standard to deliver clients the highest possible video quality. In HAS, the same video content is encoded at multiple bitrates, resolutions, framerates, and coding formats called representations. This study aims to (i) provide fast and compression-efficient multi-bitrate, multi-resolution representations, (ii) provide fast and compression-efficient multi-codec representations, (iii) improve the encoding efficiency of Video on Demand (VoD) streaming using content-adaptive encoding optimizations, and (iv) provide encoding schemes with optimizations per-title for live streaming applications to decrease the storage or delivery costs or/and increase QoE.
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...Alpen-Adria-Universität
Nowadays, HTTP Adaptive Streaming (HAS) has become the de-facto standard for delivering video over the Internet. More users have started generating and delivering high-quality live streams (usually 4K resolution) through popular online streaming platforms, resulting in a rise in live streaming traffic. Typically, the video contents are generated by streamers and watched by many audiences, geographically distributed in various locations far away from the streamers. The resource limitation in the network (e.g., bandwidth) is a challenging issue for network and video providers to meet the users’ requested quality. This dissertation leverages edge computing capabilities and in-network intelligence to design, implement, and evaluate approaches to optimize Quality of Experience (QoE) and end-to-end (E2E) latency of live HAS. In addition, improving transcoding performance and optimizing the cost of running live HAS services and the network’s backhaul utilization are considered. Motivated by the mentioned issue, the dissertation proposes five contributions in two classes: optimizing resource utilization and light-weight transcoding.
QoS Constrained H.264/SVC video streaming over Multicast Ad Hoc NetworksIJERA Editor
Support for QoS enabled multimedia transmission over multicast ad hoc network is necessary these days.
Researchers have developed various encoding/decoding schemes which can efficiently deliver the multimedia
contents over wireless networks. In case of ad hoc networks, performance of routing protocol depends upon
different factors i.e. traffic type being used for wireless transmission, dynamic network behavior, bandwidth and
computational power of nodes etc. It is essential to investigate the performance of multicast routing protocol
using various data types because they may consume huge network resources thus results in degradation of
transmission quality. In case of multicast group communication, Audio/Video data stream can cause extra
overhead on network performance and it is quite difficult to maintain Quality of Services for such type of data.
H.264 offers a rich codec library for Scalable Video Coding, to transfer SVC video traffic efficiently over
wireless networks. In this paper, we will analyze the performance of MAODV and PUMA routing protocols
using H.264/SVC video streaming traffic under the various QoS constraints such as Throughput, PDR, Delay,
Routing Load and Jitter etc.
Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.
Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual RealityWen-Chih Lo
Published in NOSSDAV'17 on June 2017.
We study the problem of predicting the Field-of-Views (FoVs) of viewers watching 360° videos using commodity Head-Mounted Displays (HMDs). Existing solutions either use the viewer's current orientation to approximate the FoVs in the future, or extrapolate future FoVs using the historical orientations and dead-reckoning algorithms. In this paper, we develop fixation prediction networks that concurrently leverage sensor- and content-related features to predict the viewer fixation in the future, which is quite different from the solutions in the literature. The sensor-related features include HMD orientations, while the content-related features include image saliency maps and motion maps. We build a 360° video streaming testbed to HMDs, and recruit twenty-five viewers to watch ten 360° videos. We then train and validate two design alternatives of our proposed networks, which allows us to identify the better-performing design with the optimal parameter settings.
Trace-driven simulation results show the merits of our proposed fixation prediction networks compared to the existing solutions, including: (i) lower consumed bandwidth, (ii) shorter initial buffering time, and (iii) short running time.
QoE- and Energy-aware Content Consumption for HTTP Adaptive StreamingDanieleLorenzi6
Video streaming services account for the majority of today’s traffic on the Internet, and according to recent studies, this share is expected to continue growing. This implies that many people around the globe utilize video streaming services on a daily basis to fruit video content. Given this broad utilization, research in video streaming is recently moving towards energy-aware approaches, which aim at the minimization of the energy consumption of the devices involved. On the other side, the perception of quality delivered to the user plays an important role, and the advent of HTTP Adaptive Streaming (HAS) changed the way quality is perceived. The focus moved from the Quality of Service (QoS) towards the Quality of Experience (QoE) of the user taking part in the streaming session. Therefore video streaming services need to develop Adaptive BitRate (ABR) techniques to deal with different network environments on the client side or appropriate end-to-end strategies to provide high QoE to the users. The scope of this doctoral study is within the end-to-end environment with a focus on the end-users domain, referred to as the player environment, including video content consumption and interactivity. This thesis aims to investigate and develop different techniques to increase the delivered QoE to the users and reduce the energy consumption of the end devices in HAS context. We present four main research questions to target the related challenges in the domain of content consumption for HAS systems.
Multi-Criteria Optimization of Content Delivery within the Future Media Internetjbruneauqueyreix
Ph.D defence slide. Improving multimedia delivery over the and end-users' Quality of Experience with multiple source streaming and hybrid peer-to-peer multi-server.
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instancesAlpen-Adria-Universität
Video streaming constitutes 65 % of global internet traffic, prompting an investigation into its energy consumption and CO2 emissions. Video encoding, a computationally intensive part of streaming, has moved to cloud computing for its scalability and flexibility. However, cloud data centers’ energy consumption, especially video encoding, poses environmental challenges. This paper presents VEED, a FAIR Video Encoding Energy and CO2 Emissions Dataset for Amazon Web Services (AWS) EC2 instances. Additionally, the dataset also contains the duration, CPU utilization, and cost of the encoding. To prepare this dataset, we introduce a model and conduct a benchmark to estimate the energy and CO2 emissions of different Amazon EC2 instances during the encoding of 500 video segments with various complexities and resolutions using Advanced Video Coding (AVC)
and High-Efficiency Video Coding (HEVC). VEED and its analysis can provide valuable insights for video researchers and engineers to model energy consumption, manage energy resources, and distribute workloads, contributing to the sustainability of cloud-based video encoding and making them cost-effective. VEED is available at Github.
Addressing climate change requires a global decrease in greenhouse gas (GHG) emissions. In today’s digital landscape, video streaming significantly influences internet traffic, driven by the widespread use of mobile devices and the rising popularity of streaming plat-
forms. This trend emphasizes the importance of evaluating energy consumption and the development of sustainable and eco-friendly video streaming solutions with a low Carbon Dioxide (CO2) footprint. We developed a specialized tool, released as an open-source library called GREEM , addressing this pressing concern. This tool measures video encoding and decoding energy consumption and facilitates benchmark tests. It monitors the computational impact on hardware resources and offers various analysis cases. GREEM is helpful for developers, researchers, service providers, and policy makers interested in minimizing the energy consumption of video encoding and streaming.
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...Alpen-Adria-Universität
In HTTP adaptive live streaming applications, video segments are encoded at a fixed set of bitrate-resolution pairs known as bitrate ladder. Live encoders use the fastest available encoding configuration, referred to as preset, to ensure the minimum possible latency in video encoding. However, an optimized preset and optimized number of CPU threads for each encoding instance may result in (i) increased quality and (ii) efficient CPU utilization while encoding. For low latency live encoders, the encoding speed is expected to be more than or equal to the video framerate. To this light, this paper introduces a Just Noticeable Difference (JND)-Aware Low latency Encoding Scheme (JALE), which uses random forest-based models to jointly determine the optimized encoder preset and thread count for each representation, based on video complexity features, the target encoding speed, the total number of available CPU threads, and the target encoder. Experimental results show that, on average, JALE yield a quality improvement of 1.32 dB PSNR and 5.38 VMAF points with the same bitrate, compared to the fastest preset encoding of the HTTP Live Streaming (HLS) bitrate ladder using x265 HEVC open-source encoder with eight CPU threads used for each representation. These enhancements are achieved while maintaining the desired encoding speed. Furthermore, on average, JALE results in an overall storage reduction of 72.70%, a reduction in the total number of CPU threads used by 63.83%, and a 37.87% reduction in the overall encoding time, considering a JND of six VMAF points.
In the context of rising environmental concerns, this paper introduces VEEP, an architecture designed to predict energy consumption and CO2 emissions in cloud-based video encoding. VEEP combines video analysis with machine learning (ML)-based energy prediction and real-time carbon intensity, enabling precise estimations of CPU energy usage and CO2 emissions during the encoding process. It is trained on the Video Complexity Dataset (VCD) and encoding results from various AWS EC2 instances. VEEP achieves high accuracy, indicated by an 𝑅2-score of 0.96, a mean absolute error (MAE) of 2.41 × 10−5, and a mean squared error (MSE) of 1.67 × 10−9. An important finding is the potential to reduce emissions by up to 375 times when comparing cloud instances and their locations. These results highlight the importance of considering environmental factors in cloud computing.
In today’s dynamic streaming landscape, where viewers access content on various devices and en- counter fluctuating network conditions, optimizing video delivery for each unique scenario is impera- tive. Video content complexity analysis, content-adaptive video coding, and multi-encoding methods are fundamental for the success of adaptive video streaming, as they serve crucial roles in delivering high-quality video experiences to a diverse audience. Video content complexity analysis allows us to comprehend the video content’s intricacies, such as motion, texture, and detail, providing valuable insights to enhance encoding decisions. By understanding the content’s characteristics, we can effi- ciently allocate bandwidth and encoding resources, thereby improving compression efficiency without compromising quality. Content-adaptive video coding techniques built upon this analysis involve dy- namically adjusting encoding parameters based on the content complexity. This adaptability ensures that the video stream remains visually appealing and artifacts are minimized, even under challenging network conditions. Multi-encoding methods further bolster adaptive streaming by offering faster encoding of multiple representations of the same video at different bitrates. This versatility reduces computational overhead and enables efficient resource allocation on the server side. Collectively, these technologies empower adaptive video streaming to deliver optimal visual quality and uninter- rupted viewing experiences, catering to viewers’ diverse needs and preferences across a wide range of devices and network conditions. Embracing video content complexity analysis, content-adaptive video coding, and multi-encoding methods is essential to meet modern video streaming platforms’ evolving demands and create immersive experiences that captivate and engage audiences. In this light, this dissertation proposes contributions categorized into four classes:
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...Alpen-Adria-Universität
Quality of Experience (QoE) and QoE models are of an increasing importance to networked systems. The traditional QoE modeling for video streaming applications builds a one-size-fits-all QoE model that underserves atypical viewers who perceive QoE differently. To address the problem of atypical viewers, this paper proposes iQoE (individualized QoE), a method that employs explicit, expressible, and actionable feedback from a viewer to construct a personalized QoE model for this viewer. The iterative iQoE design exercises active learning and combines a novel sampler with a modeler. The chief emphasis of our paper is on making iQoE sample-efficient and accurate.
By leveraging the Microworkers crowdsourcing platform, we conduct studies with 120 subjects who provide 14,400 individual scores. According to the subjective studies, a session of about 22 minutes empowers a viewer to construct a personalized QoE model that, compared to the best of the 10 baseline models, delivers the average accuracy improvement of at least 42% for all viewers and at least 85% for the atypical viewers. The large-scale simulations based on a new technique of synthetic profiling expand the evaluation scope by exploring iQoE design choices, parameter sensitivity, and generalizability.
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...Alpen-Adria-Universität
Quality of Experience (QoE) and QoE models are of an increasing importance to networked systems. The traditional QoE modeling for video streaming applications builds a one-size-fits-all QoE model that underserves atypical viewers who perceive QoE differently. To address the problem of atypical viewers, this paper proposes iQoE (individualized QoE), a method that employs explicit, expressible, and actionable feedback from a viewer to construct a personalized QoE model for this viewer. The iterative iQoE design exercises active learning and combines a novel sampler with a modeler. The chief emphasis of our paper is on making iQoE sample-efficient and accurate.
By leveraging the Microworkers crowdsourcing platform, we conduct studies with 120 subjects who provide 14,400 individual scores. According to the subjective studies, a session of about 22 minutes empowers a viewer to construct a personalized QoE model that, compared to the best of the 10 baseline models, delivers the average accuracy improvement of at least 42% for all viewers and at least 85% for the atypical viewers. The large-scale simulations based on a new technique of synthetic profiling expand the evaluation scope by exploring iQoE design choices, parameter sensitivity, and generalizability.
Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...Alpen-Adria-Universität
HTTP Adaptive Streaming (HAS) methods divide a video into smaller segments, encoded at multiple pre-defined bitrates to construct a bitrate ladder. Bitrate ladders are usually optimized per title over several dimensions, such as bitrate, resolution, and framerate. This paper adds a new dimension to the bitrate ladder by considering the energy consumption of the encoding process. Video encoders often have multiple pre-defined presets to balance the trade-off between encoding time, energy consumption, and compression efficiency. Faster presets disable certain coding tools defined by the codec to reduce the encoding time at the cost of reduced compression efficiency. Firstly, this paper evaluates the energy consumption and compression efficiency of different x265 presets for 500 video sequences. Secondly, optimized presets are selected for various representations in a bitrate ladder based on the results to guarantee a minimal drop in video quality while saving energy. Finally, a new per-title model, which optimizes the trade-off between compression efficiency and energy consumption, is proposed. The experimental results show that decreasing the VMAF score by 0.15 and 0.39 while choosing an optimized preset results in encoding energy savings of 70% and 83%, respectively.
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...Alpen-Adria-Universität
With the emergence of multiple modern video codecs, streaming service providers are forced to encode, store, and transmit bitrate ladders of multiple codecs separately, consequently suffering from additional energy costs for encoding, storage, and transmission.
To tackle this issue, we introduce an online energy-efficient Multi-Codec Bitrate ladder Estimation scheme (MCBE) for adaptive video streaming applications. In MCBE, quality representations within the bitrate ladder of new-generation codecs (e.g., HEVC, AV1) that lie below the predicted rate-distortion curve of the AVC codec are removed. Moreover, perceptual redundancy between representations of the bitrate ladders of the considered codecs is also minimized based on a Just Noticeable Difference (JND) threshold. Therefore, random forest-based models predict the VMAF of bitrate ladder representations of each codec. In a live streaming session where all clients support the decoding of AVC, HEVC, and AV1, MCBE achieves impressive results, reducing cumulative encoding energy by 56.45%, storage energy usage by 94.99%, and transmission energy usage by 77.61% (considering a JND of six VMAF points). These energy reductions are in comparison to a baseline bitrate ladder encoding based on current industry practice.
Machine Learning Based Resource Utilization Prediction in the Computing Conti...Alpen-Adria-Universität
This paper presents UtilML, a novel approach for tackling resource utilization prediction challenges in the computing continuum. UtilML leverages Long-Short-Term Memory (LSTM) neural networks, a machine learning technique, to forecast resource utilization accurately. The effectiveness of UtilML is demonstrated through its evaluation of data extracted from a real GPU cluster in a computing continuum infrastructure comprising more than 1800 computing devices. To assess the performance of UtilML, we compared it with two related approaches that utilize a Baseline-LSTM model. Furthermore, we analyzed the LSTM results against User-Predicted values provided by GPU cluster owners for task deployment with estimated allocation values. The results indicate that UtilML outperformed user predictions by 2% to 27% for CPU utilization prediction. For memory prediction, UtilML variants excelled, showing improvements of 17% to 20% compared to user predictions.
The exponential growth of computer game streaming has led to the development of Quality of Experience (QoE) metrics to evaluate user satisfaction and enjoyment during online gameplay and live streaming. Adaptive Bitrate (ABR) streaming is a recent technology that has been suggested to improve QoE. This method enhances the streaming experience, upholds visual quality, minimizes stall events, and boosts player retention. It achieves this by estimating network bottlenecks and selecting appropriate versions of the content that best match the available bandwidth rather than adjusting encoding parameters. To investigate the correlation between quality switching and stall events, a subjective test was conducted separately and comparatively with 71 participants. For more detailed and in-depth research, video games were analyzed with the Video Complexity Analyzer (VCA) tool and divided into three categories of different genres, camera view, and temporal complexity heatmap from the two sets of normal and action scenes. This study seeks to shed light on three unresolved issues pertinent to QoE in game streaming: (i) the user preferences towards quality switching and stall events across varied scenes and games, (ii) the user inclinations towards either a single, prolonged stall event or multiple, shorter stall events, and (iii) the impact of conspicuous quality switching on the user’s QoE. Results from the study provided valuable insights, both qualitatively and quantitatively. The study found a marked preference among users for quality switching over stall events across all types of game streaming, irrespective of the scene’s intensity. Furthermore, it was observed that multiple short-stall events were generally favored over a single long-stall event in streaming first-person shooting games. Interestingly, approximately half of the participants remained oblivious to quality switching during their game viewing sessions, and among those who noticed a change in quality, the alteration did not significantly impact their perceived QoE.
Over the last recent years, video streaming traffic has become the dominating service over mobile networks. The two main reasons for the growth of video streaming traffic are the improved capabilities of mobile devices and the emergence of HTTP Adaptive Streaming (HAS). Hence, there is a demand for new technologies to cope with the increasing traffic load while improving clients’ Quality of Experience (QoE). The network plays a crucial role in the video streaming process. One of the key technologies on the network side is Multi-access Edge Computing (MEC), which has several key characteristics: computing power, storage, proximity to the clients and access to network and player metrics. Thus, it is possible to deploy mechanisms at the MEC node that assist video streaming.
This thesis investigates how MEC capabilities can be leveraged to support video streaming delivery, specifically to improve the QoE, reduce latency or increase storage and bandwidth savings.
In the last decades, video streaming has been developing significantly. Among cur- rent technologies, HTTP Adaptive Streaming (HAS) is considered the de-facto approach in multimedia transmission over the internet. In HAS, the video is split into temporal segments with the same duration (e.g., 4s), each of which is then encoded into different quality versions and stored at servers. The end user sends requests to the server to retrieve segments with specific quality versions determined by an Adaptive Bitrate (ABR) algorithm for the purpose of adapting the throughput fluctuation. Though the majority of HAS-based media services function well even under throughput restrictions and variations, there are still significant challenges for multimedia systems, especially the tradeoff among the increasing content complexity, various time-related requirements, and Quality of Experience (QoE). Content complexity encompasses the increased demands for data, such as high-resolution videos and high frame rates, as well as novel content formats, such as virtual reality (VR) and augmented reality (AR). Time-related requirements include – but are not limited to – start-up delay and end-to-end latency. QoE can be defined as the level of satisfaction or frustration experienced by the user of an application or service. Optimizing for one aspect usually negatively impacts at least one of the other two aspects. This thesis tackles critical open research questions in the context of HAS that significantly impact the QoE at the client side.
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...Alpen-Adria-Universität
The considerable surge in energy consumption within data centers can be attributed to the exponential rise in demand for complex computing workflows and storage resources. Video streaming applications are both compute and storage-intensive and account for the majority of today’s internet services. In this work, we designed a video encoding application consisting of codec, bitrate, and resolution set for encoding a video segment. Then, we propose VE-Match, a matching-based method to schedule video encoding applications on both Cloud and Edge resources to optimize costs and energy consumption. Evaluation results on a real computing testbed federated between Amazon Web Services (AWS) EC2 Cloud instances and the Alpen-Adria University (AAU) Edge server reveal that VE-Match achieves lower costs by 17%-78% in the cost-optimized scenarios compared to the energy-optimized and tradeoff between cost and energy. Moreover, VE-Match improves the video encoding energy consumption by 38%-45% and gCO2 emission by up to 80 % in the energy-optimized scenarios compared to the cost-optimized and tradeoff between cost and energy.
Energy Consumption in Video Streaming: Components, Measurements, and StrategiesAlpen-Adria-Universität
The rapid growth of video streaming usage is a significant source of energy consumption, driven by improved internet connections and service offerings, the quick development of video entertainment, the deployment of Ultra High-Definition, Virtual and Augmented Reality, as well as an increasing number of video surveillance and IoT applications. To address this challenge, it is essential to understand the various components involved in energy consumption during video streaming, ranging from video encoding to decoding and displaying the video on the end user’s screen. Then, it is critical to measure energy consumption for each component accurately and conduct an in-depth analysis to develop energy-efficient strategies that optimize video streaming [1, 2, 3]. These components are classified into three categories [4]: (i) data centers, which include encoding, packaging, and storage on cloud data centers; (ii) networks, which include core network and access networks; and (iii) end-user devices which involve decoding, players, hardware, etc.
In addition to identifying the primary components of video streaming that affect energy consumption, it is important to conduct a comprehensive analysis of the entire video streaming. It is also essential to balance energy optimization and service quality to ensure that energyefficient strategies are implemented without sacrificing the quality of video streaming services.
This talk aims to provide insights into the components of video streaming that contribute to energy consumption and highlight the challenges associated with measuring their energy usage. I will also introduce the tools that can be used for energy measurements for those components and the possible and associated strategies that lie within energy efficiency. By accurately measuring energy consumption, digital media companies can effectively monitor and control their energy usage, ultimately leading to cost savings and improved sustainability.
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...Alpen-Adria-Universität
The rapid growth of video streaming usage is a significant source of energy consumption, driven by improved internet connections and service offerings, the quick development of video entertainment, the deployment of Ultra High-Definition, Virtual and Augmented Reality, as well as an increasing number of video surveillance and IoT applications. However, it is essential to note that these advancements come at the cost of energy consumption. To address this challenge, it is essential to understand the various components involved in energy consumption during video streaming, ranging from video encoding to decoding and displaying the video on the end user’s screen. Then, it is critical to accurately measure energy consumption for each component and conduct an in-depth analysis to develop energy-efficient strategies that optimize video streaming. I categorize these components into three categories: (i) data centers, (ii) networks, and (iii) end-user devices.
In this talk, my objective is to provide insights into the components of video streaming that contribute to energy consumption and highlight the challenges associated with measuring their energy usage. I will also introduce the tools that can be used for energy measurements for those components and the possible and associated strategies that lie within energy efficiency. By accurately measuring energy consumption, digital media companies can effectively monitor and control their energy usage, ultimately leading to cost savings and improved sustainability.
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...Alpen-Adria-Universität
Live media streaming is a challenging task by itself, and when it comes to use cases that define low-latency as a must, the complexity will rise multiple times. In a typical media streaming session, the main goal can be declared as providing the highest possible Quality of Experience (QoE), which has proved to be measurable using quality models and various metrics. In a low-latency media streaming session, the requirements are to provide the lowest possible delay between the moment a frame of video is captured and the moment that the captured frame is rendered on the client screen, also known as end-to-end (E2E) latency and maintain the QoE. This paper proposes a sophisticated cloud-based and open-source testbed that facilitates evaluating a low-latency live streaming session as the primary contribution. Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation (LLL-CAdViSE) framework is enabled to asses the live streaming systems running on two major HTTP Adaptive Streaming (HAS) formats, Dynamic Adaptive Streaming over HTTP (MPEG-DASH) and HTTP Live Streaming (HLS). We use Chunked Transfer Encoding (CTE) to deliver Common Media Application Format (CMAF) chunks to the media players. Our testbed generates the test content (audiovisual streams). Therefore, no test sequence is required, and the encoding parameters (e.g., encoder, bitrate, resolution, latency) are defined separately for each experiment. We have integrated the ITU-T P.1203 quality model inside our testbed. To demonstrate the flexibility and power of LLL-CAdViSE, we have presented a secondary contribution in this paper; we have conducted a set of experiments with different network traces, media players, ABR algorithms, and with various requirements (e.g., E2E latency (typical/reduced/low/ultra-low), diverse bitrate ladders, and catch-up logic) and presented the essential findings and the experimental results.
Video traffic on the Internet is constantly growing; networked multimedia applications consume a predominant share of the available Internet bandwidth. A major technical breakthrough and enabler in multimedia systems research and of industrial networked multimedia services certainly was the HTTP Adaptive Streaming (HAS) technique. This resulted in the standardization of MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) which, together with HTTP Live Streaming (HLS), is widely used for multimedia delivery in today’s networks. Existing challenges in multimedia systems research deal with the trade-off between (i) the ever-increasing content complexity, (ii) various requirements with respect to time (most importantly, latency), and (iii) quality of experience (QoE). Optimizing towards one aspect usually negatively impacts at least one of the other two aspects if not both. This situation sets the stage for our research work in the ATHENA Christian Doppler (CD) Laboratory (Adaptive Streaming over HTTP and Emerging Networked Multimedia Services; https://athena.itec.aau.at/), jointly funded by public sources and industry. In this talk, we will present selected novel approaches and research results of the first year of the ATHENA CD Lab’s operation. We will highlight HAS-related research on (i) multimedia content provisioning (machine learning for video encoding); (ii) multimedia content delivery (support of edge processing and virtualized network functions for video networking); (iii) multimedia content consumption and end-to-end aspects (player-triggered segment retransmissions to improve video playout quality); and (iv) novel QoE investigations (adaptive point cloud streaming). We will also put the work into the context of international multimedia systems research.
How to Optimize Dynamic Adaptive Video Streaming? Challenges and SolutionsAlpen-Adria-Universität
Empowered by today’s rich tools for media generation and collaborative production and convenient network access to the Internet, video streaming has become very popular. Dynamic adaptive video streaming is a technique used to deliver video content to users over the Internet, where the quality of the video adapts in real time based on the network conditions and the capabilities of the user’s device. HTTP Adaptive Streaming (HAS) has become the de-facto standard to provide a smooth and uninterrupted viewing experience, especially when network conditions frequently change. Improving the QoE of users concerning various applications‘ requirements presents several challenges, such as network variability, limited resources, and device heterogeneity. For example, the available network bandwidth can vary over time, leading to frequent changes in the video quality. In addition, different users have different preferences and viewing habits, which can further complicate live streaming optimization. Researchers and engineers have developed various approaches to optimize dynamic adaptive streaming, such as QoE-driven adaptation, machine learning-based approaches, and multi-objective optimization, to address these challenges. In this talk, we will give an introduction to the topic of video streaming and point out the significant challenges in the field. We will present a layered architecture for video streaming and then discuss a selection of approaches from our research addressing these challenges. For instance, we will present approaches to improve the QoE of clients in User-generated content applications in centralized and distributed fashions. Moreover, we will present a novel architecture for low-latency live streaming that is agnostic to the protocol and codecs that can work equally with existing HAS-based approaches.
MPEC2: Multilayer and Pipeline Video Encoding on the Computing ContinuumAlpen-Adria-Universität
Video streaming is the dominating traffic in today’s data-sharing world. Media service providers stream video content for their viewers, while worldwide users create and distribute videos using mobile or video system applications that significantly increase the traffic share. We propose a multilayer and pipeline encoding on the computing continuum (MPEC2) method that addresses the key technical challenge of high-price and computational complexity of video encoding. MPEC2 splits the video encoding into several tasks scheduled on appropriately selected Cloud and Fog computing instance types that satisfy the media service provider and user priorities in terms of time and cost.
In the first phase, MPEC2 uses a multilayer resource partitioning method to explore the instance types for encoding a video segment. In the second phase, it distributes the independent segment encoding tasks in a pipeline model on the underlying instances.
We evaluate MPEC2 on a federated computing continuum encompassing Amazon Web Services (AWS) EC2 Cloud and Exoscale Fog instances distributed on seven geographical locations. Experimental results show that MPEC2 achieves 24% faster completion time and 60% lower cost for video encoding compared to resource allocation related methods. When compared with baseline methods, MPEC2 yields 40%-50% lower completion time and 5-60% reduced total cost.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, SDN, and MEC
1. Network-Assisted Delivery of Adaptive Video Streaming
Services through CDN,SDN,and MEC
Supervisors:
Univ.-Prof.DI Dr.Hermann Hellwagner
Univ.-Prof.DI Dr.Christian Timmerer
Reza Farahani
Klagenfurt am Wörthersee,Austria
22.08.2023
Reviewers:
Prof.Dr.Filip De Turck
Prof.Dr.Tobias Hoßfeld
2. Table of Contents
-Motivation
-Technical Background
-Research Questions
-Contributions
Introduction
1
4
2
Edge-and SDN-Assisted
Frameworks for HAS
3
SFC-Enabled Architecture
for HAS
Collaborative Edge-Assisted
Frameworks for HAS
5
Hybrid P2P-CDN
Architectures for HAS
06
Conclusions
6
-Conclusions
-Publications
2
4. Motivation
2
3
4
5
6
1
4
● Video is dominating today’s Internet traffic
○ Video streaming includes 66% of the total video Internet traffic [1]
○ Video-on-Demand (VoD) and live streaming have become
significantly popular video streaming applications
○ Live streaming will increase 15-fold and reach 17% of Internet video
traffic [2]
[1] Sandvine, “The Global Internet Phenomena Report,” White Paper, 2023. https://www.sandvine.com/global-internet-phenomena-report-2023
[2] Cisco Visual Networking Index (VNI), Forecast and Trends, 2018– 2023. White Paper, 2018.
https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11-741490.pdf
5. HTTPAdaptive Video Streaming (HAS)
2
3
4
5
6
1
5
1
2
3
4
5 5
5
6
6
6 7
Encoder
Origin
Packager
CDNs
HTTP Res
HTTP Req
Reza Shokri Kalan, Reza Farahani, Emre Karsli, Christian Timmerer, and Hermann Hellwagner. Towards Low Latency Live Streaming: Challenges in a Real-world Deployment. 13th ACM MMSys, 2022.
Quality
Bandwidth
Time
Time
7. SFC
Modern NAVS Systems
2
3
4
5
6
1
7
SDN NFV
Hybrid Systems
NAVS Systems
Networking Paradigms
Content Delivery Networks
Emerging Protocols
Techniques
Computing Continuum Nodes
Edge
Cloud
Fog
CMAF
QUIC
LL-HAS
CMCD/SD
Transcoding
Multi Paradigms
Hybrid P2P-CDN
Caching Prefetching
CDN
P2P
Super-Resolution
Slicing
8. RQ1 How can SDNs/CDNs provide assistance for HAS clients in order to improve media
delivery services?
Research Questions
2
3
4
5
6
1
8
How can resources (i.e., computation, storage, bandwidth) provided by the
HAS clients be used to improve media delivery services?
RQ2
9. Research Questions
2
3
4
5
6
1
9
RQ3
RQ4
What is the utility of the proposed assistance and collaboration service?
How can the utility of the proposed NAVS frameworks be thoroughly evaluated,
both theoretically and practically?
13. Edge and SDN-Assisted Framework for HAS
2
R. Farahani, et al. "ES-HAS: An Edge-and SDN-Assisted Framework for HTTP Adaptive Video Streaming", The 31st ACM
Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), 2021.
R. Farahani, et al. "CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming", IEEE 46th
Conference on Local Computer Networks (LCN), 2021.
13
17. SABR Framework
3
4
5
6
1
2
17
Bhat, D., Rizk, A., Zink, M. and Steinmetz, R. Network assisted content distribution for adaptive bitrate video streaming. In Proceedings of the 8th ACM MMSys, 2017.
SABR: Network assisted content distribution for adaptive bitrate video streaming
21. ES-HAS System
3
4
5
6
1
2
20
● ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
○ Virtual Reverse Proxy (VRP) servers at the edge of an SDN-enablebd Network
28. CSDN System
3
4
5
6
1
2
26
● CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming
○ It equips the ES-HAS VRP with the transcoding capability
30. CSDN Server/Segment Selection Policy
3
4
5
6
1
2
28
Serving Time
Quality Deviation
1. When the requested quality level exist in the cache servers (Cache Hit)
○ find the cache server with minimum serving time
2. When the requested quality level is not available in any cache server (Cache Miss)
○ use replacement quality from a cache server with minimum fetch time
○ transcode the original quality from better quality level at the edge
○ fetch the original requested quality from the origin server
34. SFC-Enabled Architecture for HAS
3
R. Farahani, et al. "SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications", IEEE International Conference
on Communications (ICC), 2023.
32
35. Motivation
4
5
6
1
2
3
33
● OTT video
● Live video streaming
● Immersive multimedia
● Video Gaming
● Video analytics for security,
quality assurance, etc.
Increase in amount of video
generated and transported
36. Motivation
4
5
6
1
2
3
33
● OTT video
● Live video streaming
● Immersive multimedia
● Video Gaming
● Video analytics for security,
quality assurance, etc.
Increase in amount of video
generated and transported
Versatile QoE, QoS requirements
Resolution (4K, 8K)
Latency (LL,ULL)
Bitrate
37. Motivation
4
5
6
1
2
3
33
● OTT video
● Live video streaming
● Immersive multimedia
● Video Gaming
● Video analytics for security,
quality assurance, etc.
Increase in amount of video
generated and transported
Versatile QoE, QoS requirements
Resolution (4K, 8K)
Latency (LL,ULL)
Bitrate
38. Motivation
4
5
6
1
2
3
34
SDN
S
F
C
HAS
M
E
C
● How to leverage modern networking/computing paradigms to serve different MSs
requests with acceptable QoE and improved network utilization?
● How to design a network-assisted HAS scheme without client-side modification ?
39. Service Function Chaining (SFC)
4
5
6
1
2
3
35
VNF i VNF i+1 VNF n
VNF i VNF i+1 VNF n
SFC
Chains
Chain
1
Chain
m
…
…
…
40. Service Function Chaining (SFC)
4
5
6
1
2
3
35
VNF i VNF i+1 VNF n
VNF i VNF i+1 VNF n
SFC
Chains
Chain
1
Chain
m
…
…
…
Orchestration
Placement
Scheduling
SFC
Definition
VNF
Definition
43. SARENA Optimization Model
4
5
6
1
2
3
38
● The Requests Scheduler run an MILP optimization model to respond:
○ Where is the optimal place for fetching the content quality level requested by each
client, while efficiently employing layers’ available resources and satisfying service
requirements (e.g., service deadlines)?
○ How can we use the functions/services provided in the EL and IL layers to form MS
function chains (SFCs)?
○ What is the optimal SFC for responding to the requested quality level with specific
service requirements?
Total MSs Serving Latency
Transmitting Time
Transcoding Time
45. SARENATestbed
4
5
6
1
2
3
40
A cloud-based testbed, including 280 elements and real backbone topology (InternetMCI)
○ Xen virtual machines
○ 250 Dash player
○ Four Apache cache servers and an origin server
○ 19 backbone switches and 45 layer-2 links
○ Five edge server
○ Floodlight SDN controller
○ BOLA ABR algorithms
○ FFmpeg transcoders
○ LRU cache replacement policy
○ Zipf distribution is used for video and channel access popularity
47. Evaluation Methods and Metrics
4
5
6
1
2
3
41
✔ Baseline systems:
◆ CDN-assisted (CDA)
◆ Non VNF-assisted (NVA)
◆ Non VTF-enabled (NTE)
◆ Non Reconfiguration-enabled (NRE)
✔ The performance of the aforementioned approaches is evaluated through
◆ ASB: Average Segment Bitrate
◆ AQS: Average Number of Quality Switches
◆ ANS: Average Number of Stalls
◆ ASD: Average Stall Duration
◆ APQ: Average Perceived QoE calculated by ITU-T P.1203 mode 0 [1]
◆ ASL: Overall time for serving
◆ NCV: Network Cost Value
◆ ETR: Edge/P2P Transcoding Ratio
◆ BTL: Backhaul Traffic Load
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
48. SARENA Results
4
5
6
1
2
3
42
ASB: Average Segment Bitrate
AQS: Average Number of Quality
Switches
ANS: Average Number of Stalls
ASD: Average Stall Duration
APQ: Average Perceived QoE
calculated by ITU-T P.1203 mode 0 [1]
ASL: Average Serving Latency
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
50. Collaborative Edge-Assisted Frameworks for HAS
4
R. Farahani, et al., "LEADER: A Collaborative Edge- and SDN-Assisted Framework for HTTP Adaptive Video
Streaming". IEEE International Conference on Communications (ICC), 2022.
R. Farahani, et al., "ARARAT: A Collaborative Edge-Assisted Framework for HTTP Adaptive Video Streaming", IEEE
Transactions on Network and Service Management (TNSM), 2022.
51. 5
6
1
2
3
4
45
Motivation
✔ Establish a collaboration between edge servers to use their potential idle
resources for serving HAS clients.
M
E
C
SDN
N
F
V
H
A
S
56. LEADER and ARARATAction Tree
4
5
6
1
2
3
48
5
6
1
2
3
4
LEADER Action Tree ARARAT Action Tree
57. LEADER/ARARAT Optimization Models
4
5
6
1
2
3
49
● The SDN controller run an MILP optimization model to respond:
○ Where is the optimal place (i.e., LES, NESs, CSs, or the origin server) in terms of the
following items for fetching each client’s requested content quality level from?
■ minimum serving time (LEADER)
■ minimum serving time and minimum network cost (ARARAT)
○ What is the optimal approach for responding to the requested quality level (i.e., fetch
or transcode)?
Serving Latency
5
6
1
2
3
4
Network Cost
LEADER ARARAT
62. ARARAT Fine-Grained II (FG II) Heuristic
4
5
6
1
2
3
52
5
6
1
2
3
4
The bandwidth allocation is modeled as a “Fairness LP Optimization Model”
63. ARARATTestbed
1
53
● A cloud-based testbed, including 301 elements (Xen virtual machines) and real backbone topology
(Geant and Abilene)
4
5
6
1
2
3
5
6
1
2
3
4
64. 1
54
4
5
6
1
2
3
5
6
1
2
3
4
Evaluation Methods
✔ SABR:
◆ Non edge-enabled system
✔ ES-HAS
◆ Non edge-collaborative and transcoding-enabled system
◆ Each edge runs an MILP model on the collected client requests to serve them via one of actions
1, 7, or 9
✔ CSDN
◆ Non-collaborative approach
◆ Each edge server runs an MILP model for the collected client requests and serves them
separately via one of the actions 1, 2, 7, 8 or 9
✔ NECOL
◆ The Non Edge Collaborative (NECOL) system does not support an edge collaboration.
◆ Each NECOL edge server executes a simplified version of the proposed FG I heuristic for
◆ each client request to serve it through one of the actions 1, 2, 7, 8 or 9
✔ DECOL
◆ Default Edge Collaborative (DECOL)
◆ Run the proposed FG I heuristic
65. 1
55
4
5
6
1
2
3
5
6
1
2
3
4
LEADER Results
ASB: Average Segment Bitrate
AQS: Average Number of Quality Switches
ANS: Average Number of Stalls
ASD: Average Stall Duration
APQ: Average Perceived QoE calculated by
ITU-T P.1203 mode 0 [1]
CHR: Cache Hit Ratio
ETR: Edge Transcoding Ratio
BTL: Backhaul Traffic Load
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
66. 1
56
4
5
6
1
2
3
5
6
1
2
3
4
ARARAT Results
ASB: Average Segment Bitrate
AQS: Average Number of Quality
Switches
ANS: Average Number of Stalls
ASD: Average Stall Duration
APQ: Average Perceived QoE
calculated by ITU-T P.1203 mode 0 [1]
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
67. 1
57
4
5
6
1
2
3
5
6
1
2
3
4
ARARAT Results
CHR: Cache Hit Ratio
ETR: Edge Transcoding Ratio
BTL: Backhaul Traffic Load
ANU: Average Network Utilization
ASL: Average Serving Time
NCV: Network Cost Value
ANC: Average Number of Communicated
messages from/to the SDN controller
68. Hybrid P2P-CDN Architectures for HAS
5
R. Farahani, et al., "Hybrid P2P-CDN Architecture for Live Video Streaming: An Online Learning Approach”. IEEE Global
Communications Conference (GLOBECOM), 2022.
R. Farahani, et al., "RICHTER: Hybrid P2P- CDN Architecture for Low Latency Live Video Streaming”. ACM Mile-High Video
Conference (MHV), 2022.
R. Farahani, et al., "ALIVE: A Latency- and Cost-Aware Hybrid P2P-CDN Framework for Live Video Streaming", submitted to
IEEE Transactions on Network and Service Management (TNSM), 2023.
73. RICHTER and ALIVE Action Tree
63
RICHTER Action Tree ALIVE Action Tree
6
1
2
3
4
5
74. RICHTER/ALIVE Optimization Models
4
5
6
1
2
3
64
● The VTS server must respond:
○ Where is the optimal place (i.e., adjacent peers, VTS, CDN servers, or origin server) in
terms of the following items for fetching each client’s requested content quality level
from?
■ minimum serving time (RICHTER)
■ minimum serving time and minimum network cost (ALIVE)
○ What is the optimal approach for responding to the requested quality level (i.e., fetch
,transcode, or upscale)?
Serving Latency
5
6
1
2
3
4 Network Cost
RICHTER ALIVE
6
1
2
3
4
5
75. RICHTER Online Learning (OL) Approach
4
5
6
1
2
3
65
● Leverage new modules, classification technique to introduce an OL heuristic approach
● Self Organizing Map (SOM) is adopted as the request management solution in the OL agent:
○ popular technique for unsupervised classification problems
○ can be applied to solve NP-hard problems
○ does not require a prepared dataset for supervised model training
● Alive runs a simplified version that is based on the Greedy approach
5
6
1
2
3
4
6
1
2
3
4
5
Node
Action
Req#
Violation
78. 67
Evaluation Methods
✔ NOH:
◆ Non Hybrid system like traditional CDN based methods
✔ SEH:
◆ Simple Edge-enabled Hybrid
◆ It employs a simple VTS server without caching and transcoding capabilities
✔ NTH
◆ Non Transcoding-enabled Hybrid
◆ It has a VTS server with only caching capability
✔ ECT
◆ Edge Caching/Transcoding Hybrid
◆ It does not include transcoding and super-resolution at the peer side
✔ NSH
◆ Non SR-enabled Hybrid (RICHTER using Greedy apprach)
◆ There is no super-resolution feature on the peer side
4
5
6
1
2
3
5
6
1
2
3
4
6
1
2
3
4
5
80. 69
RICHTER Results
4
5
6
1
2
3
5
6
1
2
3
4
6
1
2
3
4
5
ASB: Average Segment Bitrate
AQS: Average Number of Quality Switches
ANS: Average Number of Stalls
ASD: Average Stall Duration
APQ: Average Perceived QoE calculated by
ITU-T P.1203 mode 0 [1]
ASL: Average Serving Time
CHR: Cache Hit Ratio
ETR: Edge Transcoding Ratio
BTL: Backhaul Traffic Load
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
81. 70
ALIVE Results
4
5
6
1
2
3
5
6
1
2
3
4
6
1
2
3
4
5
ASB: Average Segment Bitrate
AQS: Average Number of Quality Switches
ANS: Average Number of Stalls
ASD: Average Stall Duration
ASL: Average Serving Time
APQ: Average Perceived QoE calculated by
ITU-T P.1203 mode 0 [1]
[1] https://www.itu.int/net4/ipr/details_ps.aspx?sector=ITU-T&id=P1203-01
84. Conclusions
How can SDNs/CDNs provide assistance for HAS clients in
order to improve media delivery services?
RQ1
1
2
3
4
5
6 73
● ES-HAS and CSDN frameworks
○ Introduce Virtual Reverse Proxy function to act as a gateway between HAS
clients and the network
○ Design new server/segment selection policies
● SARENA framework
○ Design VNFs that can be chained under an SDN controller’s coordination to
establish different types of video streaming services
● LEADER and ARARAT frameworks
○ Establish a collaboration between edge servers under an SDN controller’s
coordination
○ Propose Action Tree including all possible actions to serve requests
○ Propose fair bandwidth allocation startegies
85. Conclusions
How can resources (i.e., computation, storage, bandwidth)
provided by the HAS clients be used to improve media delivery
services?
RQ2
1
2
3
4
5
6 74
● RICHTER and ALIVE frameworks
○ Hybrid P2P-CDN NAVS systems for HAS clients in live streaming
applications
○ Employing idle computational resources and available bandwidth of HAS
clients (i.e., peers) to offer distributed video processing services, such as video
transcoding and video super- resolution.
○ Propose Action Tree including all possible actions to serve requests
○ Propose heuristic algorithms to play decision-maker roles in large-scale
practical scenarios.
86. Conclusions
What is the utility of the proposed assistance and
collaboration service?
RQ3
1
2
3
4
5
6 75
● User QoE metrics (application QoS)
○ quality bitrate, number of quality switches, number of stalls, stalling duration,
serving times, VMAF values, standardized perceived quality.
● Network utilization metrics
○ cache hit ratio, transcoding ratio at the edge, transcoding ratio at the P2P
network, super-resolution ratio at the P2P network, computational cost,
backhaul bandwidth cost, number of communicated messages to/from the
SDN controller.
● Algorithm performance metrics
○ execution times and objective function values
87. Conclusions
RQ4
1
2
3
4
5
6 76
How can the utility of the proposed NAVS frameworks be
thoroughly evaluated, both theoretically and practically?
● Desine cloud-based testbeds to run realistic network topologies for all
proposed frameworks
○ Use tens/hundreds of elements, each of which runs Linux-based operating
systems inside Xen virtual machines.
○ Use two different ABR algorithm
○ Employ bitrate ladders of real video datasets
○ Use OpenFlow backbone switches and Floodlight SDN controller
○ Use realistic network traces, tools, and assumptions
○ Compare results with state-of-the-art and baseline approaches
88. First Author Publications
77
1. R. Farahani, E. Cetinkaya, C. Timmerer, M. Shojafar, M. Ghanbari, H. Hellwagner. ALIVE: A Latency- and Cost-Aware Hybrid P2P-CDN
Framework for Live Video Streaming. Submitted to IEEE Transactions on Network and Service Management (TNSM), 2023.
2. R. Farahani, C. Timmerer, H. Hellwagner. Towards Low-Latency and Energy-Efficient Hybrid P2P-CDN Live Video Streaming.
Submitted to IEEE COMSOC MMTC Communication-Frontiers, 2023.
3. R. Farahani, M. Shojafar, C. Timmerer, F. Tashtarian, M. Ghanbari, H. Hellwagner. ARARAT: A Collaborative Edge-Assisted Framework
for HTTP Adaptive Video Streaming. IEEE Transactions on Network and Service Management (TNSM), 2022.
4. R. Farahani, A. Bentaleb, C. Timmerer, M. Shojafar, R. Prodan, H. Hellwagner. SARENA: SFC-Enabled Architecture for Adaptive Video
Streaming Applications. IEEE International Conference on Communications (ICC), 2022.
5. R. Farahani, A. Bentaleb, E. Cetinkaya, C. Timmerer, R. Zimmermann, H. Hellwagner. Hybrid P2P-CDN Architecture for Live Video
Streaming: An Online Learning Approach. IEEE Global Communications Conference (GLOBECOM), 2022.
6. R. Farahani, F. Tashtarian, C. Timmerer, M. Ghanbari, H. Hellwagner. LEADER: A Collaborative Edge- and SDN-Assisted Framework for
HTTP Adaptive Video. IEEE International Conference on Communications (ICC), 2022.
7. R. Farahani, F. Tashtarian, H. Amirpour, C. Timmerer, M. Ghanbari, H. Hellwagner. CSDN: CDN-Aware QoE Optimization in SDN-Assisted
HTTP Adaptive Video Streaming. 46th IEEE Conference on Local Computer Networks (LCN), 2021.
8. R. Farahani, F. Tashtarian, A. Erfanian, C. Timmerer, M. Ghanbari, H. Hellwagner. ES-HAS: an edge- and SDN-assisted framework for
HTTP adaptive video streaming. 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV),
2021.
9. R. Farahani. CDN and SDN Support and Player Interaction for HTTP Adaptive Video Streaming. 12th ACM Multimedia Systems
Conference (MMSys), 2021.
10. R. Farahani, A. Bentaleb, M. Shojafar, H. Hellwagner. CP-Steering: CDN- and Protocol-Aware Content Steering Solution for HTTP
Adaptive Video Streaming. ACM Mile High Video (MHV), 2023.
11. R. Farahani, H. Amirpour, F. Tashtarian, A.Bentaleb, C. Timmerer, H. Hellwagner, and R. Zimmermann. RICHTER: Hybrid P2P-CDN
Architecture for Low Latency Live Video Streaming. ACM Mile-High Video (MHV), 2022.
89. Co-authored Publications
78
1. V. V Menon, R. Farahani, P. T Rajendran, H. Hellwagner, M. Ghanbari, C. Timmerer. Reduced Reference Transcoding Quality
Prediction for Video Streaming Applications. ACM Mile High Video (MHV), 2023.
2. V. V Menon, P. T Rajendran, R. Farahani, K. Schöffmann, C. Timmerer. Video Quality Assessment with Texture Information Fusion
for Streaming Applications. Submitted to the IEEE International Conference on Visual Communications and Image Processing (VCIP),
2023.
3. V. V Menon, R. Farahani, P. T Rajendran, S. Afzal, K. Schöffmann, C. Timmerer. Energy-Efficient Multi-Codec Bitrate-Ladder
Estimation for Adaptive Video Streaming. Submitted to the IEEE International Conference on Visual Communications and Image
Processing (VCIP), 2023.
4. S. Chellappa, R. Farahani, R. Bartos, H. Hellwagner. Context-Aware HTTP Adaptive Video Streaming Utilizing QUIC’s Stream Priority.
ACM Mile High Video (MHV), 2023.
5. A. Bentaleb, R. Farahani, F. Tashtarian, H. Hellwagner, R.Zimmermann. Which CDN to Download From? A Client and Server
Strategies. ACM Mile High Video (MHV), 2023.
6. R. Shokri Kalan, R. Farahani, E. Karsli, C. Timmerer, H. Hellwagner. Towards Low Latency Live Streaming: Challenges in
Real-World Deployment. The 13th ACM Multimedia Systems Conference (MMSys), 2022.
7. F. Tashtarian, A. Bentaleb, R. Farahani, M. Nguyen, C. Timmerer, H.Hellwagner, R. Zimmermann. A Distributed Delivery Architecture
for User Generated Content Live Streaming over HTTP. IEEE 46th Conference on Local Computer Networks (LCN), 2021.
8. A. Erfanian, F. Tashtarian, R. Farahani, C. Timmerer, H. Hellwagner. On Optimizing Resource Utilization in AVC-based Real-time
Video Streaming. The 6th IEEE Conference on Network Softwarization (NetSoft), 2020.
92. RICHTER Online Learning (OL) Approach
4
5
6
1
2
3
65
● Leverage new modules, classification technique to introduce an OL heuristic approach
● Self Organizing Map (SOM) is adopted as the request management solution in the OL agent:
○ popular technique for unsupervised classification problems
○ can be applied to solve NP-hard problems
○ does not require a prepared dataset for supervised model training
● Alive runs a simplified version that is based on the Greedy approach
5
6
1
2
3
4
6
1
2
3
4
5
Node
Action
Req#
Violation
96. ES-HAS Results
3
4
5
6
1
2
● We analyze the Impact of different parameters on ES-HAS MILP model behavior by:
○ ACS : the average usage percentage of cache servers with the shortest fetch time
○ AMD: the average (for different accepted max-deviation value) of the maximum
deviation between requested quality and forwarded quality
○ AQB: the average of the video quality bitrate for all received segments in Mbps
97. Problem Formulation
Central MILP Optimization Model
Constraints & Objective Function
✓ Resource Map
✓ Requests
✓ Videos Information
✓ Computational Cost
Optimal action for each request
98. Fine-Grained II (FG II)-- Bandwidth Allocation Strategy
BwAllocation request
Minimum fairness value among
all fairness coefficient.
✔ The bandwidth allocation is modeled as a “Fairness LP Optimization Model”
The fairness coefficient to the shared link(a, b)
in the route between i and j.
The allocated bandwidth to the shared link(a, b)
in the route between i and j.
98
100. Evaluation Results-- Scenario I
✔ This scenario compares the proposed centralized optimization MILP model and the CG and FG
approaches in terms of:
◆ ETV: Execution Time Values for the different ARARAT schemes.
◆ NOV: Normalized Objective Value for the ARARAT schemes.
101. Evaluation Results-- Scenario I
✔ This scenario compares the proposed centralized optimization MILP model and the CG and FG
approaches in terms of:
◆ ETV: Execution Time Values for the different ARARAT schemes.
◆ NOV: Normalized Objective Value for the ARARAT schemes.
102. Evaluation Results-- Scenario I
✔ This scenario compares the proposed centralized optimization MILP model and the CG and FG
approaches in terms of:
◆ ETV: Execution Time Values for the different ARARAT schemes.
◆ NOV: Normalized Objective Value for the ARARAT schemes.
103. Evaluation Results-- Scenario I
✔ This scenario compares the proposed centralized optimization MILP model and the CG and FG
approaches in terms of:
◆ ETV: Execution Time Values for the different ARARAT schemes.
◆ NOV: Normalized Objective Value for the ARARAT schemes.