As computing performance and network technology have evolved, mobile device users can enjoy
high quality multimedia more easily. Remote Display - the technology which mirrors the screen
of one device to another device - allows handheld mobile devices to share their screen contents
with larger-sized display devices such as TVs. However, there is general concern about high
power consumption caused by complex computation for encoding and continuous data
transmission in the mobile devices.
In this paper, we present an adaptive remote display framework considering and utilizing the
processing capability of display device. By supporting the Content Mirroring Mode, we can skip
unnecessary steps and perform core activities to improve power efficiency and extend overall
processing capability.
An Overview on Multimedia Transcoding Techniques on Streaming Digital Contentsidescitation
The current IT infrastructure as well as various
commercial applications are directly formulated based on
deployment in multimedia system e.g. education, marketing,
risk management, tele-medicines, military etc. One of the
challenges found in using such application is to deliver
uninterrupted stream of video between multiple terminals
e.g. smart-phone, PDAs, laptops, IPTV etc. The research shows
that there is a stipulated need of designing novel mechanism
of bit rate adjustment as well as format conversion policy so
that the source stream may stream well in diverse end devices
with multiple configuration of processor, memory, decoding
etc. This paper discusses various eminent points from
literature that will throw better highlights in understanding
a schema of direct digital-to-digital data conversion of one
encoding to another termed as transcoding. Although
multimedia transcoding has covered more than a decade in
the area of research, but unfortunately, there is a huge trade-
off between the application, service, resource constraint, and
hardware design that gives rise to QoS issues.
The document proposes a secured reversible data transmission method for encoded AVC video using a Gzip Deflector algorithm. It embeds residual information from a visible watermarking process using reversible contrast mapping after compressing the information with Gzip Deflector and encrypting it with AES. Simulation results showed the proposed method achieved up to 7dB higher PSNR than the state of the art approach when recovering the original video frames.
EFFICIENT HARDWARE CO-SIMULATION OF DOWN CONVERTOR FOR WIRELESS COMMUNICATION...VLSICS Design
The document describes an efficient hardware co-simulation approach for designing a digital down converter (DDC) for software defined radios. The proposed DDC uses optimal equiripple techniques to reduce resource requirements. It employs a computationally efficient polyphase decomposition structure to improve hardware complexity. The DDC is implemented using embedded multipliers, lookup tables, and block RAMs of a Virtex-II Pro FPGA. Simulation results show the DDC can operate at 160 MHz while consuming 0.34004W. It utilizes few FPGA resources, providing a cost-effective solution for software defined radio applications.
This document discusses how modern wireless network operators can more efficiently optimize their 3G networks by overcoming limitations of traditional drive test-based optimization strategies. It notes that drive testing is costly and provides limited visibility, especially for uplink activity. The document recommends integrating protocol-based network monitoring with on-demand drive testing. This allows operators to resolve 3G network issues while realizing up to 60% savings in operating expenses. It also helps operators successfully roll out new services without degradation in quality of experience.
This document summarizes an article that proposes modifications to the JPEG 2000 image compression standard to achieve higher compression ratios while maintaining acceptable error rates. The proposed Adaptive JPEG 2000 technique involves pre-processing images with a transfer function to make them more suitable for compression by JPEG 2000. This is intended to provide higher compression ratios than the original JPEG 2000 standard while keeping root mean square error within allowed thresholds. The document provides background on JPEG 2000 and lossy image compression techniques, describes the proposed pre-processing approach, and indicates it was tested on single-channel images.
Decision Making Analysis of Video Streaming Algorithm for Private Cloud Compu...IJECEIAES
The issue on how to effectively deliver video streaming contents over cloud computing infrastructures is tackled in this study. Basically, quality of service of video streaming is strongly influenced by bandwidth, jitter and data loss problems. A number of intelligent video streaming algorithms are proposed by using different techniques to deal with such issues. This study aims to propose and demonstrate a novel decision making analysis which combines ISO 9126 (international standard for software engineering) and Analytic Hierarchy Process to help experts selecting the best video streaming algorithm for the case of private cloud computing infrastructure. The given case study concluded that Scalable Streaming algorithm is the best algorithm to be implemented for delivering high quality of service of video streaming over the private cloud computing infrastructure.
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/may-2019-embedded-vision-summit-gormish
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Michael Gormish, Research Manager at Clarifai, presents the "Machine Learning- based Image Compression: Ready for Prime Time?" tutorial at the May 2019 Embedded Vision Summit.
Computer vision is undergoing dramatic changes because deep learning techniques are now able to solve complex non-linear problems. Computer vision pipelines used to consist of hand engineered stages mathematically optimized for some carefully chosen objective function. These pipelines are being replaced with machine- learned stages or end-to-end learning techniques where enough ground truth data is available.
Similarly, for decades image compression has relied on hand crafted algorithm pipelines, but recent efforts using deep learning are reporting higher image quality than that provided by conventional techniques. Is it time to replaced discrete cosine transforms with machine-learned compression techniques?
This talk examines practical aspects of deep learned image compression systems as compared with traditional approaches. Gormish considers memory, computation and other aspects, in addition to rate-distortion, to see when ML-based compression should be considered or avoided. He also discusses approaches using a combination of machine learned and traditional techniques.
This document summarizes key concepts from Chapter 2 of the textbook "Computer Science: An Overview" by J. Glenn Brookshear. It discusses the central processing unit and computer architecture, including registers, buses, and memory. It also covers machine language, instruction types, and program execution. Additional topics include arithmetic/logic instructions, communicating with peripheral devices, and other computer architectures like parallel processing and multicore CPUs.
An Overview on Multimedia Transcoding Techniques on Streaming Digital Contentsidescitation
The current IT infrastructure as well as various
commercial applications are directly formulated based on
deployment in multimedia system e.g. education, marketing,
risk management, tele-medicines, military etc. One of the
challenges found in using such application is to deliver
uninterrupted stream of video between multiple terminals
e.g. smart-phone, PDAs, laptops, IPTV etc. The research shows
that there is a stipulated need of designing novel mechanism
of bit rate adjustment as well as format conversion policy so
that the source stream may stream well in diverse end devices
with multiple configuration of processor, memory, decoding
etc. This paper discusses various eminent points from
literature that will throw better highlights in understanding
a schema of direct digital-to-digital data conversion of one
encoding to another termed as transcoding. Although
multimedia transcoding has covered more than a decade in
the area of research, but unfortunately, there is a huge trade-
off between the application, service, resource constraint, and
hardware design that gives rise to QoS issues.
The document proposes a secured reversible data transmission method for encoded AVC video using a Gzip Deflector algorithm. It embeds residual information from a visible watermarking process using reversible contrast mapping after compressing the information with Gzip Deflector and encrypting it with AES. Simulation results showed the proposed method achieved up to 7dB higher PSNR than the state of the art approach when recovering the original video frames.
EFFICIENT HARDWARE CO-SIMULATION OF DOWN CONVERTOR FOR WIRELESS COMMUNICATION...VLSICS Design
The document describes an efficient hardware co-simulation approach for designing a digital down converter (DDC) for software defined radios. The proposed DDC uses optimal equiripple techniques to reduce resource requirements. It employs a computationally efficient polyphase decomposition structure to improve hardware complexity. The DDC is implemented using embedded multipliers, lookup tables, and block RAMs of a Virtex-II Pro FPGA. Simulation results show the DDC can operate at 160 MHz while consuming 0.34004W. It utilizes few FPGA resources, providing a cost-effective solution for software defined radio applications.
This document discusses how modern wireless network operators can more efficiently optimize their 3G networks by overcoming limitations of traditional drive test-based optimization strategies. It notes that drive testing is costly and provides limited visibility, especially for uplink activity. The document recommends integrating protocol-based network monitoring with on-demand drive testing. This allows operators to resolve 3G network issues while realizing up to 60% savings in operating expenses. It also helps operators successfully roll out new services without degradation in quality of experience.
This document summarizes an article that proposes modifications to the JPEG 2000 image compression standard to achieve higher compression ratios while maintaining acceptable error rates. The proposed Adaptive JPEG 2000 technique involves pre-processing images with a transfer function to make them more suitable for compression by JPEG 2000. This is intended to provide higher compression ratios than the original JPEG 2000 standard while keeping root mean square error within allowed thresholds. The document provides background on JPEG 2000 and lossy image compression techniques, describes the proposed pre-processing approach, and indicates it was tested on single-channel images.
Decision Making Analysis of Video Streaming Algorithm for Private Cloud Compu...IJECEIAES
The issue on how to effectively deliver video streaming contents over cloud computing infrastructures is tackled in this study. Basically, quality of service of video streaming is strongly influenced by bandwidth, jitter and data loss problems. A number of intelligent video streaming algorithms are proposed by using different techniques to deal with such issues. This study aims to propose and demonstrate a novel decision making analysis which combines ISO 9126 (international standard for software engineering) and Analytic Hierarchy Process to help experts selecting the best video streaming algorithm for the case of private cloud computing infrastructure. The given case study concluded that Scalable Streaming algorithm is the best algorithm to be implemented for delivering high quality of service of video streaming over the private cloud computing infrastructure.
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/may-2019-embedded-vision-summit-gormish
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Michael Gormish, Research Manager at Clarifai, presents the "Machine Learning- based Image Compression: Ready for Prime Time?" tutorial at the May 2019 Embedded Vision Summit.
Computer vision is undergoing dramatic changes because deep learning techniques are now able to solve complex non-linear problems. Computer vision pipelines used to consist of hand engineered stages mathematically optimized for some carefully chosen objective function. These pipelines are being replaced with machine- learned stages or end-to-end learning techniques where enough ground truth data is available.
Similarly, for decades image compression has relied on hand crafted algorithm pipelines, but recent efforts using deep learning are reporting higher image quality than that provided by conventional techniques. Is it time to replaced discrete cosine transforms with machine-learned compression techniques?
This talk examines practical aspects of deep learned image compression systems as compared with traditional approaches. Gormish considers memory, computation and other aspects, in addition to rate-distortion, to see when ML-based compression should be considered or avoided. He also discusses approaches using a combination of machine learned and traditional techniques.
This document summarizes key concepts from Chapter 2 of the textbook "Computer Science: An Overview" by J. Glenn Brookshear. It discusses the central processing unit and computer architecture, including registers, buses, and memory. It also covers machine language, instruction types, and program execution. Additional topics include arithmetic/logic instructions, communicating with peripheral devices, and other computer architectures like parallel processing and multicore CPUs.
The document provides information about a seminar presentation on digital image processing. It discusses the following key points:
- The presentation was given by two students and covered topics like the introduction, history, functional categories, steps, necessity, filtering, technologies, advantages/disadvantages, and applications of digital image processing.
- A brief history of digital image processing is provided, noting its origins in newspaper printing and early uses in space applications and medical imaging.
- Functional categories of digital image processing include image enhancement, restoration, and information extraction. Key steps involve acquisition, enhancement, restoration, compression, and segmentation.
- Technologies discussed include pixelization, component analysis, independent component analysis, hidden Markov models,
VIDEO QUALITY ASSESSMENT USING LAPLACIAN MODELING OF MOTION VECTOR DISTRIBUTI...sipij
Video/Image quality assessment (VQA/IQA) is fundamental in various fields of video/image processing.
VQA reflects the quality of a video as most people commonly perceive. This paper proposes a reducedreference
mobile VQA, in which one-dimensional (1-D) motion vector (MV) distributions are used as
features of videos. This paper focuses on reduction of data size using Laplacian modeling of MV
distributions because network resource is restricted in the case of mobile video. The proposed method is
more efficient than the conventional methods in view of the computation time, because the proposed quality
metric decodes MVs directly from video stream in the parsing process rather than reconstructing the
distorted video at a receiver. Moreover, in view of data size, the proposed method is efficient because a
sender transmits only 28 parameters. We adopt the Laplacian distribution for modeling 1-D MV
histograms. 1-D MV histograms accumulated over the whole video sequences are used, which is different
from the conventional methods that assess each image frame independently. For testing the similarity
between MV histogram of reference and distorted videos and for minimizing the fitting error in Laplacian
modeling process, we use the chi-square method. To show the effectiveness of our proposed method, we
compare the proposed method with the conventional methods with coded video clips, which are coded
under varying bit rate, image size, and frame rate by H.263 and H.264/AVC. Experimental results show
that the proposed method gives the performance comparable with the conventional methods, especially, the
proposed method requires much lower transmission data.
This document discusses a content-based video retrieval system based on dominant color and texture features. It begins with an introduction to content-based video retrieval and the challenges involved. It then describes representing video through segmentation into shots and frames. The proposed method extracts dominant color, texture, and color histogram features from frames. Texture is captured through gray-level co-occurrence matrix analysis. A combined feature vector is constructed and similarity measured through Euclidean distance. The system is aimed at efficient video retrieval through analyzing dominant color and texture information.
This document summarizes the technical work done to define, design, and implement the first version of the Energy Management Device (EMD). The EMD communicates with connected appliances to monitor and control their energy usage. It uses various communication interfaces like powerline, wireless, and Ethernet. The document describes the EMD's architecture, components, interfaces, protocols, and example usage scenarios to realize energy monitoring and savings applications. Although the specified EMD architecture is final, the physical device will be optimized in a second phase.
pune muncipal corporation project reportyochoudhary
1) The document discusses implementing an ERP system for Pune Municipal Corporation to improve citizen services, data sharing between departments, and decision making.
2) Key aspects covered include the project scope, implementation methodology, cost estimates, and benefits.
3) An ERP system combined with GIS and other applications is proposed to deliver improved citizen services, integrated departmental functions, and data-driven management.
This white paper proposes a network-based approach to personalized media delivery. The key aspects are:
1) Content is prepared using MPEG-4 tools to create object-based media streams that can be flexibly manipulated.
2) Streams are integrated into a session and transported over the network.
3) A network element performs real-time media processing to customize streams for each user, device, and network conditions before reaching the STB. This allows personalization without upgrading all STBs.
This document proposes a bi-level/full-color video combination scheme to enable video communication across a wide range of bandwidths. Bi-level video uses 1 bit per pixel and works well below 56 Kbps, while full-color video has higher quality but requires over 33.6 Kbps. The scheme uses bandwidth estimation to switch between the two formats in the 33.6-56 Kbps range for smooth adaptation. It estimates available bandwidth from receiver feedback on packet loss and round-trip time, then adjusts the video format accordingly.
This document provides a European standard for a second generation digital transmission system for cable systems, known as DVB-C2. It defines the system architecture, input processing, bit-interleaved coding and modulation, data slice packet generation, layer 1 part 2 signalling generation and coding, frame builder functions, and OFDM generation for the DVB-C2 system. The standard specifies the frame structure, coding, modulation, and other technical aspects to enable digital video and audio broadcasting over cable networks.
The document provides an overview of ConsulMetrix's Network Transition Process Methodology (NTPM) and related services for modeling and planning technology architectures and transitions. NTPM defines virtual technology architectures, organizes application logic, and establishes phasing for enterprise technology processes. It utilizes a database and software tools to create 3D models of network infrastructure and optimize costs. ConsulMetrix offers consulting services to customize these tools and design integrated technology solutions for clients' facilities and networks.
This document summarizes a research paper that investigates the effects of different group of pictures (GOP) sizes on the quality of reconstructed multiview video content transmitted over error prone channels. It finds that while larger GOP sizes allow for greater compression, they can also propagate errors spatially and temporally. It proposes a multi-layer data partitioning technique to make the multiview video bitstream more robust to errors, and implements frame copy error concealment in the decoder to replace lost information. Simulation results show the multi-layer approach performs better than standard H.264 data partitioning at higher error rates.
This document provides an overview of image processing. It discusses acquiring images through various methods like cameras and converting them to digital formats. It also covers preprocessing techniques like enhancement, restoration and geometry transformations. Additional topics include image compression, analysis through techniques like segmentation and pattern recognition, and applications in medical imaging, remote sensing, and more. The document concludes by mentioning some common image processing software tools.
Multiple Binary Images Watermarking in Spatial and Frequency Domainssipij
Editing, reproduction and distribution of the digital multimedia are becoming extremely easier and faster with the existence of the internet and the availability of pervasive and powerful multimedia tools. Digital watermarking has emerged as a possible method to tackle these issues. This paper proposes a scheme using which more data can be inserted into an image in different domains using different techniques. This increases the embedding capacity. Using the proposed scheme 24 binary images can be embedded in the DCT domain and 12 binary images can be embedded in the spatial domain using LSB substitution technique in a single RGB image. The proposed scheme also provides an extra level of security to the watermark image by scrambling the image before embedding it into the host image. Experimental results show that the proposed watermarking method results in almost invisible difference between the watermarked image and the original image and is also robust against various image processing attacks.
A Novel Digital Watermarking Technique for Video Copyright Protection cscpconf
This paper proposes a novel digital video watermarking technique that embeds both visible and invisible watermarks for improved copyright protection. The invisible watermark is embedded using discrete wavelet transform (DWT) in the high-high (HH) subband coefficients of video frames. The visible watermark is embedded partially in video frames depending on user input location. Experimental results on a gray-scale video show the embedded watermarks can be extracted after attacks like salt and pepper noise, Gaussian noise, and median filtering, with peak signal-to-noise ratios above 28 dB, demonstrating the technique's robustness.
A fragile watermarking based on binomial transform in color imagescsandit
In this paper, a novel Binomial Transform based fragile image watermarking technique has
been proposed for color image authentication. The Binomial Transform (BT) is used to convert
each 2 × 2 sub-image block of the carrier image into transformed block corresponding to red,
green and blue channels in sliding window manner. One/two/three watermark bits are
embedded in second/third/fourth transformed components starting from the least significant
bit’s position (LSB-0). An adjustment has been incorporated to adjust embedded component
closer to the actual value without hampering the fabricated bits. The inverse Binomial
transform (IBT) is used to convert the transformed components back into the spatial domain. A
delicate re-adjustment method is applied on the first transformed component to remain the pixel
components in a valid range. The embedding operation in succession generates the final
watermarked image. At the receiving end, whole watermark is extracted based on the reverse
procedure and authentication is done through computed message digest and extracted bits.
Experimental results conform that the proposed technique produces high payload and Peak
Signal to Noise Ratio (PSNR) as compared to existing transformation based techniques[1, 5].
A FRAGILE WATERMARKING BASED ON BINOMIAL TRANSFORM IN COLOR IMAGEScscpconf
In this paper, a novel Binomial Transform based fragile image watermarking technique has been proposed for color image authentication. The Binomial Transform (BT) is used to convert
each 2 × 2 sub-image block of the carrier image into transformed block corresponding to red, green and blue channels in sliding window manner. One/two/three watermark bits are embedded in second/third/fourth transformed components starting from the least significant bit’s position (LSB-0). An adjustment has been incorporated to adjust embedded component closer to the actual value without hampering the fabricated bits. The inverse Binomial
transform (IBT) is used to convert the transformed components back into the spatial domain. A delicate re-adjustment method is applied on the first transformed component to remain the pixel components in a valid range. The embedding operation in succession generates the final watermarked image. At the receiving end, whole watermark is extracted based on the reverse procedure and authentication is done through computed message digest and extracted bits. Experimental results conform that the proposed technique produces high payload and Peak Signal to Noise Ratio (PSNR) as compared to existing transformation based techniques[1, 5].
Video Compression, Part 4 Section 2, Video Quality Assessment Dr. Mohieddin Moradi
This document provides information on conducting subjective video quality assessments. It discusses different subjective assessment methods like double stimulus impairment scale (DSIS) and single stimulus continuous quality evaluation (SSCQE). It describes test parameters like number of observers, viewing conditions, grading scales and how to present the results. Guidelines are provided for tasks like screening observers, conducting test sessions, introducing impairments and collecting opinion scores to evaluate video coding standards and compression artifacts.
Total cost of ownership is a key metric for assessing costs, benefits and risks of a UC solution – enabling organizations to properly evaluate competing solutions. It aligns their final decision with business needs, while understanding the effects of future requirements and functionalities.
Android Live Streaming Box
This presentation will help create a android streaming box with low cost. its business plan for Multi purpose Android box with technical
Media box with live streaming
This document discusses remote screen rendering and monitoring using cloud and mobile computing. It proposes separating screen rendering from data storage and program execution by using remote servers in the cloud to handle computationally intensive tasks and deliver screen outputs to client devices. The cloud would handle screen capturing, rendering, and delivering rendered screen images to clients. This allows thin clients like mobile devices to access graphically rich applications hosted in the cloud. Various technical aspects of virtualized screen remoting and transmission are also addressed.
Probabilistic Approach to Provisioning of ITV - Amos K.Amos Kohn
This white paper discusses a probabilistic approach to provisioning network and computing resources for delivering interactive TV. It develops a proprietary spreadsheet model to estimate the costs and benefits of deploying an interactive TV streaming processor. The model is based on analyzing user behavior, data packaging into MPEG streams, required bit rates, transport of data over the forward and return paths, necessary processing power, and financial projections to calculate return on investment.
Probabilistic Approach to Provisioning of ITV - By Amos_KohnAmos Kohn
This white paper discusses a probabilistic approach to provisioning network and computing resources for delivering interactive TV. It develops a proprietary spreadsheet model to estimate the costs and benefits of deploying an interactive TV streaming processor. The model is based on analyzing user behavior, data packaging into MPEG streams, required bit rates, forward and return network paths, processing needs, and financial projections to calculate return on investment.
The document provides information about a seminar presentation on digital image processing. It discusses the following key points:
- The presentation was given by two students and covered topics like the introduction, history, functional categories, steps, necessity, filtering, technologies, advantages/disadvantages, and applications of digital image processing.
- A brief history of digital image processing is provided, noting its origins in newspaper printing and early uses in space applications and medical imaging.
- Functional categories of digital image processing include image enhancement, restoration, and information extraction. Key steps involve acquisition, enhancement, restoration, compression, and segmentation.
- Technologies discussed include pixelization, component analysis, independent component analysis, hidden Markov models,
VIDEO QUALITY ASSESSMENT USING LAPLACIAN MODELING OF MOTION VECTOR DISTRIBUTI...sipij
Video/Image quality assessment (VQA/IQA) is fundamental in various fields of video/image processing.
VQA reflects the quality of a video as most people commonly perceive. This paper proposes a reducedreference
mobile VQA, in which one-dimensional (1-D) motion vector (MV) distributions are used as
features of videos. This paper focuses on reduction of data size using Laplacian modeling of MV
distributions because network resource is restricted in the case of mobile video. The proposed method is
more efficient than the conventional methods in view of the computation time, because the proposed quality
metric decodes MVs directly from video stream in the parsing process rather than reconstructing the
distorted video at a receiver. Moreover, in view of data size, the proposed method is efficient because a
sender transmits only 28 parameters. We adopt the Laplacian distribution for modeling 1-D MV
histograms. 1-D MV histograms accumulated over the whole video sequences are used, which is different
from the conventional methods that assess each image frame independently. For testing the similarity
between MV histogram of reference and distorted videos and for minimizing the fitting error in Laplacian
modeling process, we use the chi-square method. To show the effectiveness of our proposed method, we
compare the proposed method with the conventional methods with coded video clips, which are coded
under varying bit rate, image size, and frame rate by H.263 and H.264/AVC. Experimental results show
that the proposed method gives the performance comparable with the conventional methods, especially, the
proposed method requires much lower transmission data.
This document discusses a content-based video retrieval system based on dominant color and texture features. It begins with an introduction to content-based video retrieval and the challenges involved. It then describes representing video through segmentation into shots and frames. The proposed method extracts dominant color, texture, and color histogram features from frames. Texture is captured through gray-level co-occurrence matrix analysis. A combined feature vector is constructed and similarity measured through Euclidean distance. The system is aimed at efficient video retrieval through analyzing dominant color and texture information.
This document summarizes the technical work done to define, design, and implement the first version of the Energy Management Device (EMD). The EMD communicates with connected appliances to monitor and control their energy usage. It uses various communication interfaces like powerline, wireless, and Ethernet. The document describes the EMD's architecture, components, interfaces, protocols, and example usage scenarios to realize energy monitoring and savings applications. Although the specified EMD architecture is final, the physical device will be optimized in a second phase.
pune muncipal corporation project reportyochoudhary
1) The document discusses implementing an ERP system for Pune Municipal Corporation to improve citizen services, data sharing between departments, and decision making.
2) Key aspects covered include the project scope, implementation methodology, cost estimates, and benefits.
3) An ERP system combined with GIS and other applications is proposed to deliver improved citizen services, integrated departmental functions, and data-driven management.
This white paper proposes a network-based approach to personalized media delivery. The key aspects are:
1) Content is prepared using MPEG-4 tools to create object-based media streams that can be flexibly manipulated.
2) Streams are integrated into a session and transported over the network.
3) A network element performs real-time media processing to customize streams for each user, device, and network conditions before reaching the STB. This allows personalization without upgrading all STBs.
This document proposes a bi-level/full-color video combination scheme to enable video communication across a wide range of bandwidths. Bi-level video uses 1 bit per pixel and works well below 56 Kbps, while full-color video has higher quality but requires over 33.6 Kbps. The scheme uses bandwidth estimation to switch between the two formats in the 33.6-56 Kbps range for smooth adaptation. It estimates available bandwidth from receiver feedback on packet loss and round-trip time, then adjusts the video format accordingly.
This document provides a European standard for a second generation digital transmission system for cable systems, known as DVB-C2. It defines the system architecture, input processing, bit-interleaved coding and modulation, data slice packet generation, layer 1 part 2 signalling generation and coding, frame builder functions, and OFDM generation for the DVB-C2 system. The standard specifies the frame structure, coding, modulation, and other technical aspects to enable digital video and audio broadcasting over cable networks.
The document provides an overview of ConsulMetrix's Network Transition Process Methodology (NTPM) and related services for modeling and planning technology architectures and transitions. NTPM defines virtual technology architectures, organizes application logic, and establishes phasing for enterprise technology processes. It utilizes a database and software tools to create 3D models of network infrastructure and optimize costs. ConsulMetrix offers consulting services to customize these tools and design integrated technology solutions for clients' facilities and networks.
This document summarizes a research paper that investigates the effects of different group of pictures (GOP) sizes on the quality of reconstructed multiview video content transmitted over error prone channels. It finds that while larger GOP sizes allow for greater compression, they can also propagate errors spatially and temporally. It proposes a multi-layer data partitioning technique to make the multiview video bitstream more robust to errors, and implements frame copy error concealment in the decoder to replace lost information. Simulation results show the multi-layer approach performs better than standard H.264 data partitioning at higher error rates.
This document provides an overview of image processing. It discusses acquiring images through various methods like cameras and converting them to digital formats. It also covers preprocessing techniques like enhancement, restoration and geometry transformations. Additional topics include image compression, analysis through techniques like segmentation and pattern recognition, and applications in medical imaging, remote sensing, and more. The document concludes by mentioning some common image processing software tools.
Multiple Binary Images Watermarking in Spatial and Frequency Domainssipij
Editing, reproduction and distribution of the digital multimedia are becoming extremely easier and faster with the existence of the internet and the availability of pervasive and powerful multimedia tools. Digital watermarking has emerged as a possible method to tackle these issues. This paper proposes a scheme using which more data can be inserted into an image in different domains using different techniques. This increases the embedding capacity. Using the proposed scheme 24 binary images can be embedded in the DCT domain and 12 binary images can be embedded in the spatial domain using LSB substitution technique in a single RGB image. The proposed scheme also provides an extra level of security to the watermark image by scrambling the image before embedding it into the host image. Experimental results show that the proposed watermarking method results in almost invisible difference between the watermarked image and the original image and is also robust against various image processing attacks.
A Novel Digital Watermarking Technique for Video Copyright Protection cscpconf
This paper proposes a novel digital video watermarking technique that embeds both visible and invisible watermarks for improved copyright protection. The invisible watermark is embedded using discrete wavelet transform (DWT) in the high-high (HH) subband coefficients of video frames. The visible watermark is embedded partially in video frames depending on user input location. Experimental results on a gray-scale video show the embedded watermarks can be extracted after attacks like salt and pepper noise, Gaussian noise, and median filtering, with peak signal-to-noise ratios above 28 dB, demonstrating the technique's robustness.
A fragile watermarking based on binomial transform in color imagescsandit
In this paper, a novel Binomial Transform based fragile image watermarking technique has
been proposed for color image authentication. The Binomial Transform (BT) is used to convert
each 2 × 2 sub-image block of the carrier image into transformed block corresponding to red,
green and blue channels in sliding window manner. One/two/three watermark bits are
embedded in second/third/fourth transformed components starting from the least significant
bit’s position (LSB-0). An adjustment has been incorporated to adjust embedded component
closer to the actual value without hampering the fabricated bits. The inverse Binomial
transform (IBT) is used to convert the transformed components back into the spatial domain. A
delicate re-adjustment method is applied on the first transformed component to remain the pixel
components in a valid range. The embedding operation in succession generates the final
watermarked image. At the receiving end, whole watermark is extracted based on the reverse
procedure and authentication is done through computed message digest and extracted bits.
Experimental results conform that the proposed technique produces high payload and Peak
Signal to Noise Ratio (PSNR) as compared to existing transformation based techniques[1, 5].
A FRAGILE WATERMARKING BASED ON BINOMIAL TRANSFORM IN COLOR IMAGEScscpconf
In this paper, a novel Binomial Transform based fragile image watermarking technique has been proposed for color image authentication. The Binomial Transform (BT) is used to convert
each 2 × 2 sub-image block of the carrier image into transformed block corresponding to red, green and blue channels in sliding window manner. One/two/three watermark bits are embedded in second/third/fourth transformed components starting from the least significant bit’s position (LSB-0). An adjustment has been incorporated to adjust embedded component closer to the actual value without hampering the fabricated bits. The inverse Binomial
transform (IBT) is used to convert the transformed components back into the spatial domain. A delicate re-adjustment method is applied on the first transformed component to remain the pixel components in a valid range. The embedding operation in succession generates the final watermarked image. At the receiving end, whole watermark is extracted based on the reverse procedure and authentication is done through computed message digest and extracted bits. Experimental results conform that the proposed technique produces high payload and Peak Signal to Noise Ratio (PSNR) as compared to existing transformation based techniques[1, 5].
Video Compression, Part 4 Section 2, Video Quality Assessment Dr. Mohieddin Moradi
This document provides information on conducting subjective video quality assessments. It discusses different subjective assessment methods like double stimulus impairment scale (DSIS) and single stimulus continuous quality evaluation (SSCQE). It describes test parameters like number of observers, viewing conditions, grading scales and how to present the results. Guidelines are provided for tasks like screening observers, conducting test sessions, introducing impairments and collecting opinion scores to evaluate video coding standards and compression artifacts.
Total cost of ownership is a key metric for assessing costs, benefits and risks of a UC solution – enabling organizations to properly evaluate competing solutions. It aligns their final decision with business needs, while understanding the effects of future requirements and functionalities.
Android Live Streaming Box
This presentation will help create a android streaming box with low cost. its business plan for Multi purpose Android box with technical
Media box with live streaming
This document discusses remote screen rendering and monitoring using cloud and mobile computing. It proposes separating screen rendering from data storage and program execution by using remote servers in the cloud to handle computationally intensive tasks and deliver screen outputs to client devices. The cloud would handle screen capturing, rendering, and delivering rendered screen images to clients. This allows thin clients like mobile devices to access graphically rich applications hosted in the cloud. Various technical aspects of virtualized screen remoting and transmission are also addressed.
Probabilistic Approach to Provisioning of ITV - Amos K.Amos Kohn
This white paper discusses a probabilistic approach to provisioning network and computing resources for delivering interactive TV. It develops a proprietary spreadsheet model to estimate the costs and benefits of deploying an interactive TV streaming processor. The model is based on analyzing user behavior, data packaging into MPEG streams, required bit rates, transport of data over the forward and return paths, necessary processing power, and financial projections to calculate return on investment.
Probabilistic Approach to Provisioning of ITV - By Amos_KohnAmos Kohn
This white paper discusses a probabilistic approach to provisioning network and computing resources for delivering interactive TV. It develops a proprietary spreadsheet model to estimate the costs and benefits of deploying an interactive TV streaming processor. The model is based on analyzing user behavior, data packaging into MPEG streams, required bit rates, forward and return network paths, processing needs, and financial projections to calculate return on investment.
The document proposes a Hybrid Layered Video (HLV) encoding scheme for mobile multimedia applications. The scheme has two components: (1) a sketch-based representation that uses parametric curves to represent object outlines, called Generative Sketch-based Video (GSV); and (2) a texture component with three layers - a low-quality base layer, medium-quality mid-layer, and original-quality highest layer. Different combinations of the GSV and texture layers provide varying quality and resource usage profiles. The scheme aims to enable computer vision tasks on mobile devices in a bandwidth- and power-efficient manner.
Using Compression Techniques to Streamline Image and Video Storage and RetrievalCognizant
A guide to the use of compression in storing, retrieving and transmitting digital media content, as divergent uses and business purposes mean variable intra-frame and inter-frame image compression techniques are called for.
Iaetsd arm based remote surveillance and motion detectionIaetsd Iaetsd
This document describes an arm-based remote surveillance and motion detection system using MJPEG compression. The system uses an ARM9 processor and Linux operating system to capture video from a camera. The video is compressed using MJPEG and transmitted over the internet. Users can view the live video stream and detect motions using a web browser. The system is designed for applications like security, transportation and home monitoring due to its low cost, stability and security compared to traditional DSP-based solutions.
A NOVEL THIN CLIENT ARCHITECTURE WITH HYBRID PUSH-PULL MODEL, ADAPTIVE DISPLA...ijasuc
The advent of cloud computing has driven away the notion of having sophisticated hardware devices for
performing computing intensive tasks. This feature is very essential for resource-constrained devices. In
mobile cloud computing, it is sufficient that the device be a thin client i.e. which concentrates solely on
providing a graphical user interface to the end-user and the processing is done in the cloud. We focus on
adaptive display virtualization where the display updates are computed in advance using synchronization
techniques and classifying the job as computationally intensive or not based on the complexity of the
program and the interaction pattern. Based on application, the next possible key-press is identified and
those particular frames are pre-fetched into the local buffer. Based on these two factors, a decision is
then made whether to execute the job locally or in the cloud or whether we must take the next frame from
the local buffer or pull it from server. Jobs requiring greater interaction are executed locally in the
mobile to reduce interaction delay. If a job is to be executed in the cloud, then the results of the
processing alone are sent via the network to the device. The parameters are varied in runtime based on
network conditions and application parameters to minimise the interaction delay.
Real Time Head Generation for Video ConferencingIRJET Journal
This document proposes a real-time video synthesis model for video conferencing that reconstructs video at the receiver end to maintain a steady experience. It extracts and retargets motion from sender video frame by frame and synthesizes video on the receiver end using the first image and motion keypoints. This allows it to transfer facial expressions, head poses, and eye movements between videos using less bandwidth than standard H.264 video. The model uses WebRTC for peer-to-peer connections and a first-order motion model to extract and apply motion from one video to another in real-time for live video conferencing.
IRJET- Reliable and Energy-Efficient Hybrid Screen Mirroring Multicast SystemIRJET Journal
The document proposes a reliable and energy-efficient hybrid screen mirroring multicast system to share high-quality screen content among adjacent mobile devices over WiFi networks. It employs an overhearing-based multicast scheme to overcome problems with WiFi multicast. Systematic Raptor codes and NACK-based retransmission are used for error correction to mitigate video quality degradation from packet loss. The proposed system aims to minimize energy consumption at the source and sink devices while providing high-quality screen mirroring. It develops models for energy consumption of WiFi interfaces and Raptor encoding/decoding and determines encoding parameters in real-time to optimize overall energy use. The system was implemented on single board computers to evaluate performance in real
This document discusses the development of a video conferencing system using WebRTC. WebRTC allows real-time audio and video transmission between connected devices in a web browser without plugins. The system was created using Node.js as the web server and for signaling. The system allows users to create conference rooms and have real-time voice and video calls between multiple users. WebRTC provides APIs that allow applications to exchange video and audio streams in real-time directly in the browser. The system provides a platform for users to share their screens, chat, and record video conferences in a browser-based system that is platform and device agnostic.
Mobile-Based Video Caching Architecture Based on Billboard Manager csandit
Video streaming services are very popular today. Increasingly, users can now access multimedia applications and video playback wirelessly on their mobile devices. However, a significant challenge remains in ensuring smooth and uninterrupted transmission of almost any
size of video file over a 3G network, and as quickly as possible in order to optimize bandwidth consumption. In this paper, we propose to position our Billboard Manager to provide an optimal transmission rate to enable smooth video playback to a mobile device user connected to
a 3G network. Our work focuses on serving user requests by mobile operators from cached resource managed by Billboard Manager, and transmitting the video files from this pool. The
aim is to reduce the load placed on bandwidth resources of a mobile operator by routing away as much user requests away from the internet for having to search a video and, subsequently, if located, have it transferred back to the user.
Silicon Motion's Graphics Display SoCs enables 4K High Definition and Low PowerSilicon Motion
The document discusses a new graphics display system-on-chip (SoC) called the SM768 that is designed for bridging computers to high-definition displays over USB. The SM768 uses a new compression technology called Content Adaptive Technology (CAT) that offloads compression work to hardware accelerators, lowering CPU usage compared to competitors. It can drive dual 1080p displays over USB 3.0 with less than 2.5W of power, avoiding the need for an external power supply. The SM768 provides a comprehensive solution for USB-to-display bridging with low latency, high image quality, and a small chip size.
HARDWARE SOFTWARE CO-SIMULATION OF MOTION ESTIMATION IN H.264 ENCODERcscpconf
This paper proposes about motion estimation in H.264/AVC encoder. Compared with standards
such as MPEG-2 and MPEG-4 Visual, H.264 can deliver better image quality at the same
compressed bit rate or at a lower bit rate. The increase in compression efficiency comes at the
expense of increase in complexity, which is a fact that must be overcome. An efficient Co-design
methodology is required, where the encoder software application is highly optimized and
structured in a very modular and efficient manner, so as to allow its most complex and time
consuming operations to be offloaded to dedicated hardware accelerators. The Motion
Estimation algorithm is the most computationally intensive part of the encoder which is simulated using MATLAB. The hardware/software co-simulation is done using system generator tool and implemented using Xilinx FPGA Spartan 3E for different scanning methods.
This document provides an overview of an IoT-based wireless electronic notice board project. The system will allow users to send notices from an Android phone to be displayed on an LCD screen notice board. Key aspects include:
- The main controlling device is a Raspberry Pi processor connected to a WiFi modem and LCD display. Notices sent from an Android app will be received by the WiFi modem and processed/displayed by the Raspberry Pi.
- The objectives are to develop a wireless notice board that can display notices sent from a mobile phone in a timely manner, as well as support sending documents, images, and videos.
- The existing manual notice boards have limitations like being time-consuming to maintain
This document summarizes a research paper that proposes a framework to improve quality of experience and energy efficiency for heterogeneous wireless multimedia broadcast receivers. The framework groups users based on their device capabilities and channel conditions. It broadcasts scalable video streams that are encoded with different layers to support different groups. Time slicing is used to allow discontinuous reception and energy savings by turning radios off between bursts. A game theoretic model is used to optimize source encoding, transmission scheduling, and modulation/coding to maximize reception quality and network capacity while balancing energy usage. Evaluation shows the approach enables 75-95% energy savings.
This document describes the development of an electronic nameplate system that allows users to change the displayed text wirelessly using an Android application. The system uses an Arduino Uno microcontroller connected to an LCD display to show the text. A Bluetooth module is used to wirelessly receive text messages sent from an Android app. Users can easily update the nameplate's text in real-time from their mobile phone without needing to physically access the display. The project aims to create a low-cost and user-friendly electronic nameplate system using Bluetooth communication between an Android application and the Arduino/LCD receiver module.
Use of Automation Codecs Streaming Video Applications Based on Cloud ComputingTELKOMNIKA JOURNAL
Streaming technology is currently experiencing a great progress. Faster internet more users streaming. Streaming services that exist today there are still weaknesses in both the upload speed, streaming speed and limited types of video extensions that can be played. To resolve these problems then made a video streaming service based local area network with a system of cloud computing that can work effectively in terms of upload speeds, streaming and variations in video formats. Video streaming application is classified as a service IaaS (Infrastructure as a Service Cloud) in cloud computing. On the use of streaming applications the user does not need to convert the video, with the purpose of uploading process can be faster and applications can play a variety of video formats.
Soon R Multimedia is developing a streaming media service called SoonR that allows users to securely search, access, and share files from their personal computers on mobile devices. SoonR aims to leverage the processing power of desktop PCs to bring applications and data to mobile phones using streaming technology. SoonR has received funding from Intel Capital and Cisco and has users in over 160 countries accessing over 100 million user files.
Similar to An Adaptive Remote Display Framework to Improve Power Efficiency (20)
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Main news related to the CCS TSI 2023 (2023/1695)Jakub Marek
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceIndexBug
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxSitimaJohn
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
Skybuffer SAM4U tool for SAP license adoptionTatiana Kojar
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
2. 184 Computer Science & Information Technology (CS & IT)
The remote display technology helps users to overcome the limit of screen size by providing a
chance to mirror mobile device screen to another device with a large screen such as a TV. Using
the remote display technology, users can also share the multimedia experience with family
members or friends.
The visual quality and the end-to-end latency have been the technical challenges of the remote
display. To mirror a high-resolution screen in real time, the screen has been captured and
compressed using an encoding scheme to reduce the amount of data transfer. The efficient
encoding scheme which provides better display quality and consumes lower network bandwidth
has been researched [1].
Wi-Fi Miracast, a representative remote display solution, transmits screens encoded by H.264
video codec via peer-to-peer networking using a Wi-Fi direct (IEEE 802.11) connection. It
provides good quality by supporting high resolutions of up to 1920 x 1080 pixels and low end-to-
end latency. However, whereas the high compression ratio of H.264 provides savings in network
bandwidth, the high computational complexity of H.264 causes high power consumption and it
still remains a problem on power-limited mobile devices.
Previous researches have mainly focused on an encoding scheme to improve the problem [2] and
there has been a lack of interest in overall framework to solve the problem.
2. RELATED WORKS
Bo-yun Eom et al [1] have proposed a power-aware remote display framework which uses a
hybrid encoding scheme in VNC protocol. It aims to improve power efficiency by switching
encoding modes adaptively to the battery level of client devices.
Ji-su Ha et al [2] have proposed a scheme to implicitly analyse the dynamics of a video file and
uses the screen dynamics score to compute an ideal frame rate in run-time with respect to the
multimedia content context. The proposed work estimates the screen dynamics by calculating the
I-type macroblocks in a target interval which can be configured and skips frames based on the
normalized I-type macroblock count, the screen dynamics score. The video with low dynamics,
like video lectures, have shown a lower screen dynamics score than a dance-genre music video.
Using the screen dynamics score, which is related to the actual dynamics, the frame rate can be
controlled to minimize the transmission and power consumption without visible quality loss.
There are several remote display technologies. Chih-Fan Hsu et al [3] have measured and
compared the performance of those various technologies. The work provides the result of the
performance evaluations in various aspects: frame rate, resolution, bitrate, packet loss and so
forth. Most of them are proprietary solutions designed by manufacturers, which means it may not
be compatible with some devices.
3. BACKGROUND AND MOTIVATION
A Remote display framework is comprised of three major parts: The source device which
captures, encodes, and transmits the screen, the display device which decodes the received data
and displays it, the data transmission protocol which defines the format of the data that is to be
transmitted from a source device to a display device.
3. Computer Science & Information Technology (CS & IT) 185
The remote display is advantageous in that it can support any type of content if the source device
can handle and display it. Conversely, the display device is responsible only for displaying a
mirrored screen and the processing capability of display devices is not taken into account.
However, various consumer electronics, such as TVs and refrigerators, have evolved into smart
devices which have processing capability for various content and network connectivity [4]. We
can utilize the display device as a content processing unit to extend the overall capability of the
entire system.
The source device performs the intrinsic function which is content processing for local display.
At the same time, it executes data processing and transmissions for remote display.
Figure 1. Process for the local display and the remote display
When playing a video, the following procedures are performed.
First, the media framework extracts the video bitstream from the media source and decodes it
using the video decoder. Then, it passes the resulting video surface to the graphics engine. The
video surface is resized to fit the render area. If necessary, the color format conversion is also
carried out. The post-processed video surface is composited with a UI controller to make the final
image for local display.
In addition to the above steps, the composited frame buffer is resized to fit the remote display and
encoded to reduce network bandwidth. And then, it is sent to the remote display.
This intensive real-time processing results in lots of power consumption. Furthermore, in order to
improve the visual quality of the remote display, more computation is required and more power
consumption is generated. So, it is necessary to reduce and optimize the processes related to local
and remote display.
In this paper, we present an approach considering an overall framework, including source device,
data transmission protocol, and display device, from a broader perspective. As a result, we
suggest a novel framework to improve power efficiency and extend overall processing capability
for multimedia content.
4. 186 Computer Science & Information Technology (CS & IT)
4. ADAPTIVE REMOTE DISPLAY FRAMEWORK
In Figure 1, the transmitted video bitstream is almost same as the original video bitstream except
the composited UI controller, resolution and bitrate. To make the similar video bitstream for the
remote display, power-consuming processes such as resizing and encoding are carried out. If it
does not have to be exact same screen, it is possible to reduce the steps by sending the original
video bitstream.
In certain scenarios, such as a media file playback and slide show, the source device works
mainly as a controller, and the local display in the source device are not essential and generate
unnecessary power consumption. We can consider it as an optional process and reduce power
consumption of the source device by skipping these processes.
Adaptive remote display is based on the extended processing capability: The content can be
processed in any device that is capable of handling it. In case of remote processing in which the
content is processed in display device, the source device transmits the original content such as
media file, streaming URI instead of encoded video stream. The display device processes the
received content using its own framework and displays it. In addition, the source device is able to
skip local processing and display, if necessary.
According to the transmitted data type, two modes are defined for data transmission protocol in
adaptive remote display framework: the Screen Mirroring Mode (SMM) and the Content
Mirroring Mode (CMM). The Screen Mirroring Mode is the same one used in typical remote
display solution, which the source device process content and transfer the encoded screen to the
display device.
Figure 2. Block diagram for the Screen Mirroring Mode
In the Content Mirroring Mode, the content is transmitted instead of screen to the display device.
In this mode, the frameworks are considered in an integrated way to support extended capability.
5. Computer Science & Information Technology (CS & IT) 187
Figure 3. Block diagram for the Content Mirroring Mode
There are 3 main phases for the overall session of suggested solution.
4.1. Processing Capability Negotiation
Once a network connectivity completes successfully, the source and display device negotiate
capability which both devices can process. The source device sends a request message to query
the processing capability of the display device for contents such as media format/codec,
streaming method, graphic library supported by the source device. The display device sends a
response message listing contents that it is capable of processing, and then both devices finish the
processing capability negotiation.
Table 1. Sample content for capability negotiation
Capability Example
Text format TXT
Media format 3GP, MP4, ASF, AVI, MKV
Audio format 3GA, M4A, WMA, MP3
Image format GIF, PNG, BMP
Streaming protocol RTSP, HTTP, HTTP live streaming,
Video codec H.264, HEVC, MPEG4, VP8/VP9,
Audio codec LPCM, AAC, WMA, MP3, AMR, FLAC, DTS, AC3, RA
Network access Wi-Fi, LTE
OpenGL version 3.0
If the source device is not capable of playing the AC3 audio codec and the display device has a
AC3 decoder, the audio or video file can be played in the display device. In this way, the overall
capability can be extended.
4.2. Real-time Traffic Optimizer
User can access contents in the source device while the display device is connected. First, based
on the result of processing capability negotiation, adaptive remote display framework determines
if currently accessed content can be processed by the display device. If the content is supported
by the display device, one of the mirroring mode is selected based on the comparison result of the
expected network bandwidth. If the content is not supported by the display device, this step is
ignored and the Screen Mirroring Mode is kept.
6. 188 Computer Science & Information Technology (CS & IT)
Table 2. An example of the network bandwidth comparison
Content Screen Mirroring Mode Content Mirroring Mode
HD 1.9 Mbps 5 Mbps * 2h 18m = 5.05 GB 1.9 Mbps * 2h 18m = 1.90 GB
HD 5.4 Mbps 5 Mbps * 2h 18m = 5.05 GB 5.4 Mbps * 2h 18m = 5.42 GB
When playing the HD 1.9 Mbps video, the Content Mirroring Mode sends 1.90 GB and it saves
62% network bandwidth compared to the Screen Mirroring Mode. However, when playing the
HD 5.4 Mbps video, the Screen Mirroring Mode shows advantage in network bandwidth. In this
case, the overall power consumption including encoding and networking should be considered.
4.3. Switching Mirroring Mode
Once a mirroring mode is determined by the remote display framework, the source device
informs the display device of new mirroring mode by sending the mode switching message. The
message includes the type and detail information about the transmission data. For instance, when
switching to video streaming, the message includes data type for video streaming and streaming
URI. Once the display device receives the message, it unloads previous processing engine and
loads appropriate processing engine.
5. EVALUATIONS
To evaluate the power consumption, Galaxy Note 5 (CPU: Quad-core 1.5 GHz Cortex-A53 &
Quad-core 2.1 GHz Cortex-A57, GPU: Mali-T760MP8, Resolution: 1440 x 2560, Wi-Fi: 802.11
a / b / g / n, Android 5.1.1 Lollipop) and the Power Monitor (Monsoon Solutions Inc.) has been
used. All the conditions including brightness, network connectivity have been controlled.
For the resolution and bitrate of the remote display, FHD (Full High Definition, 1920x1080) 10
Mbps and UHD (Ultra High Definition, 3840x2160) 10 Mbps have been used.
MX Player and YouTube have been used for local video playback and video streaming,
respectively.
The various video clips have been selected for the evaluations.
Table 3. The test video clips
Content Properties of texture Properties of movement
Nature
Food
Landscape
Complexity: low
Texture change: mid
Movement: low
Background moves slowly
Sport
Sea
Complexity: mid
Texture change: high
Movement: high
Music Video
Movie
Complexity: mid
Texture change: high
Movement: mid
7. Computer Science & Information Technology (CS & IT) 189
5.1. Screen Mirroring Mode vs. Content Mirroring Mode w/ local display
Figure 4. Screen Mirroring Mode (left), Content Mirroring Mode w/ local display (right)
As shown in Figure 4, the Screen Mirroring Mode mirrors the current screen to the remote
display. The transmission data type is the encoded screen. So, it shows the same screen on the
remote display.
The Content Mirroring Mode transmits raw data such as streaming URI, media file, and
audio/video bitstream. The transmission data type is determined according to the capabilities of
the display device.
Figure 5. Comparison of the power (current) consumption:
Screen Mirroring Mode vs. Content Mirroring Mode (w/ local display, type: a/v bitstream)
Figure 5 shows the comparison result of the Screen Mirroring Mode and the Content Mirroring
Mode which sends the a/v bitstream. In this case, the Content Mirroring Mode skips the resizing
and encoding steps. The local display is also performed the same as the Screen Mirroring Mode.
The result shows a 12.4% (FHD) and 23.4% (UHD) improvement in power consumption.
8. 190 Computer Science & Information Technology (CS & IT)
5.2. Screen Mirroring Mode vs. Content Mirroring Mode w/o local display
Figure 6. Screen Mirroring Mode (left), Content Mirroring Mode w/o local display (right)
When the user watches a video using the remote display technology, the local display may not be
necessary because the video is played in the larger display. So the local display is a possible
option we can skip. The Figure 6 shows the screen of the Screen Mirroring Mode which enables
the local display and the screen of the Content Mirroring Mode which disables the local display.
In this case, the power consumption caused by the local display can also be reduced in the
Content Mirroring Mode.
Figure 7. Comparison of the power (current) consumption:
Screen Mirroring Mode vs. Content Mirroring Mode (w/o local display, type: streaming URI)
When the display device is capable of processing streaming URI, which means it has a network
connection such as wi-fi and it has an http streaming engine, the source device can transmit
streaming URI. In this case, the source device skips the real-time processing for streaming video.
As a result, the Content Mirroring Mode shows a 57.1% (FHD) and a 67.4% (UHD)
improvement in power consumption.
9. Computer Science & Information Technology (CS & IT) 191
Figure 8. Comparison of the power (current) consumption:
Screen Mirroring Mode vs. Content Mirroring Mode (w/o local display, type: a/v bitstream)
The result shows a 36.5% (FHD) and a 55.0% (UHD) improvement in power consumption.
5.3. Content Mirroring Mode w/ LCD on vs. Content Mirroring Mode w/ LCD off
Figure 9. Comparison of the power (current) consumption:
Content Mirroring Mode (with LCD on) vs. Content Mirroring Mode (with LCD off)
(w/o local display, type: a/v bitstream)
If the local display is not necessary, there is another advantage in the Content Mirroring Mode. It
can turn the LCD of the source device off. When the user watches a movie which has long
10. 192 Computer Science & Information Technology (CS & IT)
running time, this option saves the battery of the source device. When the LCD is off, the result
shows an additional improvement of 27.8% in the power consumption is obtained.
5.4. Content Mirroring Mode w/ bitrate change
Figure 10. Comparison of the power (current) consumption:
Content Mirroring Mode (w/o local display, type: a/v bitstream)
As the bitrate of a video file increases, the power consumption also increases for data
transmission. The result shows that power consumption of 10.5% is added when the bitrate
increases by 5Mbps.
6. CONCLUSIONS
The remote display enables users to enjoy multimedia contents on a large screen. An adaptive
remote display framework keeps the advantage and extends the overall capability. By reducing
the content processing, the source device consumes lower power. Besides, in the Content
Mirroring Mode, the amount of data transmitted can also be reduced. As a result, the power
efficiency of mobile device is improved.
According to the evaluations, the Content Mirroring Mode which transmits a/v bitstream has
shown a 12.4% (FHD 10 Mbps, w/ local display) to a 55% (UHD 10 Mbps, w/o local display)
improvement in power consumption compared to the Screen Mirroring Mode. In the case of
transmitting the streaming URI, the Content Mirroring Mode shows a 57.1% (FHD 10Mbps) and
a 67.4% (UHD 10Mbps) improvement in power consumption. Furthermore, there is additional
improvement of 27% in the power consumption if LCD is turned off, which is possible in the
Content Mirroring Mode.
11. Computer Science & Information Technology (CS & IT) 193
REFERENCES
[1] Boyun Eom, Choonhwa Lee, “An adaptive remote display scheme to deliver mobile cloud services”,
IEEE Transaction Consumer Electronics, Vol. 60, Aug. 2014
[2] Jisu Ha, Puleum Bae, Keun-Woo Lim, JeongGil Ko, Young-Bae Ko, " Mobile contents on the big
screen: adaptive frame filtering for mobile device screen sharing”, Proceedings of the 12th ACM
Conference on Embedded Network Sensor Systems, pp. 360-361, Nov. 2014
[3] Screencast in the Wild: Performance and Limitations, Chih-Fan Hsu and De-Yu Chen, ACM MM ’14
[4] http://www.samsung.com/sec/SmartHome/sHome.html
[5] How is Energy Consumed in Smartphone Display Applications?, Xiang Chen, Yiran Chen, ACM
HotMobile'13
[6] Profiling Power Consumption on Mobile Devices, Luca Ardito, Energy 2013
[7] Casual Mobile Screen Sharing, Proceedings of the Fifteenth Australasian User Interface Conference
(AUIC2014)
[8] Cloud Mobile Media: Reflections and Outlook, IEEE Transactions on Multimedia, vol. 16, no. 4,
June, 2014
[9] Mirror, Mirror, On The Wall: Collaborative Screen-Mirroring for Small Groups, TVX 2014, June,
2014
[10] Wi-Fi CERTIFIED Miracast™: Extending the Wi-Fi experience to seamless video display, Wi-Fi
Alliance, September, 2012