On the mdp based cost minimization for video-on-demand services in a heterogeneous wireless network with multi-homed terminals

1. On the MDP-based Cost Minimization for Video-on-Demand Services in a Heterogeneous
Wireless Network with Multi-Homed Terminals
we deal with a cost minimization problem for a multi-homed mobile terminal that downloads and
plays a video-on-demand (VoD) stream. The cost consists of the user’s dissatisfaction due to
playback disruptions and communication cost for downloading the VoD stream. There are three
components in our approach: parameter estimation, threshold adjustment, and threshold
compensation. Since we do not assume any a priori knowledge about underlying random variables,
necessary parameter values are estimated online. Using the resultant estimates, we formulate the
problem as a Markov Decision Process (MDP) problem considering as if the random variables are
exponentially distributed. To solve the MDP problem efficiently, we propose a threshold adjustment
algorithm that exploits some structural properties of any optimal solution that are specific to our
problem. Finally, to handle the cases where the random variables are not exponentially distributed,
we propose a threshold compensation algorithm to compensate for the modeling error. Through
extensive simulations, we compare the performance of our scheme with those of static threshold
schemes.
Ambit lick Solutions
Mail Id: Ambitlick@gmail.com , Ambitlicksolutions@gmail.Com