A Markov Decision Process based flow assignment framework for heterogeneous network access
Jatinder Pal Singh, Tansu Alpcan, Piyush Agrawal, Varun Sharma
WIRELESS NETWORKS | SPRINGER | Published : 2010
We consider a scenario where devices with multiple networking capabilities access networks with heterogeneous characteristics. In such a setting, we address the problem of efficient utilization of multiple access networks by devices via optimal assignment of traffic flows with given utilities to different networks. We develop and analyze a device middleware functionality that monitors network characteristics and employs a Markov Decision Process (MDP) based control scheme that in conjunction with stochastic characterization of the available bit rate and delay of the networks generates an optimal policy for allocation of flows to different networks. The optimal policy maximizes, under availab..View full abstract
Research Supported by Deutsche Telekom AG. An earlier version of the work appeared in the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, June 18-21, 2007, Helsinki, Finland.