Conference Proceedings

Beam scheduling for electronically scanned array tracking systems using multi-arm bandits

V Krishnamurthy, J Mickova, RJ Evans

Proceedings of the IEEE Conference on Decision and Control | Published : 1999


In this paper we derive optimal and sub-optimal beam scheduling algorithms for electronically scanned array tracking systems. We formulate the scheduling problem as a multi-arm bandit problem involving Hidden Markov Models. A finite dimensional optimal solution to this multi-arm bandit problem is presented. The key to solving any multi-arm bandit problem is to compute the Gittins index. We present, a finite dimensional algorithm which computes the Gittins index. Suboptimal algorithms for computing the Gittins index are also presented.

Citation metrics