Journal article

An Information-Based Learning Approach to Dual Control

Tansu Alpcan, Iman Shames

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | Published : 2015

Abstract

Dual control aims to concurrently learn and control an unknown system. However, actively learning the system conflicts directly with any given control objective for it will disturb the system during exploration. This paper presents a receding horizon approach to dual control, where a multiobjective optimization problem is solved repeatedly and subject to constraints representing system dynamics. Balancing a standard finite-horizon control objective, a knowledge gain objective is defined to explicitly quantify the information acquired when learning the system dynamics. Measures from information theory, such as entropy-based uncertainty, Fisher information, and relative entropy, are studied an..

View full abstract