Journal article

Control synthesis for stochastic systems given automata specifications defined by stochastic sets

Maryam Kamgarpour, Tony A Wood, Sean Summers, John Lygeros



The problem of control synthesis to maximize the probability of satisfying automata specifications for systems with uncertainty is addressed. Two types of uncertainty are considered; stochasticity in the dynamical system and in the sets defining the specifications. We model the uncertain dynamical sets as stochastic set processes. We show that the optimal control policy can be computed by solving a reachability problem for a hybrid stochastic system, which evolves on product state spaces of the automaton, stochastic sets, and the dynamical system. We derive an approximation to the stochastic set processes to alleviate the complexity of reachability computation. A case study illustrates the f..

View full abstract


Awarded by SNF

Funding Acknowledgements

This work was supported partially by SNF grants numbered 2000211_37876 and 141836. The material in this paper was partially presented at the Hybrid Systems: Computation and Control (HSCC 2013) Conference, April 8-11, 2013, Philadelphia, USA. This paper was recommended for publication in revised form by Associate Editor Bart De Schutter under the direction of Editor Ian R. Petersen.