Journal article

Combining gaze and AI planning for online human intention recognition

R Singh, T Miller, J Newn, E Velloso, F Vetere, L Sonenberg

Artificial Intelligence | Elsevier | Published : 2020


Intention recognition is the process of using behavioural cues, such as deliberative actions, eye gaze, and gestures, to infer an agent's goals or future behaviour. In artificial intelligence, one approach for intention recognition is to use a model of possible behaviour to rate intentions as more likely if they are a better ‘fit’ to actions observed so far. In this paper, we draw from literature linking gaze and visual attention, and we propose a novel model of online human intention recognition that combines gaze and model-based AI planning to build probability distributions over a set of possible intentions. In human-behavioural experiments (n=40) involving a multi-player board game, we d..

View full abstract


Awarded by Defence Science and Technology Group CERA Grant

Funding Acknowledgements

This work was supported by two Australian Government Research Training Program Scholarship, the Microsoft Research Centre for Social NUI, and Defence Science and Technology Group CERA Grant 02.