Conference Proceedings

Combining implicit gaze and AI for real-time intention projection

Joshua Newn, Ronal Singh, Eduardo Velloso, Frank Vetere

Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers | ACM Press | Published : 2019


Intention recognition is the process of using behavioural cues to infer an agent's goals or future behaviour. In face-to-face communication, our gaze implicitly signals our point of interest within the environment and therefore, inadvertently leaks our unspoken intentions to others. In our published body of work, we leverage this implicit function of gaze together with the tendency of humans to plan before executing their actions, resulting in an artificial agent that can project humans intentions while human players engage in a competitive game. In this demo, we created a path-planning game to demonstrate the capability of our artificial agent in a playful manner. The agent projects future ..

View full abstract


Awarded by Australian Research Council

Funding Acknowledgements

We acknowledge the Australian Commonwealth Government, Microsoft Research Centre for Social Natural User Interfaces and Interaction Design Lab for their support on this project. Dr Eduardo Velloso is the recipient of an Australian Research Council Discovery Early Career Award (Project Number: DE180100315) funded by the Australian Commonwealth Government. Last but not least, we acknowledge Alex Foster ( for permission to the use map of London illustration in our demonstration.