Conference Proceedings

AI-mediated gaze-based intention recognition for smart eyewear

Joshua Newn, Benjamin Tag, Ronal Singh, Eduardo Velloso, Frank Vetere

Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers | ACM Press | Published : 2019


Commercial smart eyewear products designed for day-today use have drastically improved in recent years. However, the current utility and applications of smart eyewear can be easily substituted with other smart wearables. In this paper, we propose the integration of an artificial agent capable of performing gaze-based intention recognition on smart eyewear to extend the device capabilities. As smart eyewear affords unobtrusive tracking of the user's gaze while the user interacts naturally with the world, it serves as a perfect platform to discreetly identify the user's intentions through gaze, allowing the agent to provide relevant, personalised and proactive assistance. We believe that integ..

View full abstract