Journal article

GAVIN: Gaze-Assisted Voice-Based Implicit Note-taking

Anam Ahmad Khan, Joshua Newn, Ryan M Kelly, Namrata Srivastava, James Bailey, Eduardo Velloso

ACM Transactions on Computer-Human Interaction | Association for Computing Machinery (ACM) | Published : 2021


Annotation is an effective reading strategy people often undertake while interacting with digital text. It involves highlighting pieces of text and making notes about them. Annotating while reading in a desktop environment is considered trivial but, in a mobile setting where people read while hand-holding devices, the task of highlighting and typing notes on a mobile display is challenging. In this article, we introduce GAVIN, a gaze-assisted voice note-taking application, which enables readers to seamlessly take voice notes on digital documents by implicitly anchoring them to text passages. We first conducted a contextual enquiry focusing on participants’ note-taking practices on digital do..

View full abstract


Awarded by Australian Research Council Discovery Early Career Researcher Award - Australian Government

Funding Acknowledgements

Eduardo Velloso is the recipient of an Australian Research Council Discovery Early Career Researcher Award (Project Number: DE180100315) funded by the Australian Government. Anam Ahmad Khan, Joshua Newn, and Namrata Srivastava are supported by scholarships under the Australian Commonwealth Government Research Training Program and Melbourne Research Scholarship.