Conference Proceedings

Listening to the Mind: Earable Acoustic Sensing of Cognitive Load

X Wei, T Dang, K Al-Naimi, Y Liu, F Kawsar, A Montanari

Ubicomp Companion 2025 Companion of the 2025 ACM International Joint Conference on Pervasive and Ubiquitous Computing | ACM | Published : 2025

Abstract

Earable acoustic sensing offers a powerful and non-invasive modality for capturing fine-grained auditory and physiological signals directly from the ear canal, enabling continuous and context-aware monitoring of cognitive states. As earable devices become increasingly embedded in daily life, they provide a unique opportunity to sense mental effort and perceptual load in real time through auditory interactions. In this study, we present the first investigation of cognitive load inference through auditory perception using acoustic signals captured by off-the-shelf in-ear devices. We designed speech-based listening tasks to induce varying levels of cognitive load, while concurrently embedding a..

View full abstract

University of Melbourne Researchers