Journal article

Automatic Facial Expression Analysis as a Measure of User-Designer Empathy

A Salmi, J Li, K Holtta-Otto

Journal of Mechanical Design | Published : 2023

Abstract

In human-centered product design and development, understanding the users is essential. Empathizing with the user can help designers gain deeper insights into the user experience and their needs. However, a few studies have captured empathy real time during user interactions. Accordingly, the degree to which empathy occurs and enhances user understanding remains unclear. To narrow this gap, a study was performed exploring the use of video-based facial expression analysis during user interviews, as a means to capture empathy related to understanding vehicle driving experiences under challenging conditions. Mimicry and synchrony have been shown to be predictors of empathy in cognitive psycholo..

View full abstract

University of Melbourne Researchers

Grants

Funding Acknowledgements

This study was possible thanks to the following funding sources: Technology Industries of Finland Centennial Foundation, Jane and Aatos Erkko Foundation, and the Chinese Scholarship Council. The authors would like to thank all participants for their time, Dai Sheng's help with statistics and effort, as well as the entire Empathic Engineers team for continued feedback.