Social Attentive User Interfaces for the Age of Interruption

Grant number: DE180100315 | Funding period: 2018 - 2022

Completed

Abstract

This proposal aims to enable the development of social attentive user interfaces—those that employ sensors such as eye trackers and thermal cameras to monitor the locus and level of users' attention and adapt their behaviour accordingly. The project lies in the field of Human-Computer Interaction, drawing from machine learning methods to design novel user experiences. Expected outcomes include insights into how people manage their attention, new methods for attention estimation and classification, and novel systems for e-learning and work productivity that demonstrate these new capabilities. As a result, this project will provide the benefit of enabling system to no longer be blind to users’..

View full description

Related publications (21)

Scholarly works icon

Mapping 20 years of accessibility research in HCI: A co-word analysis

Zhanna Sarsenbayeva, Niels van Berkel, Danula Hettiachchi, Benjamin Tag, Eduardo Velloso, Jorge Goncalves, Vassilis Kostakos

2023-07-01

Scholarly works icon

Methodological Standards in Accessibility Research on Motor Impairments: A Survey

Zhanna Sarsenbayeva, Niels Van Berkel, Eduardo Velloso, Jorge Goncalves, Vassilis Kostakos

2023-07-01

The design and evaluation of accessibility technology is a core component of the computer science landscape, aiming to ensure that..

Scholarly works icon

GAVIN: Gaze-Assisted Voice-Based Implicit Note-taking

Anam Ahmad Khan, Joshua Newn, Ryan M Kelly, Namrata Srivastava, James Bailey, Eduardo Velloso

2021-10-31

Annotation is an effective reading strategy people often undertake while interacting with digital text. It involves highlighting p..

Scholarly works icon

A probabilistic interpretation of motion correlation selection techniques

E Velloso, CH Morimoto

2021-05-06

Motion correlation interfaces are those that present targets moving in diferent patterns, which the user can select by matching th..

Scholarly works icon

Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions

H Lyons, E Velloso, T Miller

2021-04-22

As the use of algorithmic systems in high-stakes decision-making increases, the ability to contest algorithmic decisions is being ..

Scholarly works icon

A Critique of Electrodermal Activity Practices at CHI

Ebrahim Babaei, Benjamin Tag, Tilman Dingler, Eduardo Velloso

2021-01-01

Electrodermal activity data is widely used in HCI to capture rich and unbiased signals. Results from related felds, however, have ..

Scholarly works icon

Faces of Focus: A Study on the Facial Cues of Attentional States

Ebrahim Babaei, Namrata Srivastava, Joshua Newn, Qiushi Zhou, Tilman Dingler, Eduardo Velloso

2020-04-21

Automatically detecting attentional states is a prerequisite for designing interventions to manage attention - knowledge workers' ..

Scholarly works icon

Exploring the usage of thermal imaging for understanding video lecture designs and students' experiences

N Srivastava, S Nawaz, JM Lodge, E Velloso, S Erfani, J Bailey

2020-03-23

Video is becoming a dominant medium for the delivery of educational material. Despite the widespread use of video for learning, th..

Scholarly works icon

A Survey of Context Simulation for Testing Mobile Context-Aware Applications

Chu Luo, Jorge Goncalves, Eduardo Velloso, Vassilis Kostakos

2020-02-05

Equipped with an abundance of small-scale microelectromechanical sensors, modern mobile devices such as smartphones and smartwatch..

Scholarly works icon

Classifying Attention Types with Thermal Imaging and Eye Tracking

Yomna Abdelrahman, Anam Ahmad Khan, Joshua Newn, Eduardo Velloso, Sherine Ashraf Safwat, James Bailey, Andreas Bulling, Frank Vetere, Albrecht Schmidt

2019-09-09

Despite the importance of attention in user performance, current methods for attention classification do not allow to discriminate..

Scholarly works icon

Towards context-free semantic localisation

Gabriele Marini, Jorge Gonçalves, Eduardo Velloso, Raja Jurdak, Vassilis Kostakos

2019-09-09

We propose a context-free semantic localisation approach to visualise and analyse indoor movements. We focus on settings where ind..

Scholarly works icon

Biometric Mirror: Exploring Values and Attitudes towards Facial Analysis and Automated Decision-Making

Niels Wouters, Ryan Kelly, Eduardo Velloso, Katrin Wolf, Hasan Shahid Ferdous, Joshua Newn, Zaher Joukhadar, Frank Vetere

2019-06-18

Facial analysis applications are increasingly being applied to inform decision-making processes. However, as global reports of unf..

Scholarly works icon

Measuring the Effects of Stress on Mobile Interaction

Zhanna Sarsenbayeva, Niels van Berkel, Danula Hettiachchi, Weiwei Jiang, Tilman Dingler, Eduardo Velloso, Vassilis Kostakos, Jorge Goncalves

2019-03-29

Research shows that environmental factors such as ambient noise and cold ambience can render users situationally impaired, adverse..

Scholarly works icon

A Tale of Two Perspectives: A Conceptual Framework of User Expectations and Experiences of Instructional Fitness Apps

Ahed Aladwan, R Kelly, Steven Baker, Eduardo Velloso

2019-01-01

We present a conceptual framework grounded in both users’ reviews and HCI theories, residing between practices and theories as a f..

Scholarly works icon

Cognitive Aid: Task Assistance Based On Mental Workload Estimation

Qiushi Zhou, Joshua Newn, Namrata Srivastava, Tilman Dingier, Jorge Goncalves, Eduardo Velloso

2019-01-01

In this work, we evaluate the potential of using wearable non-contact (infrared) thermal sensors through a user study (N=12) to me..

Scholarly works icon

Combining implicit gaze and AI for real-time intention projection

Joshua Newn, Ronal Singh, Eduardo Velloso, Frank Vetere

2019-01-01

Intention recognition is the process of using behavioural cues to infer an agent's goals or future behaviour. In face-to-face comm..

Scholarly works icon

Continuous Evaluation of Video Lectures from Real-Time Difficulty Self-Report

Namrata Srivastava, Eduardo Velloso, Jason M Lodge, Sarah Erfani, James Bailey

2019-01-01

With the increased reach and impact of video lectures, it is crucial to understand how they are experienced. Whereas previous stud..

Scholarly works icon

Designing Interactions with Intention-Aware Gaze-Enabled Artificial Agents

Joshua Newn, Ronal Singh, Fraser Allison, Prashan Madumal, Eduardo Velloso, Frank Vetere

2019-01-01

As it becomes more common for humans to work alongside artificial agents on everyday tasks, it is increasingly important to design..

Scholarly works icon

SpinalLog: Visuo-Haptic Feedback in Musculoskeletal Manipulation Training

D Antony Chacon, Eduardo Velloso, Katrin Wolf, Thuong Hoang

2019-01-01

Current techniques for teaching spinal mobilisation follow the traditional classroom approach: an instructor demonstrates a techni..

Scholarly works icon

Combining Low and Mid-Level Gaze Features for Desktop Activity Recognition

Namrata Srivastava, Joshua Newn, E Velloso

2018-12-27

Human activity recognition (HAR) is an important research area due to its potential for building context-aware interactive systems..

Scholarly works icon

GazeGrip: Improving Mobile Device Accessibility with Gaze & Grip Interaction

Q Zhou, E Velloso

2017-11-28

Though modern tablet devices offer users high processing power in a compact form factor, interaction while holding them still pres..

University of Melbourne Researchers