Eduardo Velloso

Combining gaze and AI planning for online human intention recognition

R Singh, T Miller, J Newn, E Velloso, F Vetere, L Sonenberg

Journal article  |  2020  |  Artificial Intelligence

Intention recognition is the process of using behavioural cues, such as deliberative actions, eye gaze, and gestures, to infer an ..

Demand-Driven Transparency for Monitoring Intelligent Agents

Mor Vered, Piers Howe, Tim Miller, Liz Sonenberg, Eduardo Velloso

Journal article  |  2020  |  IEEE Transactions on Human-Machine Systems

In autonomous multiagent or multirobotic systems, the ability to quickly and accurately respond to threats and uncertainties is im..

Faces of Focus: A Study on the Facial Cues of Attentional States

Ebrahim Babaei, Namrata Srivastava, Joshua Newn, Qiushi Zhou, Tilman Dingler, Eduardo Velloso

Conference Proceedings  |  2020  |  Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Automatically detecting attentional states is a prerequisite for designing interventions to manage attention - knowledge workers' ..

Exploring the usage of thermal imaging for understanding video lecture designs and students' experiences

N Srivastava, S Nawaz, JM Lodge, E Velloso, S Erfani, J Bailey

Conference Proceedings  |  2020  |  Proceedings of the Tenth International Conference on Learning Analytics & Knowledge

Video is becoming a dominant medium for the delivery of educational material. Despite the widespread use of video for learning, th..

Engaging Participants during Selection Studies in Virtual Reality

Difeng Yu, Qiushi Zhou, Benjamin Tag, Tilman Dingler, Eduardo Velloso, Jorge Goncalves

Conference Proceedings  |  2020  |  2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

Selection studies are prevalent and indispensable for VR research. However, due to the tedious and repetitive nature of many such ..

A Survey of Context Simulation for Testing Mobile Context-Aware Applications

Chu Luo, Jorge Goncalves, Eduardo Velloso, Vassilis Kostakos

Journal article  |  2020  |  ACM Computing Surveys

Equipped with an abundance of small-scale microelectromechanical sensors, modern mobile devices such as smartphones and smartwatch..

Overcoming compliance bias in self-report studies: A cross-study analysis

Niels van Berkel, Jorge Goncalves, Simo Hosio, Zhanna Sarsenbayeva, Eduardo Velloso, Vassilis Kostakos

Journal article  |  2020  |  International Journal of Human-Computer Studies

A popular methodology used for in situ observations is the Experience Sampling Method (ESM), in which participants intermittently ..

Virtual and augmented reality for positive social impact

K Ferris, RM Kelly, R Brown, G Wadley, S Baker, J Waycott, E Velloso, S Turkay

Conference Proceedings  |  2019  |  Proceedings of the 31st Australian Conference on Human-Computer-Interaction

This workshop invites researchers and industry practitioners designing Virtual Reality and Augmented Reality applications for posi..

Multimodal data as a means to understand the learning experience

Michail N Giannakos, Kshitij Sharma, Ilias O Pappas, Vassilis Kostakos, Eduardo Velloso

Journal article  |  2019  |  International Journal of Information Management

Most work in the design of learning technology uses click-streams as their primary data source for modelling & predicting learning..

Towards context-free semantic localisation

Gabriele Marini, Jorge Gonçalves, Eduardo Velloso, Raja Jurdak, Vassilis Kostakos

Conference Proceedings  |  2019  |  Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC '19

We propose a context-free semantic localisation approach to visualise and analyse indoor movements. We focus on settings where ind..

LiftSmart: a monitoring and warning wearable for weight trainers

Yousef Kowsar, Eduardo Velloso, Lars Kulik, Christopher Leckie

Conference Proceedings  |  2019  |  Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC '19

In this paper, we demonstrate LiftSmart, a novel smart wearable to detect, track and analyse weight training activities. LiftSmart..

Classifying Attention Types with Thermal Imaging and Eye Tracking

Yomna Abdelrahman, Anam Ahmad Khan, Joshua Newn, Eduardo Velloso, Sherine Ashraf Safwat, James Bailey, Andreas Bulling, Frank Vetere, Albrecht Schmidt

Journal article  |  2019  |  Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Despite the importance of attention in user performance, current methods for attention classification do not allow to discriminate..

CamTest: A laboratory testbed for camera-based mobile sensing applications

Chu Luo, Zewen Xu, Ruining Dong, Jorge Goncalves, Eduardo Velloso, Vassilis Kostakos

Journal article  |  2019  |  Pervasive and Mobile Computing

Verifying nondeterministic processes driven by broadcasts on Android

C Luo, X Ma, Y Tian, J Goncalves, E Velloso, V Kostakos

Conference Proceedings  |  2019  |  2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC)

Broadcasts in Android facilitate inner-process and inter-process communications. Although broadcasts enable high scalability and l..

Energy-efficient prediction of smartphone unlocking

Chu Luo, Aku Visuri, Simon Klakegg, Niels van Berkel, Zhanna Sarsenbayeva, Antti Mottonen, Jorge Goncalves, Theodoros Anagnostopoulos, Denzil Ferreira, Huber Flores, Eduardo Velloso, Vassilis Kostakos

Journal article  |  2019  |  Personal and Ubiquitous Computing

Measuring the Effects of Stress on Mobile Interaction

Zhanna Sarsenbayeva, Niels van Berkel, Danula Hettiachchi, Weiwei Jiang, Tilman Dingler, Eduardo Velloso, Vassilis Kostakos, Jorge Goncalves

Journal article  |  2019  |  Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Research shows that environmental factors such as ambient noise and cold ambience can render users situationally impaired, adverse..

Biometric Mirror

Niels Wouters, Ryan Kelly, Eduardo Velloso, Katrin Wolf, Hasan Shahid Ferdous, Joshua Newn, Zaher Joukhadar, Frank Vetere

Conference Proceedings  |  2019  |  Conference on Designing Interactive Systems

Designing Interactions with Intention-Aware Gaze-Enabled Artificial Agents

Joshua Newn, Ronal Singh, Fraser Allison, Prashan Madumal, Eduardo Velloso, Frank Vetere

Conference Proceedings  |  2019  |  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

As it becomes more common for humans to work alongside artificial agents on everyday tasks, it is increasingly important to design..

Combining implicit gaze and AI for real-time intention projection

Joshua Newn, Ronal Singh, Eduardo Velloso, Frank Vetere

Conference Proceedings  |  2019  |  Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC '19

Intention recognition is the process of using behavioural cues to infer an agent's goals or future behaviour. In face-to-face comm..

Cognitive Aid: Task Assistance Based On Mental Workload Estimation

Qiushi Zhou, Joshua Newn, Namrata Srivastava, Tilman Dingier, Jorge Goncalves, Eduardo Velloso

Conference Proceedings  |  2019  |  Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

AI-mediated gaze-based intention recognition for smart eyewear

Joshua Newn, Benjamin Tag, Ronal Singh, Eduardo Velloso, Frank Vetere

Conference Proceedings  |  2019  |  Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC '19

Commercial smart eyewear products designed for day-today use have drastically improved in recent years. However, the current utili..

A Tale of Two Perspectives: A Conceptual Framework of User Expectations and Experiences of Instructional Fitness Apps

Ahed Aladwan, R Kelly, Steven Baker, Eduardo Velloso

Conference Proceedings  |  2019  |  Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19

We present a conceptual framework grounded in both users’ reviews and HCI theories, residing between practices and theories as a f..

SpinalLog: Visuo-Haptic Feedback in Musculoskeletal Manipulation Training

D Antony Chacon, Eduardo Velloso, Katrin Wolf, Thuong Hoang

Conference Proceedings  |  2019  |  Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '19

Current techniques for teaching spinal mobilisation follow the traditional classroom approach: an instructor demonstrates a techni..

Ubiquitous smart eyewear interactions using implicit sensing and unobtrusive information output

Qiushi Zhou, Joshua Newn, Benjamin Tag, Hao-Ping Lee, Chaofan Wang, Eduardo Velloso

Conference Proceedings  |  2019  |  Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC '19

Premature technology, privacy, intrusiveness, power consumption, and user habits are all factors potentially contributing to the l..

Continuous Evaluation of Video Lectures from Real-Time Difficulty Self-Report

Namrata Srivastava, Eduardo Velloso, Jason M Lodge, Sarah Erfani, James Bailey

Conference Proceedings  |  2019  |  Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19

With the increased reach and impact of video lectures, it is crucial to understand how they are experienced. Whereas previous stud..

Eyeplay revisited: Past, present and future challenges for eye-based interaction in games

Michael Lankes, Joshua Newn, Bernhard Maurer, Eduardo Velloso, Martin Dechant, Hans Gellersen

Conference Proceedings  |  2018  |  Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts - CHI PLAY '18 Extended Abstracts

What are current and future challenges that incorporating eye tracking into game design and development creates? The Second EyePla..

Circular orbits detection for gaze interaction using 2D correlation and profile matching algorithms

E Velloso, FL Coutinho, A Kurauchi, CH Morimoto

Conference Proceedings  |  2018  |  Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

© 2018 Copyright held by the owner/author(s). Recently, interaction techniques in which the user selects screen targets by matchin..

Looks can be deceiving: Using gaze visualisation to predict and mislead opponents In strategic gameplay

J Newn, F Allison, E Velloso, F Vetere

Conference Proceedings  |  2018  |  Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18

© 2018 ACM. In competitive co-located gameplay, players use their opponents' gaze to make predictions about their plans while simu..

Inferring the Mood of a Community From Their Walking Speed: A Preliminary Study

Oludamilare Matthews, Zhanna Sarsenbayeva, Weiwei Jiang, Joshua Newn, Eduardo Velloso, Sarah Clinch, Jorge Goncalves

Conference Proceedings  |  2018  |  Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers - UbiComp '18

Combining Low and Mid-Level Gaze Features for Desktop Activity Recognition

Namrata Srivastava, Joshua Newn, E Velloso

Journal article  |  2018  |  Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Human activity recognition (HAR) is an important research area due to its potential for building context-aware interactive systems..

Combining Planning with Gaze for Online Human Intention Recognition

Ronal Singh, Tim Miller, Joshua Newn, Liz Sonenberg, Eduardo Velloso, Frank Vetere

Conference Proceedings  |  2018  |  Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Intention recognition is the process of using behavioural cues to infer an agent's goals or future behaviour. People use many beha..

Combining Planning with Gaze for Online Human Intention Recognition

Ronal Singh, Tim Miller, Joshua Newn, Liz Sonenberg, Eduardo Velloso, Frank Vetere

Conference Proceedings  |  2018  |  PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18)

Effect of Distinct Ambient Noise Types on Mobile Interaction

Z Sarsenbayeva, N van Berkel, E Velloso, V Kostakos, J Goncalves

Journal article  |  2018  |  Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

The adverse effect of ambient noise on humans has been extensively studied in fields like cognitive science, indicating a signific..

Challenges of Emerging Technologies for Human-Centred Design: Bridging the Gap between Inquiry and Invention

Eduardo Velloso, Tilman Dingler, Frank Vetere, Sam Horman, Harriet McDougall, Kasia Mierzejewska

Conference Proceedings  |  2018  |  Proceedings of the 30th Australian Conference on Computer-Human Interaction

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load

Y Abdelrahman, E Velloso, T Dingler, A Schmidt, F Vetere

Journal article  |  2017  |  Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Motion Correlation: Selecting Objects by Matching their Movement

E VELLOSO, M Carter, J Newn, A Esteves, C Clarke, H Gellersen

Journal article  |  2017  |  ACM Transactions on Computer-Human Interaction

Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games

Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, Frank Vetere

Conference Proceedings  |  2017  |  Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Only Forward?: Toward Understanding Human Visual Behaviour when Examining Search Results

G Buchanan, D McKay, E Velloso, A Moffat, A Turpin, F Scholer

Conference Proceedings  |  2017  |  Proceedings of the 29th Australian Conference on Computer-Human Interaction - OZCHI '17

Search is near-ubiquitous in human society, being used for entertainment, health, financial and business information seeking. Trad..

Finding the Sweet Spot: Public Displays for Advertising on Campus

Giovanna Nunes Vilaza, Eduardo Nunes Velloso

Conference Proceedings  |  2017  |  2017 IEEE First Summer School on Smart Cities (S3C)

GazeGrip: Improving Mobile Device Accessibility with Gaze & Grip Interaction

Q Zhou, E Velloso

Conference Proceedings  |  2017  |  Proceedings of the 29th Australian Conference on Computer-Human Interaction - OZCHI '17

TraceMatch: a Computer Vision Technique for User Input by Tracing of Animated Controls

C Clarke, A Bellino, A Esteves, E VELLOSO, H Gellersen

Conference Proceedings  |  2016  |  Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Recent works have explored the concept of movement correlation interfaces, in which moving objects can be selected by matching the..

Detecting Unseen Anomalies in Weight Training Exercises

Y Kowsar, M Moshtaghi, E Velloso, L Kulik, C Leckie

Conference Proceedings  |  2016  |  Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI '16

Public DisPLAY: social games on interactive public screens

T Cox, M Carter, E VELLOSO

Conference Proceedings  |  2016  |  Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI '16

Game Controller Research from the Lab into the Wild: The Case of Eye Tracking

E VELLOSO

Conference Proceedings  |  2016

PathSync: Multi-User Gestural Interaction with Touchless Rythmic Path Mimicry

M CARTER, E Velloso, J Downs, A Sellen, K O'Hara, F Vetere

Conference Proceedings  |  2016  |  CHI

Multimodal Segmentation on a Large Interactive Tabletop: Extending Interaction on Horizontal Surfaces with Gaze

J Newn, E VELLOSO, M Carter, F Vetere

Conference Proceedings  |  2016  |  Proceedings of the 2016 ACM on Interactive Surfaces and Spaces - ISS '16

AmbiGaze: Direct Control of Ambient Devices by Gaze

Eduardo Velloso, Markus Wirth, Christian Weichel, Augusto Esteves, Hans Gellersen

Conference Proceedings  |  2016  |  Conference on Designing Interactive Systems

The Emergence of EyePlay: A Survey of Eye Interaction in Games

Eduardo Velloso, Marcus Carter

Conference Proceedings  |  2016  |  Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play

Exploring the Effects of Gaze Awareness on Multiplayer Gameplay

Joshua Newn, Eduardo Velloso, Marcus Carter, Frank Vetere

Conference Proceedings  |  2016  |  Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts - CHI PLAY Companion '16

Dynamically Exposing Gaze to Foster Playful Experiences in Multiplayer Gameplay

J Newn, E VELLOSO, M Carter, F Vetere

Conference Proceedings  |  2016

In this paper, we propose the use of 'visible gaze' for multiplayer gameplay to foster new playful experiences. Our eyes convey ri..

Demo Hour

H Jeong, D Saakes, U Lee, A Esteves, E Velloso, A Bulling, K Masai, Y Sugiura, M Ogata, K Kunze, M Inami, M Sugimoto, A Rathnayake, T Dias

Journal article  |  2015  |  Interactions

Substitutional Reality: Bringing Virtual Reality Home

AL Simeone, E Velloso

Journal article  |  2015  |  ACM Crossroads

Orbits: Enabling gaze interaction in smart watches using moving targets

A Esteves, E Velloso, A Bulling, H Gellersen

Conference Proceedings  |  2015  |  UbiComp/ISWC Adjunct

The Feet in Human–Computer Interaction: A Survey of Foot-Based Interaction

E Velloso, D Schmidt, J Alexander, H Gellersen, A Bulling

Journal article  |  2015  |  ACM Comput. Surv.

Orbits: Gaze Interaction for Smart Watches Using Smooth Pursuit Eye Movements

A Esteves, E Velloso, A Bulling, H Gellersen

Conference Proceedings  |  2015  |  UIST

An Empirical Investigation of Gaze Selection in Mid-Air Gestural 3D Manipulation.

E Velloso, J Turner, J Alexander, A Bulling, H Gellersen

Conference Proceedings  |  2015  |  INTERACT (2)

Gaze-Supported Gaming: MAGIC Techniques for First Person Shooters

E Velloso, A Fleming, J Alexander, H Gellersen

Conference Proceedings  |  2015  |  CHI PLAY

Arcade : A Platform for Public Deployment and Evaluation of Multi-Modal Games

E Velloso, C Oechsner, K Sachmann, M Wirth, H Gellersen

Conference Proceedings  |  2015  |  CHI PLAY

Interactions Under the Desk: A Characterisation of Foot Movements for Input in a Seated Position.

E Velloso, J Alexander, A Bulling, H Gellersen

Conference Proceedings  |  2015  |  INTERACT (1)

Remote Gaze and Gesture Tracking on the Microsoft Kinect: Investigating the Role of Feedback

M Carter, J Newn, E Velloso, F Vetere

Conference Proceedings  |  2015  |  OZCHI

Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences

AL Simeone, E Velloso, H Gellersen

Conference Proceedings  |  2015  |  CHI

An Empirical Characterization of Touch-Gesture Input-Force on Mobile Devices

Faisal Taher, Jason Alexander, John Hardy, Eduardo Velloso

Conference Proceedings  |  2014  |  ITS

Reindeer & Wolves: Exploring Sensory Deprivation in Multiplayer Digital Bodily Play

Daniel J Finnegan, Eduardo Velloso, Robb Mitchell, Florian Mueller, Rich Byrne

Conference Proceedings  |  2014  |  CHI PLAY

Games designed around digital bodily play involve bodily movement and expression to create engaging gameplay experiences. Most fee..

EyePlay: Applications for Gaze in Games

Jayson Turner, Eduardo Velloso, Hans Gellersen, Veronica Sundstedt

Conference Proceedings  |  2014  |  CHI PLAY

What new challenges does the combination of games and eye-tracking present? The EyePlay workshop brings together researchers and i..

Feet Movement in Desktop 3D Interaction

Adalberto L Simeone, Eduardo Velloso, Jason Alexander, Hans Gellersen

Conference Proceedings  |  2014  |  3DUI

AutoBAP: Automatic Coding of Body Action and Posture Units from Wearable Sensors

Eduardo Velloso, Andreas Bulling, Hans Gellersen

Conference Proceedings  |  2013  |  ACII

MotionMA: Motion Modelling and Analysis by Demonstration

Eduardo Velloso, Andreas Bulling, Hans Gellersen

Conference Proceedings  |  2013  |  CHI

Qualitative Activity Recognition of Weight Lifting Exercises

Eduardo Velloso, Andreas Bulling, Hans Gellersen, Wallace Ugulino, Hugo Fuks

Conference Proceedings  |  2013  |  AH

Virtual caregiver: A system for supporting collaboration in elderly monitoring

W Ugulino, M Ferreira, E Velloso, H Fuks

Conference Proceedings  |  2012  |  SBSC

Wearable computing: Accelerometers’ data classification of body postures and movements

W Ugulino, D Cardador, K Vega, E Velloso, R Milidiú, H Fuks

Conference Proceedings  |  2012  |  SBIA

Blogics! A learning tool for enabling wearable computing modules for beginners

E Velloso, D Filippo, H Fuks

Conference Proceedings  |  2011  |  Proceedings of the 19th International Conference on Computers in Education, ICCE 2011

Towards Qualitative Assessment of Weight Lifting Exercises Using Body-Worn Sensors

Eduardo Velloso, Andreas Bulling, Hans Gellersen

Conference Proceedings  |  2011  |  Ubicomp