Journal article

Can we do without GUIs? Gesture and speech interaction with a patient information system

Eamonn O'Neill, Manasawee Kaenampornpan, Vassilis Kostakos, Andrew Warr, Dawn Woodgate

PERSONAL AND UBIQUITOUS COMPUTING | SPRINGER LONDON LTD | Published : 2006

Abstract

We have developed a gesture input system that provides a common interaction technique across mobile, wearable and ubiquitous computing devices of diverse form factors. In this paper, we combine our gestural input technique with speech output and test whether or not the absence of a visual display impairs usability in this kind of multimodal interaction. This is of particular relevance to mobile, wearable and ubiquitous systems where visual displays may be restricted or unavailable. We conducted the evaluation using a prototype for a system combining gesture input and speech output to provide information to patients in a hospital Accident and Emergency Department. A group of participants was ..

View full abstract