Research Overview

Dr. Andrew Crossan

We have studied a range of body-based gestures for mobile interaction. This work has explored user targeting performance with accelerometer sensed wrist rotation (download paper ) and head tilt (download paper ) as input techniques in both static and mobile contexts. We have also conducted studies with foot based interaction for a menu interaction task showing the potential of foot tap for short interactions.

For feedback, we have explored texturing a touchscreen with virtual audio and vibrotactile textures to support the user when browsing an interface non-visually (download paper ). We have explored the use of convincing pre-recorded textures using processed audio files generated through recorded audio from a contact microphone being dragged over everyday surfaces. These textures are displayed through audio or a C2 linear tactile actuator varying the rate and amplitude of the texture with the user's finger speed on the screen.

Ms Yolanda Vazquez-Alvarez

The aim of our research is to evaluate 3D audio techniques used to implement auditory displays that support multitasking and access to context information in interactive mobile environments. This work has first evaluated the positional 3D audio controls supported by the mobile device of choice for this work, i.e. Nokia N95 8GB (download paper ). After the successful evaluation of the 3D audio controls on the Nokia mobile device, a number of 3D audio techniques were evaluated in an interactive multitasking environment (download paper ). An initial user study has also been carried out to test an auditory display supporting access to context information in an outdoor locative audio environment (download paper ). Currently, a calibration to test the accuracy of an indoor localization system is being set up. This study will act as a baseline to investigate the requirements for user interaction with location-based information.

Miss Julie Rico

In our past research into the social acceptability of using multimodal mobile interfaces, we have used a variety of methods to begin exploring these issues. Our first project used a survey format with videos of gestures being performed to ask respondents about the locations where they would be willing to perform gestures and the audiences they would be willing to perform gestures in front of. This was followed up by an on-the-street study where participants were asked to perform gestures in a private indoor setting and a public outdoor setting over repeated trials. The results of these studies can be found (download paper ). Our current work looks into not only gesture, but also speech based input for mobile devices. This study uses different experience prototypes in a focus group setting that examines the social acceptability of performing these actions in public as well as possible application areas where they might be useful.