• Multimodal human-computer interaction (HCI)
• 3D sound and Earcons in human-computer interfaces
• Novel multimodal interfaces for mobile devices
• The use of force-feedback devices, tactile displays, pressure input and Tactons in human-computer interaction
• Sonification/Perceptualisation of data
• Design of haptic medical simulators
• Interaction design for older users and users with visual disabilities
• Smell-based user interfaces

We are all part of the Glasgow Interactive Systems Group (GIST) here at Glasgow. GIST is one of the largest HCI research groups in the UK. It is an inter-disciplinary group investigating all aspects of interactive systems from graphics, to sounds, from User Interface Management Systems to the psychology of interaction and formal specifications of user interfaces.

Multimodal Research

A current focus of our work is on the design and evaluation of novel interfaces for mobile devices that can be used on the move. The GAIME project is investigating how we use non-hand based gestures (e.g. wrist rotation, head movements) and 3D sound to improve mobile interaction. We are also interested in pedestrian navigation on mobile devices and how we can support the kinds of navigation that people want to do with multimodal interaction in the Haptimap EU project.

We are also interested computer haptics, based on both force-feedback and tactile displays.We are currently interested in the design of Tactons (tactile icons). We also work in the area of design of visualisations for blind people - see the MultiVis project. For full details on our haptics research see the research pages.

A new area of interest is using multimodal interaction for home care. We have just started the Multimodal Reminders in the Home project with Edinburgh University to study how multimodal interaction can improve home care systems.

The design of non-speech sounds (things like music and sound-effects) and how they can be used to improve human-computer interaction is another area of our research. Earcons are one type of sound that we have studied in great detail. For lots more detail look at the research pages.

We have begun to work using smell as an interaction technique, particularly focusing on the memory-triggering capabilities of smell as an aid to searching and Aromacons, the smell equivalent of visual icons/earcon/tactons.

Conferences, Workshops and Special Issues

Ercan Altinsoy, Ute Jekosch and I ran the Fourth International Workshop on Haptic and Audio Interaction Design (HAID 2009) in Dresden, Germany on 10-11th September, 2009. Here are some photos of the event. HAID 2010 will take place in Aalborg University, Copenhagen, Denmark.

Antti Oulasvirta and I just finished a special issue of the International Journal of Human-Computer Studies on Mobile Human-Computer Interaction.

Kanav Kahol, Vincent Hayward and I edited a special issue of IEEE Transactions on Haptics on Ambient Haptics.