Shoogle is a novel, intuitive interface for sensing data within a mobile device, such as presence and properties of
text messages or remaining resources. It is based around active exploration: devices are shaken, revealing the contents
rattling around "inside".
Vibrotactile display and realistic impact sonification create a compelling system. Inertial
sensing is used for completely eyes-free, single-handed interaction that is entirely natural. Prototypes are
running both on a PDA and on a mobile phone with a wireless sensor pack. This is a general technique for coupling inference mechanisms and multimodal interaction.
J. Williamson, R. Murray-Smith, S. Hughes, Shoogle:
Multimodal Excitatory Interfaces on Mobile Devices, CHI
- J. Williamson, R. Murray-Smith, S. Hughes, Devices as Interactive Physical Containers: The Shoogle System, Extended abstracts of ACM SIG CHI Conference, San Jose, 2007. PDF
- J. Williamson, R. Murray-Smith, Multimodal Excitatory
Interfaces with Automatic Content Classification (submitted)
An explantory video is available in MOV and AVI formats:
Slides for the CHI talk on Shoogle are here (PPT format).
Some audio examples from the Shoogle system are given below (in WAV format). All
of these are recorded directly from the audio out of the iPaq.
- Metallic objects
- Wooden objects
- Glass objects
- Keys jangling
- Chiming metal
- Large metal object
- Ping-pong balls
- Deep, drum like object