Dynamics and Interaction Group

The dynamics and interaction project is focused on researching the role of dynamic systems in the study and synthesis of interaction between humans and between humans and computers. The current style of interaction based on discrete clicks on keyboard and mouse to interact with a computer is not rich enough to be easily extended and cannot be easily applied to many important areas of computing. We are developing new methods of interacting based on gesture, rhythm and control, and which interact intelligently with the physical constraints of real-world interaction. All of these methods use feedback, which can be visual but in our work is often also audio, or haptic (both force- and tactile feedback). They are also relevant to context-dependent interaction.

Our approach feeds from a range of research fields, relying heavily on adaptive pattern recognition, nonparametric modelling of dynamic systems, manual control theory, Bayesian reasoning, human motor control. We use mobile devices with inertial sensing (including custom-developed sensor packs like the SHAKE), location-aware systems with GPS, and with our collaborators in Berlin, EEG systems for Brain-Computer Interaction design.

Application areas include mobile computing, mobile telephony, location-aware interaction and rehabilitation engineering.

You can see videos of our work here

SHAKE Users Group webpage

The group is based at Glasgow University and is led by Roderick Murray-Smith (from 2001-2008, the lab had research labs at both Glasgow University and the Hamilton Institute, NUI Maynooth).

Researchers:

• Dr. John Williamson (his Ph.D. thesis)
• Dr. Andrew Crossan (GAIME, linking the Multimodal & Dynamics & Interaction groups)
• Andrew Ramsay (TOBI)
• Dari Trendafilov (Nokia/GU)
• Craig Stewart (Negotiated Interaction, linking the Multimodal & Dynamics & Interaction groups)
• Melissa Quek (TOBI)
• Dominik Gotojuch
• Rich Donaldson

Previous group members & visitors:

• Stephen Hughes (SAMH Engineering)
• Dr. Steven Strachan (HI, his Ph.D. thesis, now at FT/Orange labs in Grenoble)
• Josip Music (Univ. Split, Croatia)
• Dr. Parisa Eslambolchilar (HI, her Ph.D. thesis)
• Dr Kristjan Ažman (IJS, Slovenia)
• Sommer Gentry, Ph.D. (M.I.T., now U.S. Naval Academy)
• Dr. Agathe Girard (HSBC, her PhD thesis)
• Jostein Bakkeheim (nee Hansen) (NTNU)
• Dr. Thomas Hermann (University of Bielefeld)
• Dr Vuokko Lantz (Nokia Research Centre, Helsinki)
• Dr Morten Proschowsky (DTU)
• Dr. Jian Qing Shi (Newcastle)

Related Funding:

1. Current Funded Research Projects

   1. TOBI: Tools for Brain-Computer Interaction, EC-funded project. Roderick Murray-Smith (Glasgow PI), John Williamson, project coordinator:Prof. José del R. Millán, 2008-2012.
   2. GAIME: Gestural and Auditory Interactions for Mobile Environments, Stephen Brewster(PI), Roderick Murray-Smith and Andrew Crossan, EPSRC funded project. 2007-2010.
   3. Multimodal, Negotiated Interaction in Mobile Scenarios, EPSRC funded project (£638k), Roderick Murray-Smith (PI), with Matt Jones (Swansea), Stephen Brewster, 2007-2010.
   4. EC-COST action IC0601 on Sonic Interaction Design.
   5. OpenInterface. EC funded Research network. 2006-2009.
   6. Social Interaction: A Cognitive-Neurosciences Approach, ESRC funded project (£3.7 million) , Simon Garrod (PI), 2008-2012.
   7. PASCAL network member, EC-funded network in Pattern Analysis, Statistical Modelling and Computational Learning.
      

   Completed funded projects

   1. A dynamic systems approach to Negotiated Interaction on mobile devices, (€164k), Science Foundation Ireland Research Frontier grant, Sept. 2006-08.
   2. Dynamics, Uncertainty and Interaction, (€66K) PASCAL Pump-priming project (EC-funded), 2005-2006, Roderick Murray-Smith & John Williamson, based in Glasgow, in collaboration with Fraunhofer FIRST, Berlin, and DTU, Denmark.
   3. Dynamics and Interaction in BCI and Music Spaces, (€68k), J. Williamson, R. Murray-Smith, funded within the PASCAL network 2005-2007.
   4. Intelligent Sound Project - supported by the Danish Technical Research Council, and led by Lars Kai Hansen.
   5. Nonparametric Methods for Curve Fitting and Prediction with Large Data-sets, EPSRC GR/T29253/01 (Jan. 2005—June 2007), Jian Qing Shi (PI), Mike Titterington & Roderick Murray-Smith as Collaborators.
   6. Body space: Feedback for Closed-loop control of Gesture input, €136K, based at the Hamilton Institute, collaborating with the Palpable Machines group at Media Lab Europe, started November 2003
   7. Continuous Gestural Interaction with Mobile devices (€77K), with Stephen Brewster and Doug Leith, based at the Hamilton Institute. Sept. 2003-Sept 2006.
   8. Audioclouds: Three-Dimensional Audio and Gestural Interfaces for Mobile and wearable Computers, Three year EPSRC funded research project (Principal Investigator Stephen Brewster), October 2002-2005. £237K, graded "Outstanding" by EPSRC.
   9. The Glasgow Computing Science Research Festival 2005-06, Muffy Calder and Simon Gay and Roderick Murray-Smith (£19K), EPSRC.
   10. MAC - Multi-Agent Control: Probabilistic reasoning, optimal co-ordination, stability analysis and controller design for intelligent hybrid systems. (€1.2M) A four year Research Training Network within the European Commission's 5th Framework, April 2000-2004.
   11. Modern Statistical Approaches to off-equilibrium modelling for nonlinear system control. A three year EPSRC funded research project 2000-03, graded "tending to outstanding" by EPSRC reviewers.
   12. Early recognition of rollover in large lorries, Industrially funded project (joint work with K. Hunt in Mechanical Engineering as Principal Investigator)
   13. Portable Robotic Laboratories, EPSRC funded Public Understanding Award (Prof. Muffy Calder as Principal Investigator). See the legolab page for related information.
   14. Design of controllers based on pattern recognition (Fondecyt Project 700397), (Principal Investigator Daniel Sbarbaro-Hofer, Universidad de Concepción, Chile)
   15. Gesture-Based Interaction with Mobile Devices, (together with coinvestigator Stephen Brewster). Funded by SHEFC RDG85.

Related Publications:

(for non interaction-related publications see here)

• S. Brewster, R. Murray-Smith, Haptic Human-Computer Interaction, LNCS 2058, Springer-Verlag, 2001
  
• S. Strachan, Multimodal, Embodied and Location-Aware Interaction, Ph.D. thesis, Hamilton Institute, NUI Maynooth, 2007. pdf
• P. Eslambolchilar, Making Sense of Interaction Using a Model-Based Approach, Ph.D. thesis, Hamilton Institute, NUI Maynooth, 2007. pdf
• J. Williamson, Continuous Uncertain Interaction, Ph.D. thesis, Dept, of Computing Science, University of Glasgow, 2006. pdf

• J. Williamson, R. Murray-Smith, B. Blankertz, M. Krauledat, K.-R. Müller, Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces, International Journal of Human Computer Studies (available online 17 June 2009).
• S. Strachan, R. Murray-Smith, Nonvisual, distal tracking of mobile remote agents in geosocial interaction, LoCA 2009, Tokyo. pdf
• R. Murray-Smith, Empowering people rather than connecting them, to appear in International Journal of Mobile HCI, 2009. pdf
• R. Murray-Smith, S. Strachan, GeoPoke: Rotational Mechanical Systems Metaphor for Embodied Geosocial Interaction, NordiCHI 2008: Using Bridges, 18-22 October, Lund, Sweden, 2008. pdf
• R. Murray-Smith, S. Strachan, Rotational Dynamics for Design of Bidirectional Feedback during Manual Interaction, Fun and Games, Second International Conference, Markopoulos, P.; Ruyter, B.D.; Ijsselsteijn, W.; Rowland, D. (Eds.), Lecture Notes in Computer Science, Vol. 5294, p1-10, 2008. pdf
• A. Crossan, J. Williamson, S. Brewster, and R. Murray-Smith, Wrist rotation for interaction in mobile contexts. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 - 05, 2008). MobileHCI '08. ACM, New York, NY, 435-438. pdf doi
• S. Strachan, R. Murray-Smith, Bearing-based selection in mobile spatial interaction, Personal and Ubiquitous Computing, Vol. 13, No. 4, 2009. doi pdf
• P. Eslambolchilar, R. Murray-Smith, Control Centric Approach in Designing Scrolling and Zooming User Interfaces, International Journal of Human-Computer Studies, 2008. pdf
• R. Murray-Smith, J. Williamson, S. Hughes, T. Quaade, Stane: Synthesized Surfaces for Tactile Input, In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, p1299-1302, 2008 . pdf video doi
• R. Murray-Smith, J. Williamson, S. Hughes, T. Quaade and S. Strachan, Rub the Stane, In: Extended abstracts of ACM SIGCHI 2008 , Florence, Italy 2008. pdf . video
• Brown, L.M. and Williamson, J., Shake-to-talk: Multimodal Messaging for Interpersonal Communication, Proceedings of the 2nd International Workshop on Haptic and Audio Interaction Design (Seoul, Korea), 2007, Springer LNCS.
• J. Williamson, L. Brown, Flutter:Directed Random Browsing of Photo Collections with a Tangible Interface. DIS 2008, Cape Town.
• R. Murray-Smith, A. Ramsay, S. Garrod, M. Jackson, B. Musizza, Gait alignment in mobile phone conversations, MobileHCI 2007, Singapore. pdf
• S. J. Cho, R. Murray-Smith, Y. B. Kim, Multi-Context Photo Browsing on Mobile Devices Based on Tilt Dynamics, to appear in MobileHCI 2007, Singapore. pdf video(context) video(tilt-problems) video(basics)-mp4
• B. Blankertz, M. Krauledat, G. Dornhege, J. Williamson, R. Murray-Smith, and K.-R. Müller, A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface, HCI International, China, 2007. pdf video
• J. Williamson, R. Murray-Smith, S. Hughes, Shoogle: Multimodal Excitatory Interaction on Mobile Devices, Proceedings of ACM SIG CHI Conference, San Jose, 2007. pdf video
• S. Strachan, J. Williamson, R. Murray-Smith, Show me the way to Monte Carlo: density-based trajectory navigation, Proceedings of ACM SIG CHI Conference, San Jose, 2007. pdf
• S. Strachan, R. Murray-Smith, S. O’Modhrain, BodySpace: inferring body pose for natural control of a music player, Extended abstracts of ACM SIG CHI Conference, San Jose, 2007. pdf video
• S. J. Cho, R. Murray-Smith, C. Choi, Y. Sung, K. Lee, Y-B. Kim, Dynamics of Tilt-based Browsing on Mobile Devices, Extended abstracts of ACM SIG CHI Conference, San Jose, 2007. pdf video
• J. Williamson, R. Murray-Smith, S. Hughes, Devices as Interactive Physical Containers: The Shoogle System, Extended abstracts of ACM SIG CHI Conference, San Jose, 2007. pdf video
• P. Eslambolchilar, A. Crossan, R. Murray-Smith, S. Dalzel-Job, F. Pollick, Model-based Target Sonification in Small Screen Devices: Perception and Action, Handbook of Mobile HCI, 2008. pdf
• A. Crossan, R. Murray-Smith, S. Brewster, B. Musizza, Instrumented Usability Analysis for Mobile Devices, Handbook of Mobile HCI, 2008. pdf
• P. Eslambolchilar, R. Murray-Smith, Model-based, multimodal interaction in document browsing, 3rd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI'06), Washington DC, 2006. pdf
• B. Blankertz, G. Dornhege, M. Krauledat, M. Schröder, J. Williamson, R. Murray-Smith, K.R. Müller, The Berlin Brain-Computer Interface presents the novel mental typewriter Hex-o-Spell, 3rd International BCI Workshop and Training Course, Graz, 2006. pdf video (38Mb)
• J. Williamson, S. Strachan, R. Murray-Smith, It’s a Long Way to Monte-Carlo: Probabilistic GPS Navigation, Proceedings of Mobile HCI 2006, Helsinki, 2006. pdf
• A. Crossan, R. Murray-Smith, Rhythmic Interaction for Song Filtering on a Mobile Device, Haptic and Audio Interaction Design, First International Workshop, HAID 2006, Glasgow, UK, Aug. 31 - Sep. 1, p45-55, 2006. pdf video
• S. Strachan, P. Eslambolchilar, R. Murray-Smith, S. Hughes, S. O'Modhrain, gpsTunes - controlling navigation via audio feedback, Mobile HCI 2005. pdf
• S. Gentry, E. Feron, R. Murray-Smith, Human-human haptic collaboration in cyclical Fitts' tasks, to appear in IROS'05. pdf
• J. Williamson, R. Murray-Smith, Sonification of Probabilistic Feedback through Granular Synthesis, IEEE Multimedia, Vol. 12, No. 2, p45-52, April/June, 2005. pdf
• A. Crossan, R. Murray-Smith, S. Brewster, J. Kelly, B. Musizza, Gait Phase Effects in Mobile Interaction, CHI 2005, Portland. pdf
• R. Kamnik, T. Bajd, J. Williamson, R. Murray-Smith, Rehabilitation Robot Cell for Multimodal Standing-Up Motion Augmentation, International Conference on Robotics and Automation (ICRA 2005), Barcelona, 2005. pdf
• R. Kamnik, J. Q. Shi, R. Murray-Smith and T. Bajd, Nonlinear modelling of FES-supported standing up in paraplegia for selection of feedback sensors, IEEE Transactions on Neural Systems & Rehabilitation Engineering, Vol. 13, No. 1, p40-52, March, 2005. pdf
• J.Q Shi, R. Murray-Smith, D. M. Titterington, Hierarchical Gaussian process mixtures for regression, Statistics and Computing, vol. 15, pp31-41, 2005. pdf
• J. Williamson, R. Murray-Smith, Dynamics and probabilistic text entry, In: Proceedings of the Hamilton Summer School on Switching and Learning in Feedback systems, Ed. R. Murray-Smith, R. Shorten, Springer-Verlag, Lecture Notes in Computing Science, Vol. 3355, p333-342, 2005. Springerlink pdf
• V. Lantz, R. Murray-Smith, Rhythmic Interaction with a mobile device, NordiCHI 2004, Tampere, 2004. pdf
• S. Strachan, R. Murray-Smith, Muscle Tremor as an Input Mechanism, UIST 2004, Santa Fe, 2004. pdf video
• P. Eslambolchilar, J. Williamson, R. Murray-Smith, Multimodal Feedback for tilt controlled Speed Dependent Automatic Zooming, UIST 2004, Santa Fe, 2004. pdf video
• S. Strachan, R. Murray-Smith, I. Oakley, J. Ängeslevä, Dynamic Primitives for Gestural Interaction, Mobile Human-Computer Interaction – MobileHCI 2004: 6th International Symposium, Glasgow, UK, September 13-16, 2004. Proceedings. Stephen Brewster, Mark Dunlop (Eds), LNCS 3160, Springer-Verlag, p325-330, 2004. pdf Springerlink
• P. Eslambolchilar, R.Murray-Smith, Tilt-based Automatic Zooming and Scaling in Mobile Devices - a state-space implementation, Mobile Human-Computer Interaction – MobileHCI 2004: 6th International Symposium, Glasgow, UK, September 13-16, 2004. Proceedings. Stephen Brewster, Mark Dunlop (Eds), LNCS 3160, Springer-Verlag, p120-131, 2004. pdf tilt-video(avi-6Mb) clip stylus video(avi-9Mb) clip SpringerLink
• A. Crossan, R. Murray-Smith, Variability in Wrist-Tilt Accelerometer-based Gesture Interfaces, Mobile Human-Computer Interaction – MobileHCI 2004: 6th International Symposium, Glasgow, UK, September 13-16, 2004. Proceedings. Stephen Brewster, Mark Dunlop (Eds), LNCS 3160, Springer-Verlag, p144-155, 2004. pdf Springerlink
• A. Crossan, J. Williamson, R. Murray-Smith, Haptic Granular Synthesis: Targeting, Visualisation and Texturing, International Symposium on Non-visual & Multimodal Visualization, London, IEEE Computer Society, 2004 pdf video clip (avi-1.24 Mb)
• J. Williamson, R. Murray-Smith, Pointing without a pointer, ACM SIG CHI, Vienna, 2004. pdf
• J. Williamson, R. Murray-Smith, Granular synthesis for display of time-varying probability densities, International Workshop on Interactive Sonification (Human Interaction with Auditory Displays), eds. A. Hunt, Th. Hermann, Bielefeld, Germany, January 2004. pdf demos
• P. Eslambolchilar, A. Crossan, R. Murray-Smith, Model-based target sonification on mobile devices, International Workshop on Interactive Sonification (Human Interaction with Auditory Displays), eds. A. Hunt, Th. Hermann, Bielefeld University, Germany, January 2004. pdf
• J.Q Shi, R. Murray-Smith, D. M. Titterington, Bayesian Regression and Classification Using Mixtures of Multiple Gaussian Processes, International Journal of Adaptive Control and Signal Processing, Volume 17, Number 2, pp1 149-161, 2003. pdf
• S. Gentry, R. Murray-Smith, Haptic dancing: human performance at haptic decoding with a vocabulary, IEEE International conference on Systems Man and Cybernetics, Washington, D.C., USA 2003 pdf (Awarded Best Student Paper prize)
• Murray-Smith, R, Sbarbaro, D., Rasmussen,C.E., Girard, A., Adaptive, Cautious, Predictive control with Gaussian Process priors, 13th IFAC Symposium on System Identification, IFAC, Rotterdam, 2003 pdf

• Gentry,S., Wall, S., Oakley, I., Murray-Smith, R., Got rhythm? Haptic-only lead and follow dancing, Proceedings of Eurohaptics 2003, Dublin, pp481-488, 2003. pdf
• E. Solak, R. Murray-Smith, W.E. Leithead, D.J. Leith, and C.E. Rasmussen, Derivative observations in Gaussian Process models of dynamic systems, NIPS 15, Vancouver, Canada, MIT Press, 2003. ps pdf
• A. Girard, C., Rasmussen, J. Quinonero Candela, and R. Murray-Smith, Gaussian Process Priors With Uncertain Inputs – Application to Multiple-Step Ahead Time Series Forecasting, NIPS 15, Vancouver, Canada, MIT Press, 2003. ps pdf
• R. Murray-Smith, Modelling Human Gestures and control behaviour from measured data, IFAC conference on Artificial Intelligence in Real Time Control, Budapest 2000. pdf
• R. Murray-Smith, Modelling human control behaviour with a Markov-chain switched bank of control laws, 7th IFAC Symposium on Man-Machine Systems, Kyoto, pp. 521-526, 1998. pdf

• Kamnik, R., J. Q. Shi, R. Murray-Smith and T. Bajd. Nonlinear modelling of FES-supported standing up in paraplegia for selection of feedback sensors. Technical Report TR-2003-150. University of Glasgow, Scotland, UK, July 2003. pdf
• J. Williamson, R. Murray-Smith, Dynamics and probabilistic text entry, DCS Technical Report TR-2003-147, Department of Computing Science, Glasgow University, June, 2003. pdf video (11Mb)
• A. Girard, R. Murray-Smith,Learning a Gaussian Process prior model with uncertain inputs, DCS Technical Report TR-2003-144, Department of Computing Science, Glasgow University, June, 2003. pdf
• J. Williamson, R. Murray-Smith, Audio feedback for gesture recognition, DCS Technical Report TR-2002-127, Department of Computing Science, Glasgow University, 2002. pdf
• J.Q. Shi, R. Murray-Smith, D.M. Titterington, Bayesian Regression and Classification Using Mixtures of Gaussian Processes, DCS Technical Report TR-2002-114/Dept. Statistics Tech. Report 02-8, 2002. pdf
• J.Q. Shi, R. Murray-Smith, and D.M. Titterington, Hierarchical Gaussian process mixtures for regression, DCS Technical Report TR-2002-107/Dept. Statistics Tech. Report 02-7, 2002. pdf

Recent workshops:

• PASCAL 2007 Workshop on BCI meets HCI, April 16th-17th, Martigny, Switzerland.
• CHI 2007 Workshop on Mobile Spatial Interaction, Peter Fröhlich, Rainer Simon, Lynne Baillie, Joi Roberts,
  Roderick Murray-Smith, Matt Jones, Rahul Nair.
• NIPS 2006 Workshop: Current Trends in Brain-Computer Interfacing, Matthias Krauledat , José del R. Millán , Klaus-Robert Mueller , Benjamin Blankertz , Roderick Murray-Smith