Eye Movements and Visual Perception

Contact Andreas Bulling Project Start June 2007 Project End June 2010

Description The goal of this project is to extend contextual awareness for wearable systems by examining movements of the human eyes which reveal information about the user's interaction with the environment and to make use of cognitive aspects inherent in visual perception like temporal history, intention or learning.

Objectives

Context and activity recognition using eye movements
We want to introduce the paradigm of visual perception and investigations on eye movements as new methods to implement novel and complement current context-aware systems. Therefore, we will investigate the potential but also possible limitations of using eye movements to perform context and activity recognition in wearable settings. Besides recognising individual activities another focus will be put on long-term eye movement analysis.

Mobile attentive user interfaces and multi-modal interaction
Based on the findings from the previous objectives we plan to investigate attentive user interfaces (AUI) in mobile settings using wearable systems. Besides cognitive aspects like visual attention and deliberate eye gestures, we want to analyse how subjective appraisal, temporal history and learning influence eye movement characteristics and how these aspects can be used in novel AUIs.

Wearable eye tracking based on Electrooculography
We aim at building a wearable eye tracking solution based on Electrooculography (EOG) and try to push this technology to its limits. The key issues that will be addressed are to achieve as less obtrusiveness as possible and to develop signal processing methods which adapt to dynamically changing environments during long-term recordings.

Publications

2011

• Eye Movement Analysis for Activity Recognition Using Electrooculography
  Andreas Bulling, Jamie A. Ward, Hans Gellersen and Gerhard Tröster
  (2011), in: IEEE Transactions on Pattern Analysis and Machine Intelligence, 33:4(741-753)
  [ BiBTeX RIS PDF DOI URL ]
• Kontexterkennung für Hörgeräte mittels zusätzlicher Sensormodalitäten
  Bernd Tessendorf, Andreas Bulling, Peter Derleth, Manuela Feilner, Daniel Roggen, Thomas Stiefmeier and Gerhard Tröster
  in: Proc. of the 37th Annual Convention for Acoustics (DAGA 2011), 2011
  [ BiBTeX RIS ]
• Recognition of Hearing Needs from Body and Eye Movements to Improve Hearing Instruments
  Bernd Tessendorf, Andreas Bulling, Peter Derleth, Manuela Feilner, Daniel Roggen, Thomas Stiefmeier and Gerhard Tröster
  in: Proc. of the 9th International Conference on Pervasive Computing (Pervasive 2011), Springer, 2011
  [ BiBTeX RIS ]
• What's in the Eyes for Context-Awareness?
  Andreas Bulling, Daniel Roggen and Gerhard Tröster
  (2011), in: IEEE Pervasive Computing, 10:2(48 - 57)
  [ BiBTeX RIS DOI URL ]

2010

• Eye Movement Analysis for Context Inference and Cognitive-Awareness: Wearable Sensing and Activity Recognition Using Electrooculography
  Andreas Bulling
  PhD Thesis, Diss. ETH No. 19082, ETH Zurich, 2010
  [ BiBTeX RIS PDF URL ]
• On the issue of variability in labels and sensor configurations in activity recognition systems
  Daniel Roggen, Kilian Förster, Alberto Calatroni, Andreas Bulling and Gerhard Tröster
  in: Workshop at the 8th International Conference on Pervasive Computing (Pervasive 2010), 2010
  [ BiBTeX RIS PDF ]
• Toward Mobile Eye-Based Human-Computer Interaction
  Andreas Bulling and Hans Gellersen
  (2010), in: IEEE Pervasive Computing, 9:4(8-12)
  [ BiBTeX RIS PDF DOI ]
• Towards Multi-Modal Context Recognition for Hearing Instruments
  Bernd Tessendorf, Andreas Bulling, Daniel Roggen, Thomas Stiefmeier, Gerhard Tröster, Manuela Feilner and Peter Derleth
  in: Proc. of the 14th International Symposium on Wearable Computers, IEEE Press, 2010
  [ BiBTeX RIS ]

2009

• Eye Movement Analysis for Activity Recognition
  Andreas Bulling, Jamie A. Ward, Hans Gellersen and Gerhard Tröster
  in: Proc. of the 11th International Conference on Ubiquitous Computing (UbiComp 2009), pages 41-50, ACM Press, 2009
  [ BiBTeX RIS PDF DOI ]
• OPPORTUNITY: Activity and context awareness in opportunistic open-ended sensor environments
  Daniel Roggen, Kilian Förster, Alberto Calatroni, Andreas Bulling, Thomas Holleczek, Gerhard Tröster, Paul Lukowicz, Gerald Pirkl, David Bannach, Alois Ferscha, Andreas Riener, Clemens Holzmann, R. Chavarriaga and J. del R. Millán
  in: Proc. of the 1st European Future and Emerging Technologies Conference (FET 2009), Prague, Czech Republic, European commission, 2009
  [ BiBTeX RIS ]
• Speech as a Feedback Modality for Smart Objects
  Clemens Lombriser, Andreas Bulling, Andreas Breitenmoser and Gerhard Tröster
  in: Proc. of the 2nd International Workshop on Intelligent Pervasive Devices (PerDev 2009), pages 1-5, 2009
  [ BiBTeX RIS PDF DOI ]
• Wearable EOG Goggles: Eye-Based Interaction in Everyday Environments
  Andreas Bulling, Daniel Roggen and Gerhard Tröster
  in: Ext. Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009), pages 3259-3264, 2009
  [ BiBTeX RIS PDF DOI ]
• Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments
  Andreas Bulling, Daniel Roggen and Gerhard Tröster
  (2009), in: Journal of Ambient Intelligence and Smart Environments, 1:2(157-171)
  [ BiBTeX RIS PDF DOI ]

2008

• Adjunct Proceedings of the Third European Conference on Smart Sensing and Context
  Andreas Bulling, Clemens Lombriser, Daniel Roggen and Gerhard Tröster
  ETH Zurich, 2008
  [ BiBTeX RIS URL ]
• EyeMote - Towards Context-Aware Gaming Using Eye Movements Recorded From Wearable Electrooculography
  Andreas Bulling, Daniel Roggen and Gerhard Tröster
  in: Proc. of the 2nd International Conference on Fun and Games (FnG 2008), pages 33-45, 2008
  [ BiBTeX RIS PDF DOI ]
• It's in Your Eyes - Towards Context-Awareness and Mobile HCI Using Wearable EOG Goggles
  Andreas Bulling, Daniel Roggen and Gerhard Tröster
  in: Proc. of the 10th International Conference on Ubiquitous Computing (UbiComp 2008), pages 84-93, 2008
  [ BiBTeX RIS PDF DOI ]
• Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography
  Andreas Bulling, Jamie A. Ward, Hans Gellersen and Gerhard Tröster
  in: Proc. of the 6th International Conference on Pervasive Computing (Pervasive 2008), pages 19-37, Springer, 2008
  [ BiBTeX RIS PDF Dataset DOI ]

2007

• Adaptation and learning: Towards applications in wearable computing
  Oliver Amft, Marc Bächlin, Andreas Bulling, Martin Rumo, Johannes Schumm, Cornelia Setz, Thomas Stiefmeier, Bert Arnrich, Daniel Roggen and Gerhard Tröster
  ETZ Zurich, 2007
  [ BiBTeX RIS PDF ]
• Automatic Artefact Compensation in EOG Signals
  Andreas Bulling, Philip Herter, Martin Wirz and Gerhard Tröster
  in: Adj. Proc. of the 2nd European Conference on Smart Sensing and Context (EuroSSC 2007), pages 12-13, 2007
  [ BiBTeX RIS ]

Media & Press Coverage

• The Stranger Side of CHI 2009
  Wearable eye tracker described in an article on MIT Technology Review, April 13, 2009
• Wearable EOG Goggles
  Video about eye gesture based interaction using the wearable electrooculographic (EOG) goggles available at YouTube (Link), November 19, 2008
• IP Profile: Wearable Eye Tracker
  Article about the wearable eye tracker published on Nano World News (Link), June 27, 2008
• ETH Zurich technology transfer in Boston
  Article mentioning the wearable eye tracker as one of three innovations presented at TechConnect Summit 2008 published on ETH Life (Link), June 24, 2008
• Transfer in Boston
  Article mentioning the wearable eye tracker as one of three innovations presented at TechConnect Summit 2008 published on ETH Life (Link), June 24, 2008
• Visionary Diagnosis
  Article about the wearable eye tracker published in the Classroom Ready Monthly Science News (PDF / PDF), June 2008
• Spec-tacular
  Article about the wearable eye tracker published on Mumbai News (Link / PDF), May 03, 2008
• Pesquisador cria óculos que identifica sintomas de esquizofrenia
  Article about the wearable eye tracker published on WNews (Link), May 02, 2008
• Óculos fazem diagnóstico de doenças medindo o movimento dos olhos
  Article about the wearable eye tracker published on Inovação Tecnológica (Link), April 30, 2008
• Wearable Computing: Special Goggles Analyze Eye Movements To Diagnose Disease
  Article about the wearable eye tracker published on ScienceDaily (Link), April 28, 2008
• Diese Brille bietet mehr als den Durchblick
  Article about the wearable eye tracker published in CASHdaily (PDF), April 09, 2008
• Augen-Computer
  Article about the wearable eye tracker published in Baslerstab, April 01, 2008
• Spectacles measure eye movements
  Article about the wearable eye tracker published on ETH Life (Link), March 31, 2008
• Brille misst Augenbewegungen
  Article about the wearable eye tracker published on ETH Life (Link), March 31, 2008

Student Projects

Master Theses

• Biometric interface for authentication using eye movements from EOG (FS09)
• Adaptive EOG signal processing on DSP (HS07)
• Development of an integrated wearable EOG-based eye-tracker (SS07)

Semester Theses

• Online configuration and calibration for wearable EOG goggles (FS09)
• Long-Term Eye Movement Analysis Using Wearable Electrooculography (FS09)
• Text-entry interface using continuous eye gestures from EOG (HS08)
• Automatic artefact compensation in EOG signals (SS07)