University of Oulu

Mihai Bâce, Teemu Leppänen, David Gil de Gomez, and Argenis Ramirez Gomez. 2016. ubiGaze: ubiquitous augmented reality messaging using gaze gestures. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications (SA '16). ACM, New York, NY, USA, Article 11, 5 pages. DOI:

ubiGaze : ubiquitous augmented reality messaging using gaze gestures

Saved in:
Author: Bâce, Mihai1; Leppänen, Teemu2; Gomez, Argenis Ramirez3;
Organizations: 1Department of Computer Science, ETH Zurich
2Center for Ubiquitous Computing, University of Oulu
3School of Computing and Communication, Lancaster University
4School of Computing, University of Eastern Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 5.1 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2016
Publish Date: 2019-05-27


We describe ubiGaze, a novel wearable ubiquitous method to augment any real-world object with invisible messages through gaze gestures that lock the message into the object. This enables a context and location dependent messaging service, which users can utilize discreetly and effortlessly. Further, gaze gestures can be used as an authentication method, even when the augmented object is publicly known. We developed a prototype using two wearable devices: a Pupil eye tracker equipped with a scene camera and a Sony Smartwatch 3. The eye tracker follows the users’ gaze, the scene camera captures distinct features from the selected real-world object, and the smartwatch provides both input and output modalities for selecting and displaying messages. We describe the concept, design, and implementation of our real-world system. Finally, we discuss research implications and address future work.

see all

ISBN Print: 978-1-4503-4551-4
Article number: 11
DOI: 10.1145/2999508.2999530
Host publication: SA '16 SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications
Conference: ACM SIGGRAPH Asia
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Funding: Parts of this work were developed at the Eyework workshop during UBISS 2016, Oulu, Finland. We thank Hans Gellersen (Lancaster University) and Eduardo Velloso (University of Melbourne) for their support for this work. We would also like to thank Gabor Sörös (ETH Zurich) for his ideas and help throughout this project.
Copyright information: © 2016 Copyright held by the owner/author(s). This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in SA '16 SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications,