University of Oulu

Xiang Su, Ai Jiang, Jacky Cao, Wenxiao Zhang, Pan Hui, and Juan Ye. 2022. Enabling Continuous Object Recognition in Mobile Augmented Reality. In IUI ’22: 27th Annual Conference on Intelligent User Interfaces, March 22–25, 2022, Helsinki, Finland. ACM, New York, NY, USA, 4 pages.

Enabling continuous object recognition in mobile augmented reality

Saved in:
Author: Su, Xiang1,2; Jiang, Ai3; Cao, Jacky2,1;
Organizations: 1Department of Computer Science, Norwegian University of Science and Technology, Norway
2Center for Ubiquitous Computing, University of Oulu, Finland
3School of Computer Science, University of St Andrews, United Kingdom
4The Hong Kong University of Science and Technology, Hong Kong
5University of Helsinki, Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 0.9 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2022
Publish Date: 2023-04-12


Mobile Augmented Reality (MAR) applications enable users to interact with physical environments through overlaying digital information on top of camera views. Detecting and classifying complex objects in the real world presents a critical challenge to enable immersive user experiences in MAR applications. Aiming to provide continuous MAR experiences, we address a key challenge of continuous object recognition, which requires accommodating an increasing number of recognition requests on different types of images in MAR systems and possible new types of images in emerging applications. Inspired by the latest advance in continual learning approaches in computer vision, this paper presents a novel MAR system to enhance its scalability with continual learning in realistic scenarios. Our experiments demonstrate that 1) the system enables efficiently recognising objects without requiring retraining from scratch; and 2) edge computing further reduces latency for continual object recognition.

see all

ISBN: 978-1-4503-9145-0
Pages: 42 - 45
DOI: 10.1145/3490100.3516459
Host publication: 27th International Conference on Intelligent User Interfaces
Conference: International Conference on Intelligent User Interfaces
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Copyright information: © Owner/Author 2022. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in IUI ’22: 27th Annual Conference on Intelligent User Interfaces,