University of Oulu

Lik-Hang Lee, Tristan Braud, Simo Hosio, and Pan Hui. 2021. Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges. ACM Comput. Surv. 54, 8, Article 165 (November 2022), 38 pages. DOI:

Towards augmented reality driven human-city interaction : current research on mobile headsets and future challenges

Saved in:
Author: Lee, Lik-Hang1; Braud, Tristan2; Hosio, Simo3;
Organizations: 1KAIST, Republic of Korea
2Division of Integrative Systems and Design, The Hong Kong University of Science and Technology, Hong Kong
3Center for Ubiquitous Computing, The University of Oulu, Finland
4Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong
5Department of Computer Science, The University of Helsinki, Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 1.6 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2021
Publish Date: 2021-11-15


Interaction design for Augmented Reality (AR) is gaining attention from both academia and industry. This survey discusses 260 articles (68.8% of articles published between 2015–2019) to review the field of human interaction in connected cities with emphasis on augmented reality-driven interaction. We provide an overview of Human-City Interaction and related technological approaches, followed by reviewing the latest trends of information visualization, constrained interfaces, and embodied interaction for AR headsets. We highlight under-explored issues in interface design and input techniques that warrant further research and conjecture that AR with complementary Conversational User Interfaces (CUIs) is a crucial enabler for ubiquitous interaction with immersive systems in smart cities. Our work helps researchers understand the current potential and future needs of AR in Human-City Interaction.

see all

Series: ACM computing surveys
ISSN: 0360-0300
ISSN-E: 1557-7341
ISSN-L: 0360-0300
Volume: 54
Issue: 8
Article number: 165
DOI: 10.1145/3467963
Type of Publication: A1 Journal article – refereed
Field of Science: 113 Computer and information sciences
Funding: This research has been supported in part by 5G-VIIMA and REBOOT Finland IoT Factory projects funded by Business Finland, the 6G Flagship project, 5GEAR funded by the Academy of Finland (Decision No. 318927), and project 16214817 from the Research Grants Council of Hong Kong. Further, this research is supported by the GenZ strategic profiling project at the University of Oulu, supported by the Academy of Finland (project number 318930), and CRITICAL (Academy of Finland Strategic Research, 335729). Part of the work was also carried out with the support of Biocenter Oulu, spearhead project ICON.
Academy of Finland Grant Number: 318927
Detailed Information: 318927 (Academy of Finland Funding decision)
318930 (Academy of Finland Funding decision)
335729 (Academy of Finland Funding decision)
Copyright information: © 2021 Copyright held by the owner/author(s). Publication rights licensed to ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in ACM Computing Surveys,