University of Oulu

Lik Hang Lee, Yiming Zhu, Yui-Pan Yau, Pan Hui, and Susanna Pirttikangas. 2021. Press-n-Paste: Copy-and-Paste Operations with Pressure-sensitive Caret Navigation for Miniaturized Surface in Mobile Augmented Reality. Proc. ACM Hum.-Comput. Interact. 5, EICS, Article 199 (June 2021), 29 pages. DOI:

Press-n-paste : copy-and-paste operations with pressure-sensitive caret navigation for miniaturized surface in mobile augmented reality

Saved in:
Author: Lee, Lik Hang1; Zhu, Yiming2; Yau, Yui-Pan3;
Organizations: 1Republic of Korea and The University of Oulu, Finland
2University of Science and Technology of China, China and Hong Kong University of Science and Technology, Hong Kong SAR
3Hong Kong University of Science and Technology, Hong Kong SAR
4Hong Kong University of Science and Technology, Hong Kong SAR and University of Helsinki, Finland
5The University of Oulu, Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 8.5 MB)
Persistent link:
Language: English
Published: Association for Computing Machinery, 2021
Publish Date: 2022-02-24


Copy-and-paste operations are the most popular features on computing devices such as desktop computers, smartphones and tablets. However, the copy-and-paste operations are not sufficiently addressed on the Augmented Reality (AR) smartglasses designated for real-time interaction with texts in physical environments. This paper proposes two system solutions, namely Granularity Scrolling (GS) and Two Ends (TE), for the copy-and-paste operations on AR smartglasses. By leveraging a thumb-size button on a touch-sensitive and pressure-sensitive surface, both the multi-step solutions can capture the target texts through indirect manipulation and subsequently enables the copy-and-paste operations. Based on the system solutions, we implemented an experimental prototype named Press-n-Paste (PnP). After the eight-session evaluation capturing 1,296 copy-and-paste operations, 18 participants with GS and TE achieve the peak performance of 17,574 ms and 13,951 ms per copy-and-paste operation, with 93.21% and 98.15% accuracy rates respectively, which are as good as the commercial solutions using direct manipulation on touchscreen devices. The user footprints also show that PnP has a distinctive feature of miniaturized interaction area within 12.65 mm * 14.48 mm. PnP not only proves the feasibility of copy-and-paste operations with the flexibility of various granularities on AR smartglasses, but also gives significant implications to the design space of pressure widgets as well as the input design on smart wearables.

see all

Series: Proceedings of the ACM on human-computer interaction
ISSN: 2573-0142
ISSN-E: 2573-0142
ISSN-L: 2573-0142
Volume: 5
Issue: EICS
Pages: 1 - 29
Article number: 199
DOI: 10.1145/3457146
Host publication: ECIS
Conference: Engineering Interactive Computing Systems
Type of Publication: A4 Article in conference proceedings
Field of Science: 213 Electronic, automation and communications engineering, electronics
Copyright information: © 2021 Copyright held by the owner/author(s). Publication rights licensed to ACM.