University of Oulu

Latif, U., Gong, Z., Nanjappan, V., & Georgiev, G. (2023). DESIGNING FOR REHABILITATION MOVEMENT RECOGNITION AND MEASUREMENT IN VIRTUAL REALITY. Proceedings of the Design Society, 3, 1387-1396. doi:10.1017/pds.2023.139

Designing for rehabilitation movement recognition and measurement in virtual reality

Saved in:
Author: Latif, Ummi Khaira1; Gong, Zhengya1; Nanjappan, Vijayakumar1;
Organizations: 1Center for Ubiquitous Computing, University of Oulu, Finland
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 1.8 MB)
Persistent link:
Language: English
Published: Cambridge University Press, 2023
Publish Date: 2023-10-31


Virtual reality (VR)-based rehabilitation has been widely implemented to maintain and increase patient motivation during therapy sessions. Researchers nowadays design VR-based rehabilitation by leveraging off-the-shelf VR devices for easy access and application. However, researchers need to implement additional custom hardware or incorporate a specific algorithm to perform a real-time evaluation of each therapeutic movement. This study aims to design and develop a system with features for recognizing and measuring the upper limb rehabilitation movement in VR using off-the-shelf VR devices such as VR headsets, controllers, and trackers. This system is bundled and distributed as a single toolkit to accommodate other researchers in providing the evaluation feature for their VR-based rehabilitation system. The user experiment was conducted to verify the usability of this proposed design system. The experiment results show that the system can recognize 16 upper limb movements and provide several measurement data that researchers can use in providing the evaluation feature based on their design requirements.

see all

Series: Proceedings of the Design Society
ISSN: 2732-527X
ISSN-E: 2732-527X
ISSN-L: 2732-527X
Volume: 3
Pages: 1387 - 1396
DOI: 10.1017/pds.2023.139
Host publication: Proceedings of the International Conference on Engineering Design (ICED23), Bordeaux, France, 24-28 July 2023
Conference: Proceedings of the International Conference on Engineering Design
Type of Publication: A4 Article in conference proceedings
Field of Science: 113 Computer and information sciences
3141 Health care science
217 Medical engineering
Funding: This work was supported by the European Union’s Horizon 2020 research and innovation programme (Grant Number H2020-856998), the Academy of Finland 6Genesis Flagship (Grant number 346208), and the China Scholarship Council (Grant Number 202107960006).
Academy of Finland Grant Number: 346208
Detailed Information: 346208 (Academy of Finland Funding decision)
Copyright information: © The Author(s), 2023. Published by Cambridge University Press. This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (, which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.