University of Oulu

A. Firouzian, P. Pulli, M. Pleva, J. Juhar and S. Ondas, "Speech interface dialog with smart glasses," 2017 15th International Conference on Emerging eLearning Technologies and Applications (ICETA), Stary Smokovec, 2017, pp. 1-6. doi: 10.1109/ICETA.2017.8102483

Speech interface dialog with smart glasses

Saved in:
Author: Firouzian, Aryan1; Pulli, Petri1; Pleva, Matus2;
Organizations: 1Dept. of Information Processing Science, Faculty of Information Technology and Electrical Engineering, University of Oulu, Oulu, Finland
2Dept. of Electronics and Multimedia Communications, Faculty of Electrical Engineering and Informatics, Technical university of Kosice, Letna 9, 04120 Koŝice, Slovakia
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 1.3 MB)
Persistent link:
Language: English
Published: Institute of Electrical and Electronics Engineers, 2017
Publish Date: 2019-05-03


This paper describes design of elderly-user-friendly multi-mode user interface with different modules. Use of eye glasses is common among senior citizens, and it inspired us to implement interface modules on it. Indicator-based Glasses contains the Eye Blinking Detection module integrated with visual cues indicators as system feedback. The multi-mode interface provides five interaction channels by proposing audio input/output modules and Android application on smartphone device. The VoiceXML Dialog Manager implementation (VoiceON) is described and proposed for speech enabled computer initiated dialogues. Senior citizens suffering from mild and moderate dementia are the primary target group of the proposed system. The human factors of the multi-mode interface will be tested in experiment with senior citizens, and different scenarios will be evaluated.

see all

ISBN: 978-1-5386-3296-3
ISBN Print: 978-1-5386-3297-0
Pages: 135 - 140
DOI: 10.1109/ICETA.2017.8102483
Host publication: 2017 15th International conference on emerging eLearning technologies and applications (ICETA)
Conference: IEEE international conference on emerging elearning technologies and applications
Type of Publication: A4 Article in conference proceedings
Field of Science: 213 Electronic, automation and communications engineering, electronics
Funding: The research presented in this paper was supported by Academy of Finland and Japan Science and Technology Agency (JST) in ASTS (Assisted Living for Senior Citizens) project and by the Ministry of Education, Science, Research and Sport of the Slovak Republic under the projects VEGA 1/0075/15 & KEGA 055TUKE-4/2016.
Copyright information: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.