![Sample our Computer Science journals, sign in here to start your access, latest two full volumes FREE to you for 14 days]({"type":"image" , "src" : "/sda/5928/TOC-Subject-Sample-2021-Computer-Science.jpg"})
Abstract
Hand-held augmented reality (AR) offers accessible, interactive rehabilitation options for patients with upper limb motor deficits. Incorporating hand-involved interactions (e.g., tangible and mid-air interactions) into hand-held AR provides patients with intuitive manners to perform rehabilitation exercises mimicking real-world activities. Previous work has shown the importance of user experience and motor performance in rehabilitation systems, but little was known in the literature regarding the impact of hand-involved interactions in hand-held AR on user experience and motor performance in rehabilitation exercises. Hence, this study aims to evaluate user experience and motor performance when using three types of hand-involved interactions in hand-held AR rehabilitation: (1) tangible cube (i.e., a space-multiplexed tangible interaction with a physical cube acting as a real proxy to manipulate a virtual object in the same form); (2) tangible controller (i.e., a time-multiplexed tangible interaction with a physical controller applied to manipulate a virtual object); and (3) hand motion (i.e., a form of mid-air interaction to move a virtual object with hands). Based on the findings from self-report, electroencephalography (EEG), and performance measures, this study reveals the advantages of the tangible cube over the tangible controller, both superior to the hand motion in hand-held AR rehabilitation regarding user experience and motor performance. This study offers new understanding of the advantages and disadvantages of various interaction techniques in hand-held AR rehabilitation, emphasizing crucial design considerations for these systems, with a focus on user experience and motor performance in upper limb rehabilitation.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
Notes on contributors
Wenxin Sun
Wenxin Sun received his MSc degree in computer science from the Chinese University of Hong Kong in 2015. He is currently pursuing his PhD at the University of Liverpool. His research interest includes human–computer interaction and immersive experiences (virtual/augmented reality).
Mengjie Huang
Mengjie Huang is an Associate Professor in the Design School at Xi’an Jiaotong-Liverpool University, China. She received the PhD degree from National University of Singapore. Her research interests lie in human-computer interaction, with special focuses on human factors, user experience, and brain decoding.
Chenxin Wu
Chenxin Wu earned his BEng in Digital Media Technology from University of Liverpool. He is set to pursue a MSc at University College London. His research focuses on human-computer interaction and user experience within the realm of virtual/augmented reality.
Rui Yang
Rui Yang is an Associate Professor in the School of Advanced Technology at Xi’an Jiaotong-Liverpool University, China. He received the BEng degree in Computer Engineering and the PhD degree in Electrical and Computer Engineering from National University of Singapore. His research interests include intelligent control and optimization and human-machine interaction.
Yong Yue
Yong Yue is a Professor at the Department of Computing, and Director of the Virtual Engineering Centre at Xi’an Jiaotong-Liverpool University. He had held various positions in industry and academia in China and the UK. His current research interests include virtual reality, computer vision, robot applications, and operations research.
Miaomiao Jiang
Miaomiao Jiang is a doctor in Kunshan Rehabilitation Hospital, the director of Department of Pediatric Rehabilitation. She specializes in pediatric rehabilitation, with extensive clinical experience in managing common diseases in children and profound expertise in researching and treating pediatric rehabilitation cases.