Research on virtual reality system design for body and psychological rehabilitation

doi:10.19682/j.cnki.1005-8885.2019.1028

中国邮电高校学报(英文) ›› 2019, Vol. 26 ›› Issue (6): 73-82.doi: 10.19682/j.cnki.1005-8885.2019.1028

• Artificial Intelligence • 上一篇下一篇

Research on virtual reality system design for body and psychological rehabilitation

Liu Tingting, Liu Zhen, Pang Qianchao, Ouyang Menglin, Chai Yanjie

1. College of Science and Technology, Ningbo University, Ningbo 315212, China
2. Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China
3. Zhejiang Fashion Institute of Technology, Ningbo 315211, China
4. The Affiliated Hospital of Medical School of Ningbo University, Ningbo 315000, China

收稿日期:2018-08-08 修回日期:2019-12-27 出版日期:2019-12-31 发布日期:2020-03-10
通讯作者: Liu Zhen, E-mail: liuzhen@nbu.edu.cn E-mail:liuzhen@nbu.edu.cn
作者简介:Liu Zhen, E-mail: liuzhen@nbu.edu.cn
基金资助:
This work was supported by the Ningbo Science and Technology Innovation 2025 Project (2019B10032), Ningbo Science, Technology Plan Projects (2019C50081, 2019C50024).

Research on virtual reality system design for body and psychological rehabilitation

Liu Tingting, Liu Zhen, Pang Qianchao, Ouyang Menglin, Chai Yanjie

1. College of Science and Technology, Ningbo University, Ningbo 315212, China
2. Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China
3. Zhejiang Fashion Institute of Technology, Ningbo 315211, China
4. The Affiliated Hospital of Medical School of Ningbo University, Ningbo 315000, China

Received:2018-08-08 Revised:2019-12-27 Online:2019-12-31 Published:2020-03-10
Contact: Liu Zhen, E-mail: liuzhen@nbu.edu.cn E-mail:liuzhen@nbu.edu.cn
About author:Liu Zhen, E-mail: liuzhen@nbu.edu.cn
Supported by:
This work was supported by the Ningbo Science and Technology Innovation 2025 Project (2019B10032), Ningbo Science, Technology Plan Projects (2019C50081, 2019C50024).

摘要/Abstract

摘要： There are many people in China who suffered from physical and mental diseases and need physical and psychological rehabilitation. Traditional treatments can work in rehabilitation, but will take much money and labor. In recent years, virtual reality (VR) technology has become a new direction to innovate rehabilitation. This paper summarizes the research results of VR technology in rehabilitation for stroke, anxiety, depression and autism. Based on these results, we propose a framework for VR rehabilitation system with virtual agents. A prototype system is developed to corroborate the proposed design guidelines. With the prototype rehabilitation system, autistic children can train their life skills in different scenarios. Preliminary test results show the proposed framework can push users to take the rehabilitation training actively and can be a new method for rehabilitation training.

关键词:

VR, intelligent virtual agent, rehabilitation, psychological

Abstract: There are many people in China who suffered from physical and mental diseases and need physical and psychological rehabilitation. Traditional treatments can work in rehabilitation, but will take much money and labor. In recent years, virtual reality (VR) technology has become a new direction to innovate rehabilitation. This paper summarizes the research results of VR technology in rehabilitation for stroke, anxiety, depression and autism. Based on these results, we propose a framework for VR rehabilitation system with virtual agents. A prototype system is developed to corroborate the proposed design guidelines. With the prototype rehabilitation system, autistic children can train their life skills in different scenarios. Preliminary test results show the proposed framework can push users to take the rehabilitation training actively and can be a new method for rehabilitation training.

Key words:

VR, intelligent virtual agent, rehabilitation, psychological

中图分类号:

TP391.9

Liu Tingting, Liu Zhen, Pang Qianchao, Ouyang Menglin, Chai Yanjie.

Research on virtual reality system design for body and psychological rehabilitation

[J]. The Journal of China Universities of Posts and Telecommunications, 2019, 26(6): 73-82.

参考文献

References
1. Vogiatzaki E, Krukowski A. Modern stroke rehabilitation through e-health-based entertainment. Springer International Publishing, 2015
2. Webster D, Celik O. Systematic review of Kinect applications in elderly care and stroke rehabilitation. Journal of Neuro Engineering and Rehabilitation, 2014, 11(1): 108p
3. Dhimana, Solanki D, Bhasin A, et al. An intelligent, adaptive, performance-sensitive, and virtual reality-based gaming platform for the upper limb. Comput Anim Virtual Worlds, 2018
4. Lupu R G, Botezatu N, Ungureanu F, et al. Virtual reality based stroke recovery for upper limbs using leap motion. Proceedings of the 20th International Conference on System Theory, Control and Computing, ICSTCC 2016. Institute of Electrical and Electronics Engineers Inc
5. Pei W, Xu G, Li M, et al. A motion rehabilitation self-training and evaluation system using Kinect. Proceedings of the 13th International Conference on Ubiquitous Robots and Ambient Intelligence, URAI 2016. Institute of Electrical and Electronics Engineers Inc
6. Simonsen D, Popovic M B, Spaich E G, et al. Design and test of a Microsoft Kinect-based system for delivering adaptive visual feedback to stroke patients during training of upper limb movement. Med Biol Eng Comput, 2017, 55(11): 1927 -1935
7. Xing L, Wang X, Wang J. A motion intention-based upper limb rehabilitation training system to stimulate motor nerve through virtual reality. Int J Adv Rob Syst, 2017, 14(6)
8. Cho S, Ku J, Cho Y K, et al. Development of virtual reality proprioceptive rehabilitation system for stroke patients. Comput Methods Programs Biomed, 2014, 113(1): 258 -265
9. Cho S, Kim W S, Paik N J, et al. Upper-limb function assessment using VBBTs for stroke patients. IEEE Comput Graphics Appl, 2016, 36(1): 70 -78
10. Rogers J M, Duckworth J, Middleton S, et al. Elements virtual rehabilitation improves motor, cognitive, and functional outcomes in adult stroke: evidence from a randomized controlled pilot study. Journal of Neuro Engineering and Rehabilitation, 2019, 16(1): 1 -13
11. Park M, Ko M, Oh S, et al. Effects of virtual reality-based planar motion exercises on upper extremity function, range of motion, and health-related quality of life: a multicenter, single-blinded, randomized, controlled pilot study. Journal of Neuro Engineering and Rehabilitation, 2019, 16(122): 1 -13
12. Mobini A, Behzadipour S, Saadat M. Test-retest reliability of Kinect's measurements for the evaluation of upper body recovery of stroke patients. Biomed Eng Online, 2015, 14(1)
13. Holmes D E, Charles D K, Morrow P J, et al. Using fitt's law to model arm motion tracked in 3D by a leap motion controller for virtual reality upper arm stroke rehabilitation. Proceedings of the 29th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2016. Institute of Electrical and Electronics Engineers Inc
14. Veras M, Kair Y D, Rogante M, et al. Scoping review of outcome measures used in telerehabilitation and virtual reality for post-stroke rehabilitation. J Telemed Telecare, 2017, 23(6): 567 -587
15. Guo X H, Wang J, Yang Y, et al. Active and passive training system of lower limb rehabilitation based on virtual reality. Journal of Xi'an Jiaotong University, 2016, 2(50): 124 -131
16. Verma S, Kumar D, Kumawat A, et al. A low-cost adaptive balance training platform for stroke patients: a usability study. IEEE Trans Neural Syst Rehabil Eng, 2017, 25(7): 935 -944
17. Wang X, Meng Z X, Qian Z, et al. Effects of enriched balance training on balance function in stroke patients with hemiplegia. Chinese Journal of Rehabilitation, 2016, 6(31): 438 -441
18. Adams R J, Lichter M D, Ellington A, et al. Virtual activities of daily living for recovery of upper extremity motor function. IEEE Trans Neural Syst Rehabil Eng, 2018, 26(1): 252 -260
19. Liang Y, Wu D, Ledesma D, et al. Virtual tai-chi system: a smart-connected modality for rehabilitation. Smart Health, 2018: 232 -249
20. Trombetta M, Bazzanello H P P, Brum M R, et al. Motion rehab AVE 3D: a VR-based exergame for post-stroke rehabilitation. Comput Methods Programs Biomed, 2017, 151: 15 -20
21. Baker S, Waycott J, Robertson E, et al. Evaluating the use of interactive virtual reality technology with older adults living in residential aged care. Information Processing and Management, 2019: 1 -13
22. Viaud-Delmon I. Adaptation as a sensorial profile in trait anxiety: a study with virtual reality. Journal of Anxiety Disorders (0887 -6185), 2000, 14(6): 583 -601
23. Jonsson P, Wallergard M, Osterberg K, et al. Cardiovascular and cortisol reactivity and habituation to a virtual reality version of the trier social stress test: a pilot study. Psychoneuroendocrinology (0306 -4530), 2010, 35: 1397 -1403
24. Kotlyar M, Donahue C, Thuras P, et al. Physiological response to a speech stressor presented in a virtual reality environment. Psychophysiology (0048 -5772), 2008, 45: 1034 -1037
25. Anderson P, Jacobs C, Rothbaum B O. Computer-supported cognitive behavioral treatment of anxiety disorders. Journal of Clinical Psychology (1097 -4679), 2004, 60(3): 253 -267
26. Wiederhold B K, Miller I T, Wiederhold M D. Using virtual reality to mobilize health care: mobile virtual reality technology for attenuation of anxiety and pain. IEEE Consumer Electronics Magazine, 2018, 7(1): 106 -109
27. Yahyaoui H, Menelas B A J. Towards the development of a serious game that targets psychological stressors of the workplace. In 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), 2017: 1 -6
28. Cai H, Wang Z, Zhang Y, et al. A virtual-reality based neurofeedback game framework for depression rehabilitation using pervasive three-electrode EEG collector. In 12th Chinese
Conference on Computer Supported Cooperative Work and Social Computing, Chinese CSCW 2017, 2017: 173 -176
29. Osman H A, Dong H, Saddik A E. Ubiquitous biofeedback serious game for stress management. IEEE Access, 2016(4): 1274 -1286
30. Fowler C A, Ballistrea L M, Mazzone K E, et al. A virtual reality intervention for fear of movement for veterans with chronic pain: protocol for a feasibility study. Pilot and Feasibility Studies, 2019, 5(1): 1 -10
31. Bernardini S, Porayska-Pomsta K, Smith T J. ECHOES: an intelligent serious game for fostering social communication in children with autism. Information Sciences, 2014, 264: 41 -60
32. Caria S, Paterno F, Santoro C, et al. The design of web games for helping young high-functioning autistics in learning how to manage money. Mobile Networks and Applications, 2018: 1 -14
33. Ip H H S, Wong S W L, Chan D F Y, et al. Enhance emotional and social adaptation skills for children with autism spectrum disorder: a virtual reality enabled approach. Computers and Education, 2018, 117: 1 -15
34. Kamaruzaman N N, Jomhari N. Digital game-based learning for low functioning autism children in learning Al-Quran. In Taibah University International Conference on Advances in Information Technology for the Holy Quran and Its Sciences, NOORIC 2013, 2015: 184 -189
35. Kamaruzaman N N, Jomhari N, Kamarulzaman N, et al. Engaging children with severe autism in learning Al-Quran through the serious game. Indian Journal of Science and Technology, 2016, 9(40)
36. Lu A, Chan S, Cai Y, et al. Learning through VR gaming with virtual pink dolphins for children with ASD. Interactive Learning Environments, 2017: 1 -12
37. Zhao H, Swanson A R, Weitlauf A S, et al. Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Transactions on Human-Machine Systems, 2018, 48(2): 136 -148
38. Didehbani N, Allen T, Kandalaft M, et al. Virtual reality social cognition training for children with high functioning autism. Computers in Human Behavior, 2016, 62: 703 -711
39. Gordon I, Pierce M D, Bartlett M S, et al. Training facial expression production in children on the autism spectrum. Journal of Autism and Developmental Disorders, 2014, 44(10): 2486 -2498
40. Kuriakose S, Lahiri U. Design of a physiology-sensitive VR-based social communication platform for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering: A Publication of the IEEE Engineering in Medicine and Biology Society, 2017, 25(8): 1180 -1191
41. Serret S, Hun S, Iakimova G, et al. Facing the challenge of teaching emotions to individuals with low-and high-functioning autism using a new serious game: a pilot study. Molecular Autism, 2014, 5(1)
42. Smith M J, Fleming M F, Wright M A, et al. Brief report: vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders, 2015, 45(10): 3364 -3369
43. Bozgeyikli L, Raij A, Katkoori S, et al. A survey on virtual reality for individuals with autism spectrum disorder: design considerations. IEEE Transactions on Learning Technologies,
2018, 11(2): 133 -151
44. Morales-Rodriguez M L, Pavard B. Design of an emotional and social interaction paradigm for the animation of 3D characters: the case of a therapy for brain injured people (the mirror neuron paradigm). Virtual Reality, 2007, 11(2 -3): 175 -184
45. Tidoni E, Abu-Alqumsan M, Leonardis D, et al. Local and remote cooperation with virtual and robotic agents: a P300 BCI study in healthy and people living with spinal cord injury. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2017, 25(9): 1622 -1632
46. Volante M, Babu S V, Chaturvedi H, et al. Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations. IEEE Transactions on Visualization and Computer Graphics, 2016, 22(4): 1326 -1335

[1]	李端张洪欣 Muhammad Saad Khan 米芳. Recognition of motor imagery tasks for BCI using CSP and chaotic PSO twin SVM[J]. 中国邮电高校学报(英文版), 2017, 24(3): 83-90.
[2]	白冰牛中奇牛毅魏兵赵钢. Fast division-free parallel structure for convolution perfectly matched layer in finite difference time domain method [J]. Acta Metallurgica Sinica(English letters), 2015, 22(1): 72-76.
[3]	张金玲. Construction of parallel and distributed static simulation system based on augmented reality[J]. Acta Metallurgica Sinica(English letters), 2012, 19(4): 117-121.

Research on virtual reality system design for body and psychological rehabilitation

Research on virtual reality system design for body and psychological rehabilitation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价