臺灣博碩士論文加值系統

為了恢復病人的手臂功能，針對手臂復健的職能治療是必須進行的步驟。如果病人可以持續穩定與密集的進行職能治療的話，喪失的手臂運動功能也有很大機會能逐步恢復。進行職能治療的復健時，為了評估訓練成效，治療師需要在旁監督病人。此外，復健通常是重複的訓練。在復健過程中病人常常會覺得復健訓練很枯燥而無法專心。為了減輕治療師的工作負擔，同時增加病人進行復健的興趣，在本論文中，我們提出一種基於三維辨識圖案的擴增實境復健系統。本系統能夠在復健時紀錄訓練的成效，並且渲染具互動效果的擴增實境畫面以提高使用者使用本系統的興趣。為達此目的，我們將三個三維辨識圖案戴在病人的手臂上，用以評估病人手臂的運動。相較於傳統二維平面辨識圖案，三維辨識圖案包含更多的可供識別的平面，在部分平面被遮住時，系統仍然可以由拍攝到的辨識圖案中計算辨識圖案與相機相對的位置跟方向，使系統更加得可靠。為了吸引病人的注意力，提高病人的使用意願，系統將上臂、手肘、手之間的相關性，渲染一個連結模型在上臂上。在訓練時，病人需要拿起虛擬杯子，到指定目標處，而系統會記錄訓練時間、路徑，進而提供訓練時的數據，供治療師評估病人的運動功能與訓練成效。

The occupational therapy for arm rehabilitation aims to recover patient’s arm functionalities. If patients can perform steady and intense exercises, arm motor functionalities can be recovered. To assess the performance of exercises, a therapist needs to monitor the patients. In addition, the exercises are usually repetitive tasks. Patients usually feel that the exercises are boring and cannot concentrate on the exercises. To reduce the working burdens of the therapists and increase the patients’ interests during exercises, we propose a 3-D marker based augmented reality (AR) rehabilitation system, which can monitor the performance of exercises and render the interactive AR views for arm rehabilitation. To assess the motions of the patient’s arm, three 3-D markers are set on his arm. The 3-D markers contain more recognizable faces so that their poses with respect to the web camera can be computed under partial occlusions and make the system become more reliable. To attract the patient’s attention, an augmented reality view is rendered on the screen in front of the patient. The system renders a link model to show the correlations among the upper arm, the elbow, and the hand of the patient. The exercise asks the patient to put a virtual cup on the target environment marker shown in the AR view. During the exercise, the moving time and paths are recorded to assess his motor functionalities. As shown in the experiments, our system can perform well, and help patients and therapists to achieve the goal of the rehabilitation.

摘要 i
Abstract ii
Index iii
Table Index iv
Figure Index v
1. INTRODUCTION 1
2. RELATED WORK 4
2.1 AUGMENTED REALITY 4
2.2 STROKE REHABILITATION 5
2.3 AR BASED STROKE REHABILITATION 6
3. PRELIMINARY 7
3.1 THE CAMERA MODEL 7
3.2 ARTOOLKIT 8
4. 3-D MARKER BASED AUGMENTED REALITY SYSTEM 11
4.1 SYSTEM OVERVIEW 11
4.2 3-D MARKER DESIGN 12
4.3 EXERCISE COURSES 18
5. EXPERIMENTS 21
5.1 ASSESSMENT OF REHABILITATION EFFECT 25
6. CONCLUSION 28
7. REFERENCES 29

[1]Koichi Hiraoka,"Rehabilitation Effort to Improve Upper Extremity Function in Post-Stroke Patients: A Meta-Analysis," Journal of Physical Therapy Science, vol. 13, no. 1, pp. 5-9, Aug. 2001.
[2]Thielman GT, Dean CM, Gentile AM.,"Rehabilitation of reaching after stroke: task-related training versus progressive resistive exercise," US National Library of Medicine National Institutes of Health. Oct, 2004.
[3]Carolynn Patten, PhD, PT; Jan Lexell, MD, PhD; Heather E. Brown, MSPT,"Weakness and strength training in persons with poststroke hemiplegia:Rationale, method, and efficacy," Journal of Rehabilitation Research & Development. , vol. 41, no. 3A, pp. 293-312, May-June 2004.
[4]H. Kato, and M. Billinghurst,"Marker tracking and HMD calibration for a video-based augmented reality conferencing system," Proceedings of Augmented Reality, pp. 85-94, 1999.
[5]Henderson, S. Dept. of Comput. Sci., Columbia Univ., New York, NY, USA Feiner, S.,"Opportunistic Tangible User Interfaces for Augmented Reality," IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 1, pp. 4-6, Jan.-Feb. 2010.
[6]ARToolKit Home Page .https://www.hitl.washington.edu/artoolkit/.
[7]M. Billinghurst, H. Kato, and I. Poupyrev,"The MagicBook - Moving Seamlessly between Reality and Virtuality," IEEE Computer Graphics and Applications, vol. 21, no 3, pp. 6-8, 2001.
[8]M. Billinghurst, A. Cheok, H. Kato, and S. Prince,"Real World Teleconferencing," IEEE Computer Graphics and Applications, vol. 22, no 6, pp. 11-13, 2002.
[9]M. Billinghurst and H. Kato,"Collaborative Augmented Reality," Communications of the ACM, vol. 45, no. 7, pp. 64-70, 2002.
[10]De Crescenzio, F. Univ. of Bologna, Bologna, Italy Fantini, M. ; Persiani, F. ; Di Stefano, L. ; Azzari, P. ; Salti, S.,"Augmented Reality for Aircraft Maintenance Training and Operations Support," IEEE Computer Graphics and Applications, vol. 31, no. 1, pp. 96-101, Jan.-Feb. 2011.
[11]D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[12]H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
[13]T. Lee and T. Hollerer,"Multithreaded Hybrid Feature Tracking for Markerless Augmented Reality," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 3, pp. 355-368, May 2009.
[14]M. Maidi, M. Preda, and V. H. Le,"Markerless tracking for mobile augmented reality," IEEE International Conference on Signal and Image Porcessing Applications, 16-18, pp. 301-306, November 2011.
[15]L. E. Sucar, R. Luis, R. Leder, J. Hernández and I. Sánchez,"Gesture therapy: A vision-based system for upper extremity stroke rehabilitation, " Proc. 32nd Annu. Int.Conf. IEEE Eng. Med. Biol. Soc., pp. 3690-3693, 2010.
[16]M. Steinisch , M. G. Tana and S. Comani,"A post-stroke rehabilitationsystem integrating robotics, VR and high-resolution EEG imaging, " IEEE Trans. Neural Syst. Rehabil. Eng., vol. 21, no. 5, pp. 849-859, 2013.
[17]V.G. Popescu, G.C. Burdea M. Bouzit, V.R. Hentz,"A virtual-reality-based telerehabilitation system with force feedback," IEEE Trans. Information Technology in Biomedicine, volume 4, issue 1, page(s):45 - 51. March 2000.
[18]D. Jack , R. Boian , A. Merians , M. Tremaine , G. Burdea , S. Adamovich , M. Recce and H. Poizner,"Virtual reality-enhanced stroke rehabilitation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 9, no. 3, pp. 308-318, 2001.
[19]R. Boian , J. Deutsch , C. S. Lee , G. Burdea and J. Lewis,"Haptic effects for virtual reality-based post-stroke rehabilitation," Proc. 11th Symp. HAPTICS, pp. 247-253, 2003.
[20]K. Morrow, C. Docan and G. Burdea,"Low-cost virtual rehabilitation of the hand for patients post-stroke," Proc. Int. Workshop Virtual Rehabil. , pp. 6-10, 2006.
[21]I. Shakra, M. Orozco, A. El Saddik, S. Shirmohammadi, and E. Lemaire,"Haptic Instrumentation for Physical Rehabilitation of Stroke Patients," IEEE International Workshop on Medical Measurement and Applications Benevento, 2006.
[22]R. Kayyali , A. Alamri , M. Eid , R. Iglesias , S. Shirmohammadi and A. El Saddik,"Occupational therapists'' evaluation of haptic motor rehabilitation," Proc. 29th Annu. Int. Conf. IEEE EMBS, pp. 4763-4766, 2007.
[23]A. Gaggioli , A. Meneghini , M. Pigatto , I. Pozzato , G. Greggio , F. Morganti and G. Riva,"Computer-enhanced mental practice in upper-limb rehabilitation after cerebrovascular accident: A case series study," Proc. Virtual Rehabil., pp. 151-154, 2007.
[24]A. Alamri , R. Iglesias , M. Eid , A. El Saddik , S. Shirmohammadi and E. Lemaire,"Haptic exercises for measuring improvement of post-stroke rehabilitation patients," Proc. Int. Workshop Med. Meas. Appl., pp. 1-6, 2007.
[25]A. Alamri , M. Eid , R. Iglesias , S. Shirmohammadi and A. El Saddik,"Haptic virtual rehabilitation exercises for poststroke diagnosis," IEEE Trans. Instrumentation and Measurement., vol. 57, no. 9, pp. 1876-1883, 2008.
[26]A. Alamri , M. Eid and A. El Saddik,"A quality of performance model for evaluating post-stroke patients, " Proc. IEEE Int. Conf. CIMSA, pp. 14-18, 2008.
[27]R., Colombo, F., Pisano, S., Micera, A., Mazzone, C., Delconte, M., Carrozza, P., Dario, and G., Minuco,"Upper limb rehabilitation and evaluation of stroke patients using robot-aided techniques," proceeding of 9th International Conference on Rehabilitation Robotics, 2005.
[28]R. Colombo , F. Pisano , S. Micera , A. Mazzone , C. Delconte , M. C. Carrozza , P. Dario and G. Minuco,"Robotic techniques for upper limb evaluation and rehabilitation of stroke patients, neural systems and rehabilitation engineering," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 13, no. 3, pp. 311-324, 2005.
[29]J., Furusho, C., Li, Y., Yamaguchi, S., Kimura, K. Nakayama, T., Katuragi, T., Oguri, U., Ryu, S., Suzuki, and A., Inoue,"A 6-DOF rehabilitation machine for upper limbs including wrists using ER actuators," in proceedings of IEEE International Conference of Mechatronics and Automation, 2005.
[30]C. D. Takahashi , L. Der-Yeghiaian , V. H. Le and S. C. Cramer,"A robotic device for hand motor therapy after stroke, rehabilitation robotics," ICORR 9th Int. Conf., pp. 17-20, 2005.
[31]L. De Vito, O. Postolache and S. Rapuano,"Measurements and sensors for motion tracking in motor rehabilitation," IEEE Instrumentation and Measurement Magazine, vol. 17, pp. 30-38, 2014.
[32]Y. Choi,"Ubi-REHAB: An android-based portable Augmented Reality stroke rehabilitation system using the eGlove for multiple participants," in Virtual Rehabilitation International Conference on, pp. 1-2, 2011.
[33]A. Alamri, J. Cha, M. Eid, and A. El Saddik,"Evaluating the post-stroke patients progress using an Augmented Reality Rehabilitation system," in Proc. IEEE International Workshop on Medical Measurements and Applications, pp. 89-94, May 2009.
[34]A. Alamri, J. Cha, M. Eid, and A. El Saddik, A.;Coll. of Comput. & Inf. Sci., King Saud Univ., Riyadh, Saudi Arabia,"AR-REHAB: An Augmented Reality Framework for Poststroke-Patient Rehabilitation," IEEE Trans. Instrumentation and Measurement, vol. 59, no. 10, pp. 2554-2563, Sep. 2010.
[35]M. Khademi, H. M. Hondori, C. V. Lopes, L. Dodakian, and S. C. Cramer,"Haptic Augmented Reality to Monitor Human Arm''s Stiffness in Rehabilitation," in Proceedings of the IEEE EMBS Conference on Biomedical Engineering and Sciences, 2012.
[36]X. Luo , R. Kenyon , T. Kline , H. Waldinger and D. Kamper,"An augmented reality training environment for post-stroke finger extension rehabilitation," Proc. 9th ICORR, pp. 329-332, 2005.
[37]X. Luo , T. Kline , H. Fischer , K. Stubblefield , R. Kenyon and D. Kamper,"Integration of augmented reality and assistive devices for post-stroke hand opening rehabilitation," Proc. Conf. IEEE Eng. Med. Biol. Soc., pp. 6855-6858, 2005.
[38]A. G. D. Correa , G. A. de Assis , M. do Nascimento , I. Ficheman and R. de Deus Lopes,"Genvirtual: An augmented reality musical game for cognitive and motor rehabilitation," Proc. Virtual Rehabil., pp. 1-6, 2007.
[39]A. G. D. Correa, I. K. Ficheman, M. do Nascimento, and R. de Deus Lopes,"Computer Assisted Music Therapy: A Case Study of an Augmented Reality Musical System for Children with Cerebral Palsy Rehabilitation," in Ninth IEEE International Conference on Advanced Learning Technologies, pp. 218-220, 2009.
[40]NyARToolkit project.http://nyatla.jp/nyartoolkit/wp/.
[41]Unity - Game Engine https://unity3d.com/.
[42]C.-R. Huang, C.-S. Chen, and P.-C. Chung,"Tangible Photo-Realistic Virtual Museum," IEEE Computer Graphics and Applications, vol.25, no.1, pp.15-17, Jan.-Feb., 2005.