臺灣博碩士論文加值系統

本論文中，我們提出一個新的人機介面，藉由攝影機拍攝手部動作，提出一套以電腦視覺為基礎的模擬滑鼠動作系統。從攝影機擷取的影像中，利用移動物體偵測法，搭配陰影偵測與膚色偵測，擷取出完整的手部區域進行動作分析，我們利用核密度估計演算法 (Kernel Density Estimation, KDE) 及許多手部輪廓上的特徵，判斷手部動作所模擬的滑鼠指令。此外，增加滑鼠手勢辨識的功能，利用一套基於隱藏式馬可夫模型 (Hidden Markov model, HMM) 的手勢辨識系統，判斷4種滑鼠手勢。

This thesis presents a novel vision-based human-computer interaction system. We use webcam to capture hand gesture pictures and simulate mouse manipulation. The system employs moving object detection, shadow detection, and skin color detection to obtain the hand region from captured images. Kernel density estimation (KDE) and many features on hand contour are used to recognize the mouse manipulation based on hand gestures. Additionally, the system also includes the mouse gesture recognition. It is able to recognize four kinds of mouse gestures by a mouse gesture recognition system based on hidden Markov model (HMM.)

目 錄
書頁名 i
審定書 ii
中文摘要 iv
英文摘要 v
誌 謝 vi
目 錄 vii
表 目 錄 xi
圖 目 錄 xii
第一章、 序論 1
1.1 研究背景 1
1.2 研究目標 1
1.3 論文貢獻 2
1.4 論文架構 2
第二章、 文獻探討 3
2.1 以電腦視覺為基礎的手勢辨識之相關研究 3
2.2 系統內部運用之相關技術 3
第三章、 滑鼠動作模擬 7
3.1 滑鼠動作設定 8
3.2 手部區域偵測 10
3.2.1 核密度估計法為基礎的背景相減法 11
3.2.2 陰影區域與膚色區域偵測 13
3.3 滑鼠指令判斷 14
3.3.1 指尖點、指縫點與長軸參考點的偵測 16
3.3.2 游標移動偵測 17
3.3.3 左鍵及右鍵點擊偵測 17
3.3.4 左鍵及右鍵拖曳偵測 25
3.3.5 滾輪指令偵測 26
第四章、 滑鼠手勢辨識 31
4.1 軌跡前處理 32
4.2 特徵擷取 34
4.3 量化編碼 35
4.4 手寫軌跡辨識 36
4.4.1 隱藏式馬可夫模型 36
4.4.2 軌跡辨識系統 41
第五章、 實驗結果 42
5.1 實驗環境 42
5.2 滑鼠動作模擬系統之實驗 43
5.2.1 相關參數設定 43
5.2.2 實驗方法與結果 44
5.3 滑鼠手勢辨識之實驗 48
5.3.1 符號軌跡資料庫 48
5.3.2 實驗方法與結果 49
第六章、 結論與未來展望 50
參考文獻 51

[1]BYONG K. KO and HYUN S. YANG, “Finger Mouse and Gesture Recognition System as a new Human Computer Interface”, Computers and Graphics, vol. 21, no. 5, pp. 555-561, 1997.
[2]L.K. Lee, S. Kim, Y.-K. and M.H. Lee, “Recognition of hand gesture to human-computer interaction,” Proc. 26th Annual Conf. IEEE Industrial Electronics Society (IECON 2000), vol. 3, pp. 2117-2122, 2000.
[3]A. Leonardis and H. Bischof. “Dealing with occlusions in the eigenspace approach,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 453-458, 1996.
[4]L. Bretzner, I. Laptev, and T. Lindeberg, “Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering,” Proc. of the 5th IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 405-410, 2002.
[5]Zhi-Wei Chen, Yu-Cheng Lin, and Cheng-Chin Chiang, “Design and implementation of a vision-based fingertip writing interface,” Proceedings - International Conference on Pattern Recognition, vol. 2, art. no. 1699158, pp. 104-107, 2006.
[6]S. Fejes and L.S. Davis, “Detection of independent motion using directional motion estimation,” Computer Vision and Image Understanding, vol.74, no. 2, pp. 101-120, 1999.
[7]S. Fejes and L.S. Davis, “What can projections of flow fields tell us about the visual motion,” Proceedings of the IEEE International Conference on Computer Vision, pp.979-986, 1998.
[8]S. Fejes and L.S. Davis, “Exploring visual motion using projections of flow fields,” Proc. of the DARPA Image Understanding Workshop, 1997.
[9]L. Wixson and M. Hansen, “Detecting salient motion by accumulating directional-consistent flow,” Proceedings of the IEEE International Conference on Computer Vision, vol. 2, pp. 797-804, 1999.
[10]N. Paragios and R. Deriche, “Geodesic active contours and level sets for the detection and tracking of moving objects,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 3, pp. 266–280, 2000.
[11]M. Piccardi, “Background subtraction techniques: a review,” Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3099–3104, 2004.
[12]C. Wren, A. Azarhayejani, T. Darrell, and A.P. Pentland, “Pfinder: real-time tracking of the human body,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, 1997.
[13]D. Koller, J. Weber, T. Huang, J. Ma14 G. Ogasawara, B. Rao, and S. Russell, “Towards Robust Automatic Traffic Scene Analysis in Real-time”, Proceedings of the IEEE Conference on Decision and Control, pp. 3776-3781, 1994.
[14]B.P.L. Lo and S.A. Velastin, “Automatic congestion detection system for underground platforms,” Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing, pp. 158-161, 2001.
[15]R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, ghosts, and shadows in video streams,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1337-1442, 2003.
[16]A. Elgammal, D. Hanvood, and L.S. Davis, “Non-parametric model for background subtraction,” Proceedings of the European Conference on Computer Vision, pp. 751-767, 2000.
[17]I. Haritaoglu, D. Harwood, and L. Davis, “W4: real-time surveillance of people and their activities,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809–830, 2000.
[18]Kyungnam Kim, Thanarat H. Chalidabhongse, David Harwood, and Larry Davis, “Real-time foreground–background segmentation using codebook model,” Real-Time Image, vol. 11, no. 3, pp. 172-185, 2005.
[19]Kyungnam Kim, Thanarat H. Chalidabhongse, David Harwood, and Larry Davis, “Background modeling and subtraction by codebook construction,” Proceedings - International Conference on Image Processing, pp. 3061-6064, 2004.
[20]Alireza Tavakkoli, Mircea Nicolescu, George Bebis, and Monica Nicolescu, “Non-parametric statistical background modeling for efficient foreground region detection,” Machine Vision and Applications, vol. 20, no. 6, pp. 395-409, 2009.
[21]C. Stauffer, Grimson, and W.E.L., “Adaptive background mixture models for real-time tracking,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 246-252, 1999.
[22]Dar-Shyang Lee, “Effective Gaussian mixture learning for video background subtraction,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 827-832, 2005.
[23]Q.Z. Wu, B.S. Jeng, “Background subtraction based on logarithmic intensities,” Pattern Recognition Letters, vol. 23, no. 13, pp. 1529–1536, 2002.
[24]Q.Z. Wu, H.Y. Cheng, and B.S. Jeng, “Motion detection via change-point detection for cumulative histograms of ratio images,” Pattern Recognition Letters, vol. 26, no. 5, pp. 555–563, 2005.
[25]P. Spagnolo, T.D Orazio, M. Leo, and A. Distante, “Moving object segmentation by background subtraction and temporal analysis,” Image and Vision Computing, vol. 24, no. 5, pp. 411-423, 2006.
[26]Jianying Hu, Michael K. Brown, and William Turin, “Hmm based on-line handwriting recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 1039–1045, 1996.
[27]WONGYU CHO, SEONG-WHAN LEE, and JIN H. KIM, “Modeling and Recognition of Cursive Words with Hidden Markov Models,” Pattern Recognition, vol. 28, no. 12, pp. 1941–1953, 1995.
[28]Daiki Okumur, Seiichi Uchida, and Hiroaki Sakoe, “An HMM Implementation for On-line Handwriting Recognition - Based on Pen-Coordinate Feature and Pen-Direction Feature,” Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, art. no. 1575504, pp. 26-30, 2005.
[29]J.A. Vlontzos and S. Y. Kung, “Hidden Markov models for character recognition,” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing – Proceedings, pp. 1719-1722, 1989.
[30]Brijesh Verma, Jenny Lu, Moumita Ghosh, and Ranadhir Ghosh “A Feature Extraction Technique for On-line Handwriting Recognition,” IEEE International Conference on Neural Networks - Conference Proceedings, pp. 1337–1341, 2004.
[31]Chen-Chiung Hsieh, Ming-Ren Tsai, and Mu-Chun Su, “A Fingertip Extraction Method and Its Application to Handwritten Alphanumeric Characters Recognition,” IEEE, Int. Conf. Signal Image Technology and Internet Based Systems, pp. 293-300, 2008.
[32]http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/AV0405/MISHRA/kde.html
[33]R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting Moving Objects, Ghosts and Shadows in Video Streams,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1337-1342, 2003.
[34]P. Kakumanu, S. Makrogiannis, and N. Bourbakis, “A Survey of Skin-color Modeling and Detection Methods,” Pattern Recognition, vol. 40, pp. 1106-1122, 2007.
[35]Yang Zhang, Guangshun Shi, and Jufeng Yang, “HMM-based online recognition of handwritten chemical symbols,” Proceedings of the International Conference on Document Analysis and Recognition, ICDAR , art. no. 5277669, pp. 1255-1259, 2009.
[36]J. Hu, S.G. Lim and M.K. Brown, “Writer independent online handwriting recognition using an HMM approach,” Pattern Recognition, vol. 33, pp.133-147, 2000.
[37]V. Jagadeesh Babu, L. Prasanth, R. Raghunath Sharma,G.V. Prabhakara Rao, and Bharath A, “HMM-based online handwriting recognition system for Telugu symbols,” Proceedings of the International Conference on Document Analysis and Recognition, ICDAR 1, art. no. 4378676, pp. 63-67, 2007.
[38]M.K. Pakhira, S. Bandyopedhyay, and U. Maulik, “Validity index for crisp and fuzzy clusters,” Pattern Recognition, vol. 37, no. 3, pp. 487–501, 2004.
[39]L.R. Rabiner, “A tutorial on hidden Markov models and selected applications in speech recognition,” Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.