跳到主要內容

臺灣博碩士論文加值系統

(34.204.180.223) 您好!臺灣時間:2021/08/05 16:33
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:李蒼昱
研究生(外文):Lee,Tsang-Yi
論文名稱:利用手勢辨識之互動式擴增實境技術於軍事用途之應用
論文名稱(外文):Applying the Hand Gesture Recognition Approach to Control Virtual Objects of Augmented Reality for Military Applications
指導教授:王順吉王順吉引用關係
指導教授(外文):Wang,Shuenn-Jyi
口試委員:賈叢林黃俊堯王順吉賴義鵬陳丙堃
口試委員(外文):Chia,Tsorng-LinHuang,Jiung-YaoWang,Shuenn-JyiLai,Yi-PongChen,Ping-Kun
口試日期:2012-05-15
學位類別:碩士
校院名稱:國防大學理工學院
系所名稱:資訊工程碩士班
學門:工程學門
學類:電資工程學類
論文種類:學術論文
論文出版年:2012
畢業學年度:100
語文別:中文
論文頁數:83
中文關鍵詞:擴增實境手勢辨識動態手勢
外文關鍵詞:Augmented RealityHand Gesture RecognitionDynamic Gesture
相關次數:
  • 被引用被引用:8
  • 點閱點閱:1016
  • 評分評分:
  • 下載下載:297
  • 收藏至我的研究室書目清單書目收藏:1
擴增實境技術透過追蹤及定位技術,在真實視訊影像中混合虛擬物件,可針對不同的應用設計不同事件腳本使其呈現更加生動。但若能結合互動功能,構建出互動式擴增實境,則能讓使用者與虛擬物件互動,更有身歷其境的感受。
目前互動式擴增實境技術常使用特定的標記符號作為虛擬物件與人們互動觸發條件,但標記易受遮蔽影響,而降低其操控性;或是輔以特殊設備或裝置來加強其互動性,但使用不普及。本文提出基於視覺之動態手勢辨識技術,不需要特殊硬體的輔助,並結合既有擴增實境技術,可輕易且方便操控虛擬物件。本文方法分為手勢辨識與擴增實境呈現兩部份;手勢辨識部份,首先擷取手部區域,接著擷取指尖位置、手指支數、手勢方向等特徵值,以辨識靜態手勢。最後結合狀態資訊及手勢變動資訊,辨識出移動、旋轉以及放大縮小等動態手勢變動資訊,將此變動資訊傳給擴增實境模組,藉以控制三維虛擬物件。研究成果能應用在兵棋操控,改善現今電腦兵棋系統需手動輸入繁複位置參數之缺點。可藉由動態手勢方便地移動、旋轉及縮放三維物件,進而下達作戰命令。或利用手部指令即時命令受控單位實施後勤整補、實施攻擊等,增加兵棋系統控制便利性及互動性。亦可應用在國軍高危險性作業機械手臂遠端控制,如彈藥庫彈整所未爆彈處理之機械手臂操作,可降低人員作業危安。經由實驗驗證本文所提之方法能即時且正確的辨識手勢變化,直接操控擴增實境之三維虛擬物件。

The technique of augmented reality (AR) is to augment virtual objects into real images. To promote further applications, the interactions between a user and virtual objects are needed. Individual can interact with virtual objects using markers or data gloves for specific applications. However, if users want to select, translate, rotate, or scale virtual objects, using markers are not immediate perception, and using data gloves are costly and unpopular. In this thesis, we proposed a vision-based hand gesture recognition scheme to control 2D-3D virtual objects of AR easily, instinctively, and popularly. The proposed method consists of two major parts: the hand gesture recognition, and the AR presentation. In the hand gesture recognition, first, the hand region is extracted. Second, the features of hands such as the positions of finger points, the numbers of fingers, and the hand orientation are computed to recognize static hand gestures. Then, we integrate the state information and moving information of hands to calculate the dynamic hand variations such as the data of position, rotation, and scaling. Finally, these information can be transferred to the AR presentation modular to control the virtual objects. In the AR presentation modular, the 2D data are converted to 3D coordinates, and the changed virtual objects are rendered correctly. The experimental results show that the proposed approach can recognize dynamic hand gesture correctly and control the virtual objects in AR instinctively and in real time. Furthermore, the proposed scheme can be used in military applications such as moving symbols in war game system, hand command training for squad actions, or remote controlling mechanical arms for bomb disposal.
目錄
誌謝 ii
摘要 iii
ABSTRACT iv
目錄 v
表目錄 vii
圖目錄 viii
1. 緒論 1
1.1. 研究背景與動機 1
1.2. 研究目的 3
1.3. 研究架構 4
2. 文獻探討 5
2.1. 互動式擴增實境介紹 5
2.1.1. 標記之互動式擴增實境 6
2.1.2. 特殊硬體之互動式擴增實境 8
2.1.3. 小結 9
2.2. 手勢辨識相關技術分析 9
2.2.1. 利用輔助設備之手勢辨識相關研究 10
2.2.2. 利用視覺技術之手勢辨識相關研究 12
2.2.3. 手勢資訊分析 19
2.2.4. 手勢辨識關鍵技術 20
2.3. 三維電腦繪圖基礎概念介紹 22
2.3.1. 座標系統 22
2.3.2. 三度空間轉換 25
3. 動態手勢控制擴增實境虛擬物件 27
3.1. 研究平台套件簡介 27
3.1.1. NyARToolkitCS簡介 27
3.1.2. EmguCV簡介 28
3.2. 環境描述及手勢定義 30
3.2.1. 系統架構 30
3.2.2. 手勢定義 31
3.3. 系統流程 37
3.3.1. 手勢辨識流程 37
3.3.2. 擴增實境區塊 50
4. 實驗結果與分析 58
4.1. 系統開發及測試環境 58
4.2. 系統效能測試 59
4.3. 手勢辨識相關分析與比較 60
4.4. 手勢辨識驗證 62
4.5. 系統展示 72
5. 結論與未來研究方向 75
5.1. 結論 75
5.2. 未來研究方向 75
參考文獻 76
自傳 81


[1] Malassiotis, S.,and Strintzis, M.G. ,Real-time hand posture recognition using range data, Image and Vision Computing, Vol. 26 ,pp.1027–1037,2008.
[2]Chen, Qing, Georganas, Nicolas D., and Petriu, Emil M., Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar, Image and Vision Computing, Vol. 26,pp. 1607–1620,2008.
[3]Juan, Manuel Ramirez-Cortes, Pilar, Gomez-Gil, Gabriel, Sanchez-Perez, and Cesar Prieto-Castro, Shape-based hand recognition approach using the morphological pattern spectrum ,Journal of Electronic Imaging, Vol. 18, No. 1, pp.013012-1-013012-6 ,2009.
[4] Yang, S.S. ,Ge, Y., and Lee, T.H.,Hand gesture recognition and tracking based on distributed locally linear embedding,Image and Vision Computing, Vol. 26, pp.1607–1620,2008.
[5] Kelly, Daniel, McDonald, John, and Markham, Charles,A person independent system for recognition of hand postures used in sign language,Pattern Recognition Letters, Vol.3,pp.11359–1368,2010.
[6] Suk, Heung-Il, Sin, Bong-Kee, and Lee, Seong-Whan,Hand gesture recognition based on dynamic Bayesian network framework,Pattern Recognition , Vol.43 pp.3059–3072,2010.
[7] Cheng,Shinko Y., and Trivedi, Mohan M.,Vision-Based Infotainment User Determination by Hand Recognition for Driver Assistance, IEEE Transactions on Intelligent Transportation Systems, Vol. 11, No. 3, pp.759 - 764,September 2010.
[8] Huang, Deng-Yuan, Hu, Wu-Chih, and Chang, Sung-Hsiang,“Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination”,Expert Systems with Applications , Vol.38, pp.6031–6042,2011.
[9] Hsu, 5Rein-Lien, Mohamed, Abdel-Mottaleb, and Anil, K. Jain, Face detection in color images, on Pattern Analysis and Machine Intelligence,Vol. 24, No. 5,pp.696-706,2002.
[10]Alexey, K., and Leonid, M.,Hand Gesture Recognition through On-Line Skeletonization, VISAPP 2011-International Conference on Computer Vision Theory and Applications ,pp. 555-559,2010.
[11]McDonald, C., Malik S., and Roth, G., Hand-Based Interaction in Augmented Reality, Haptic Virtual Environments and Their Applications, IEEE International Workshop 2002 HAVE,pp.55-59,2002.
[12]Lee, J. Y., Gue W. R., and Seo, D. W., Hand gesture-based tangible interactions for manipulating virtual objects in a mixed reality environment,”Int J Adv Manuf Technol,Vol. 51,pp.1069–1082 ,2010.
[13]Ionescu, B., Coquin D., Lambert, P., and Buzuloiu V., Dynamic Hand Gesture Recognition Using the Skeleton of the Hand,EURASIP Journal on Applied Signal Processing,Vol. 13, pp.2101–2109,2005.
[14] Wachs, J. P., Stern, H., Edan, Y., Cluster Labeling and Parameter Estimation for the Automated Setup of a Hand-Gesture Recognition System, IEEE transactions on systems, man, and cybernetics—part a: systems and humans, vol. 35, no. 6,pp.932-943, November 2005.
[15]Yin, X., and Xie, M.,Finger identification and hand posture recognition for human–robot interaction, Image and Vision Computing , no. 6, pp.1291–1300 ,2007.
[16]Just, A., and Marcel, S.,A comparative study of two state-of-the-art sequence processing techniques for hand gesture recognition, Computer Vision and Image Understanding ,Vol. 113, 532–543,2009.
[17]Zhang, X., Chen, X., Li, Y., Lantz V., Wang K.,and Yang J., A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors ,IEEE transactions on systems, man, and cybernetics—part a: systems and humans, vol. 41, no. 6,pp.1064-1067,2011.
[18]Milgram, P., Haruo, T., Utsumi, A., and Kishino, F., Augmented reality:A class of display on the reality-virtuality continuum, Telemanipulator and Telepresence Technologies, SPIE Vol. 2351, pp. 282-292, 1994.
[19]Kato, H., and Billinghurst, M., Marker Tracking and HMD Calibration for a video-based Augmented Reality Conferencing System, in IWAR ’99: Proceedings of the 2nd, IEEE and ACM International Workshop on Augmented Reality, pp. 85-94, 1999.
[20]Bimber, O., and Ramesh, R., “Spatial Augmented Reality Merging Real and Virtual Worlds, Wellesley”, assachusetts, U.S.A ,A K Peters, Ltd ,Chap.1, pp. 1-7, 2005
[21]Nilsen, T., and Looser, J., Tankwar Tabletop war gaming in augmented reality, In Proceedings of 2nd International Workshop on Pervasive Gaming Applications, 2005.
[22]Henderson, S.,and Feiner, S., Evaluating the Benefits of Augmented Reality for Task Localization in Maintenance of an Armored Personnel Carrier Turret, Proceeding of IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09), pp. 135-144, October 2009.
[23] Billinghurst, M., Kato, H., and Poupyrev, I., The MagicBook: A Transitional AR Interface,Computers & Graphics, Vol. 25, Issue 5, pp. 745-753, 2001.
[24]Huang, C. R., “The Vision-base Interaction on Augmented Exhibition Environments,” Ph.D. Dissertation, Department of Electrical Engineering, National Cheng Kung University Tainan, Taiwan, R.O.C., June, 2005.
[25]Shreiner, D.,and The Khronos OpenGL ARB Working Group, “OpenGL Programming Guide,” Addison-Wesley Professional, USA, 2009.
[26] McAndrew, A., Wang Jung-Hua, and Tseng Chun-Shun: “Introduction to Digital Image Processing with MATLAB Asia Edition,”CENGAGE,USA, 2010。
[27] Cormen, T. H.;Leiserson C. E., and Ronald L. Rivest, Clifford. Stein "33.3: Finding the convex hull". Introduction to Algorithms (2nd ed.). MIT Press and McGraw-Hill.pp. 949–955,2001.
[28]徐明亮,盧紅星,王琬,”OpenGL遊戲編程”,機械工業出版社,中國,第7-22頁,2008。
[29]張峰銘,“電腦繪圖”,松崗電腦圖書資料股份有限公司,台灣,第10-1~11-18頁,1995。
[30]陳昱廷,”從做中學C#遊戲程式設計”,上奇科技出版事業處,台灣,第7-1~7-53頁,2006。
[31]賴岱佑著,數位影像分析之智慧型監視系統,文魁資訊股份有限公司,台灣,第3.7-13,2008。
[32] 李傑,郝曉莉”一種基於橢圓膚色模型的人臉檢測方法”,計算機量測與控制第14卷,第2期,第170-182頁,2006。
[33] ARToolket Maker, http://roarmot.co.nz/ar/。
[34] ARToolket Support Library, http://www.artoolworks.com/support/library/
Creating_and_training_new_ARToolKit_markers
[35] ARToolket,http://www.hitl.washington.edu/ARToolKit/
[36] EmguCV, http://www.emgu.com/wiki/index.php/Main_Page
[37] NVIDIA CUDA™, http://www.nvidia.com.tw/object/cuda_home_new_tw.html
[38] NyARToolkit, http://nyatla.jp/NyARToolkit/wiki/index.php?NyARToolkitCS.en
[39] Windows Mobile SDK, http://www.microsoft.com/download/en/details.aspx
[40] Kinect for Windows, http://www.kinectforwindows.org/download/
[41] Nintendo, http://www.nintendo.tw/wiisportsresort/
[42] Sony EyePet, http://www.eyepet.com
[43] 好神通, http://hipage.hinet.net/event/888/01/index.htm
[44] FIND, http://www.find.org.tw/eng/home.asp
[45] D'Fusion, http://www.t-immersion.com
[46] U.S.ARMY,http://www.goarmy.com/home/augmented-reality-game-race-for
-strength.html
[47]Alex's Tech Blog,http://www.avk.name/
[48]Emgu CV Hand Gestures Recognition Advanced Tutorial,http://db.tt/GkT6J9k, http://blogs.ugidotnet.org/wetblog/Default.aspx
[49]360Doc個人圖書館,http://www.360doc.com/content/10/1120/21/
542436_71013672.shtml
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top