跳到主要內容

臺灣博碩士論文加值系統

(216.73.216.108) 您好!臺灣時間:2025/09/02 12:20
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:高樹賢
研究生(外文):SHU-HSIEN KAO
論文名稱:支援直覺式動作與語音指令之3D虛擬導覽系統
論文名稱(外文):An Intuitional 3D Virtual Navigation System Supporting Motion and Voice Commands
指導教授:王慶生王慶生引用關係
指導教授(外文):Ching-Sheng Wang
學位類別:碩士
校院名稱:真理大學
系所名稱:數理科學研究所
學門:數學及統計學門
學類:其他數學及統計學類
論文種類:學術論文
論文出版年:2008
畢業學年度:96
語文別:中文
論文頁數:6
中文關鍵詞:直覺式動作語音虛擬導覽WiiRemote
外文關鍵詞:Virtual navigationmotionvoiceWiiRemote
相關次數:
  • 被引用被引用:5
  • 點閱點閱:346
  • 評分評分:
  • 下載下載:64
  • 收藏至我的研究室書目清單書目收藏:1
近年來隨著影像表現技術與繪圖硬體的進步,使得虛擬實境系統的建立較過往容易實現。但綜觀目前常見之虛擬導覽系統,不是缺乏與使用者的直接互動,就是需要使用複雜的按鍵或指令介面,或是提供昂貴且不易維護的互動式設備如:感應手套、六軸滑鼠、人體動作捕捉系統等。本論文則使用常見且經濟的設備,設計出一套支援直覺式語音及動作指令的3D虛擬導覽系統。本論文使用WiiRemote補捉使用者的動作資訊,分析並轉換成為導覽指令如:行走、跑步、轉彎等,並結合語音指令,讓使用者能在不受羈絆的環境中,直覺且有效率的操作虛擬導覽系統。
In recent years following a steady progression of the image representation techniques and graphic hardware, it has afforded the development of a virtual navigation system to be more achievable than before. Yet to gauge from the common virtual navigation systems to date, they either lack a direct interaction with the user, or they require using complex GUI interface, or supplying expensive and difficult-to-maintain interactive equipment, such as a sensor glove, 6-way optical mouse, human motion capturing system and so forth. This paper has adopted the common and economic equipment to devise an intuitional 3D virtual navigation system supporting voice and motion commands. The proposed system adopts the WiiRemote to capture the use’s motion information, analyze and convert them into the navigation commands, such as walking, running, turning and the like, integrating also the voice commands, allowing the user to operate the virtual navigation system intuitively and effective in an unhindered environment.
1. 簡介 1
1.1 研究背景與動機 1
1.2 研究目的 2
1.3 章節安排 3
2. 相關研究 4
2.1 直覺式互動之硬體設備 4
2.2 直覺式互動之相關研究 9
3. 互動式虛擬導覽系統之建構 19
3.1 虛擬導覽系統之建構 19
3.2 直覺式互動設備之選擇 24
4. 系統架構與功能 26
4.1 系統架構 26
4.2 動作導覽指令 29
4.3 語音導覽指令 30
5. 系統建置與測試 33
5.1 系統建置 33
5.2 測試環境與結果 40
6. 結論與未來展望 42
REFERENCE: 43


圖目錄
圖1:VICON被動式捕捉攝影機. 5
圖2:主動式設備. 5
圖3:5DT DATA GLOVE. 6
圖4:SPACEMOUSE. 7
圖5:WIIREMOTE. 8
圖6:MOTION CAPTURE DATA MARKERS. 12
圖7:HAPTIC人機互動界面系統. 13
圖8:TRACKING (FRAME 30, 45, 60, 75). 14
圖9:PHYSICAL INTERACTION AND 3D CONTENT-BASED SEARCH系統示意圖. 15
圖10: AUTOMATIC SCALING OF THE WORLD WHEN THE USER GRABS AND RELEASES AN OBJECT. 16
圖11: PINCH GLOVES™. 16
圖12: TULIP MENUS. 17
圖13: "TWO - 4 - SIX" HANDHELD DEVICES. 17
圖14: BALLOON SELECTION IN ACTION. 18
圖15:真理大學虛擬校園場景一隅. 20
圖16: 牛津學堂內部場景. 21
圖17: 牛津學堂內部展示品. 21
圖18: 真理大學室外操場場景. 22
圖19: 真理大學校園建築場景. 22
圖20: 系統架構圖. 28
圖21: 視角計算示意圖. 29
圖 22:語音辨識流程圖. 31
圖 23:SAPI架構圖. 32
圖24: 系統建置示意圖. 33
圖25: 眼鏡+紅外線LED示意圖. 34
圖26: 校園測試場景圖. 35
圖27: 測試初始畫面. 35
圖28:僅以鍵盤滑鼠操控畫面. 36
圖29:僅以動作指令操控畫面. 36
圖30:以動作與語音導覽指令操控畫面. 37
圖31:真理大學數理與管理學院. 37
圖32:真理大學圖書館. 38
圖33:真理大學牛津學堂. 38
圖34:真理大學人文學院. 39
圖35:真理大學大教堂. 39
圖36:真理大學前門. 40

表目錄
表1: 虛擬實境建構方式之比較. 19
表2:虛擬實境操作方法之比較. 23
表3:導覽指令操作方式比較表. 41
[1] A. Kulik, R. Blach, & B. Frohlich, "two - 4 - six" - A Handheld Device for 3D-Presentations, IEEE Symposium on 3D User Interfaces (3DUI’06), Alexandria, Virginia, USA , 2006, 167-171.
[2] S. Jeong, W. Choi, N. Hashimoto, & M. Sato, Reactive Virtual Human System with haptic sensation and adaptive function, Proceedings of the 2005 International Conference on Cyberworlds (CW’05), Yokohama, Japan, 2005, 461-466.
[3] H. Benko, & S. Feiner, Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection, IEEE Symposium on 3D User Interfaces 2007 (3DUI’07), Charlotte, North Carolina, USA, 2007, 79-86.
[4] F. Seinicke, & K. Hinrichs, Grab-and-Throw Metaphor: Adapting Desktop-based Interaction Paradigms to Virtual Reality, IEEE Symposium on 3D User Interfaces 2006 (3DUI’06), Alexandria, Virginia, USA, 2006, 83-86.
[5] J. Cui, & Z. Sun, Visual Hand Motion Capture for Guiding A Dexterous Hand, Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition (FGR’04), Seoul, Korea, 2004, 729-734.
[6] K. Moustakas, M.G. Strintzis, D. Tzovaras, etc., Masterpiece: Physical Interaction and 3D Content-Based Search in VR Applications, 2006 IEEE Multimedia Magazine, 13(2), 2006, 92-100.
[7] MicroSoft SAPI:
http://www.microsoft.com/speech/download/sdk51
[8] IBM ViaVoice:
http://www-306.ibm.com/software/voice/viavoice/
[9] Toshiba LaLaVoice:
http://www3.toshiba.co.jp/pc/lalavoice/
[10] Jung-Tang Huang, Hsin-Sheng Chen and Ching-Kong Chen (2002), “Analysis and Comparison of Body Limb Motion by Costume Color Aided Image Processing”, 2002 Workshop on Consumer Electronics (WCE2002) Dec, Hsinchu, Taiwan.
[11] Mark C.K. Yang, Jong-Sen Lee, Fellow, IEEE,Cheng-Chang Lien, and Chung-Lin Huang “Hough Transform Modified by Line Connectivity and Line Thickness”, IEEE Transactions on Pattern Analysis and Machine Intelligence ,Volume 19 Issue 8 (August 1997, Pages: 905 – 910,Year of Publication: 1997 ,ISSN:0162-8828.
[12] A. Ude, "Robust estimation of human body kinematics from video", Proc. IEEE/RSJ Conf. Intelligent Robots and Systems, Kyongju, Korea, pp 1489-1494, October 1999.
[13] Chih-Yi Chiu, Shih-Pin Chao, Ming-Yang Wu, Shi-Nine Yang, and Hsin-Chih Lin “Content-Based Retrieval for Human Motion Data”, to appear on Journal of Visual Communication and Image Representation. pp. 605-612, Kinmen, Taiwan, R.O.C., Aug. 17-19, 2003.
[14] Wang. S. C. and Huang, C. L., "Structure Recovery and Motion Estimation from Stereo Motion," IEICE Trans. on Information and Systems, Vol. E77-D, No.11, , Nov. 1994 , pp.1247-1258.
[15] 林英裕“利用特徵值的轉換來提昇單字語音辨識之能力”, 私立逢甲大學電機工程系碩士論文, 2001.
[16] 劉大仁”序列資料比對演算法設計及其在內容導向語音檢索系統之製作”, 國立高雄第一科技大學電腦與通訊工程所碩士碩士論文, 2003.
[17] Christopher Einsmann, Meghan Quirk, Ben Muzal, Bharath Venkatramani, Thomas Martin, and Mark Jones,“Modeling a Wearable Full-body Motion Capture System”, Proceedings of the 2005 Ninth IEEE Internation Symposium on Wearable Computers (ISWC 05), 18-21 Oct. 2005 Page(s): 144 - 151.
[18] Mark R. Mine, Frederick P. Brooks Jr,University of North Carolina at Chapel Hill , Carlo H. Sequin , University of California at Berkeley , “Moving Objects In Space: Exploiting Proprioception In Virtual-Environment Interaction” , 1997 Proceedings of the 24th annual conference on Computer graphics and interactive techniques, Pages: 19 - 26.
[19] Doug A. Bowman and Chadwick A. Wingrave , “Design and Evaluation of Menu Systems for Immersive Virtual Environments” , Department of Computer Science (0106) Virginia Tech Blacksburg, VA 24061 USA , vr, p. 149, IEEE Virtual Reality Conference 2001 (VR 2001), p. 149.
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top