臺灣博碩士論文加值系統

本研究旨在探討合成化戰場中數位戰士之智慧型眼鏡(Smart Glasses)使用者介面架構與資訊呈現方式，並實現雛形系統。透過結合智慧型眼鏡配備之環感麥克風、GPS、陀螺儀、加速計與電子羅盤等感應器，蒐集士兵所處環境資訊與移動情況，即時傳送至指揮控制中心進行資料融合，以及在軍車輛載具周圍安裝鏡頭，將影像校正、拼接成為一環視攝影系統，並將拼接後影像傳送至戰情中心，提供車輛載具周遭環境畫面，或結合其他戰場情報，如敵方兵力部屬、碉堡配置、戰略載具分布、危險地區[8]或戰場地形與氣候情報，由電腦或指揮官分析戰勢，並做出最佳判斷與下達指令，再將有用資訊，如戰場情勢分布，目前任務等以文字、語音或圖形介面回傳至數位戰士，將必要資訊顯示於智慧型眼鏡上，使士兵能快速了解情報及做出正確反應。
為完成本研究目標，須了解眼鏡開發方法，和了解其所配備之感應器數值之意義，另外為因應車載人員之車載環視攝影，本研究也須了解如何透過多個攝影鏡頭，取得車輛四周之影像校正及拼接，並將數據與鏡頭畫面回傳並顯示於戰情中心，在完成雛型系統後，便將眼鏡感應器之數據分析為易讀之資訊，如顯示士兵頭部轉動之方位、3D顯示士兵頭部狀態及士兵行為分析，透過這些功能，指揮官就可直接了解士兵行為及狀態，而在戰情中心上方有一地圖顯示所有士兵之地理位置，透過每部Google Glass之GPS資訊及載入Google地圖之圖資，指揮官亦可加入敵軍或可疑位置，且此圖資也能回傳至Google Glass，供士兵了解附近之地理資訊，戰情中心也可回傳文字指令與語音對講，並將必要資訊顯示於智慧型眼鏡上，使士兵能快速了解情報及做出正確反應。

The prupose of this paper is to study how to design the information presentation and adaptive user interface of mobile augmented reality (MAR) glasses for the information-based warrior under synthetic battlefield environment. With the advancement of smart mobile devices and mobile network bandwidth, the applications of MAR-based services have gaining enormous attentions. However, due to the limitation of computing power and storage space of mobile smart devices, it can’t perform too complicated tasks, e.g., images recognition, behavior inference, and services computing, etc., to meet the requirement of the next generation of MAR, for example, utilizing image to recognize the surrounding environment and to position targets. With the increasing popularity of wireless broadband environment and the mature of cloud computing technologies, parts of complicated computation works that are originally executed on mobile device can then be shifted to the cloud server to produce service information and then transfer back to the mobile device. By this way, the computation requirement on mobile device is significantly reduced and, hence, further feasible to provide wider ranges of services. In order to enhance the applications and techniques of MAR, the project will focus on data searching techniques through cloud network and behavior perception technology of pervasive computing to filter out augmented and surrounding information of information-based warrior and further to affect user interface design of smart glasses. The augmented information of smart glasses display will correspond to the true intent of warrior, while not affecting the warrior to perform tasks in the real world.

論文審定書i
誌謝 iii
中文摘要 iv
英文摘要 v
第一章 簡介1
1.1 背景與目的1
1.2 智慧型穿戴裝置2
1.3 擴增實境3
1.4 環視攝影4
第二章 相關研究5
2.1 行動擴增實境5
2.2 Google Glass 智慧型眼鏡6
2.3 環視攝影系統8
第三章 研究方法8
3.1 整體架構8
3.2 智慧型眼鏡應用程式端10
3.3 車載環視攝影機拼接21
3.4 戰情中心建立22
第四章 實驗結果25
4.1 系統架構25
4.2 智慧型眼鏡端29
4.3 影像拼接功能30
第五章 結論36
第六章 參考文獻37

[1]Stuart Elder, and Alex Vakaloudis, "A Technical Evaluation of Devices for Smart GlassesApplications," Internet Technologies and Applications (ITA), pp. 98-103, 2015.
[2]Xiaozhe Wang, Shu Liu, Cao Qin, Jiaxing Yuan, and Mingxiu Lin, "Real-time localization and information acquisition system based on wireless communication," Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), pp.1293-1298, 2015.
[3]Phan Thanh Hoa, Thien Xuan Dinh, and Van Thanh Dau, "Design Study of Multidirectional Jet Flow for a Triple-Axis Fluidic Gyroscope," IEEE Sensors Journal, pp.4103-4113, 2015.
[4]Kebao Xu, Juncheng Wang, Xiaojun Ju, Ping Zhu, and Guangqing Chen, "Compensation for Heeling Error of MEMS Accelerator Sensor in Vehicle ABS," 2006 2nd IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications, pp1-5, 2006.
[5]Yeongyun Kim, Seung Gook Hwang, Sang-Yong Rhee, and Dong Hun Kim, "Implementation of a personal riding robot with a magnetic compass sensor using a smartphone interface," 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS), pp. 17-22, 2014.
[6]Carlos Ricolfe-Viala, Antonio-Jose Sanchez-Salmeron, and Angel Valera, "Efficient Lens Distortion Correction for Decoupling in Calibration of Wide Angle Lens Cameras," IEEE Sensors Journal, pp. 854-863, 2013.
[7]Hyung Il Koo, and Nam Ik Cho, " Feature-based image registration algorithm for image stitching applications on mobile devices," IEEE Transactions on Consumer Electronics, pp. 1303-1310, 2011.
[8]Liangyi Fan, Shanzhen Yi, Zhongyi Li, and Bo Yang "Research on Toxic Gas Diffusion Simulation in Urban Areas Based on GIS," 2009 International Conference on New Trends in Information and Service Science, pp.166-189, 2009.
[9]Hoang ChuDuc, Luong DuongTrong, Thuan NguyenDuc, and Duc TrinhQuang, " Mobile device based HRV analysis system," 2013 Fifth International Conference on Ubiquitous and Future Networks (ICUFN), pp. 446-449, 2013
[10]T. P. Caudell, and D. W. Mizell, "Augmented reality: an application of heads-up display technology to manual manufacturing processes," Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, pp.659-669, 1992.
[11]Zhen Wu, Guohua Feng, Hao Luo, and Xiaofeng Wu, "Development of a Visual Reality Headset and Its Applications in 3D Interactive Bike Race Games, " 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), pp. 445-448, 2015.
[12]Qi-ming Li, Yi-min Chen, De-yi Ma, Chen Huang, Sheng Xu, Ren-miao Lu, Yan Liu, and Xi-chen Wang, " Design and implementation of a Chinese character teaching system based on augmented reality interaction technology, "2011 IEEE International Conference on Computer Science and Automation Engineering, pp.322-326, 2011.
[13]Karlheinz Blankenbach, and Edward Buckley, "Perceptual Effects of Laser-Based HUDs, "Journal of Display Technology, pp. 194-197, 2012.
[14]Sung Lae Kim, Hae Jung Suk, Jeong Hwa Kang, Jun Mo Jung, and Teemu H. Laine, "Using Unity 3D to facilitate mobile augmented reality game development, "2014 IEEE World Forum on Internet of Things (WF-IoT), pp.21-26, 2014.
[15]Sungyoul Park, Dongwook Kim, and Kyongsu Yi, "Vehicle localization using an AVM camera for an automated urban driving," 2016 IEEE Intelligent Vehicles Symposium (IV), pp 817-876, 2016
[16]H. T. Ngo, and V. K. Asari, "A pipelined architecture for real-time correction of barrel distortion in wide-angle camera images," IEEE Transactions on Circuits and Systems for Video Technology, pp 436-444, 2005.
[17]Tung-Ying Lee, Tzu-Shan Chang, Chen-Hao Wei, Shang-Hong Lai, Kai-Che Liu, and Hurng-Sheng Wu “Automatic Distortion Correction of Endoscopic Images Captured With Wide-Angle Zoom Lens,” IEEE Transactions on Biomedical Engineering, pp 2603-2613, 2013
[18]Hajime Kawanishi, Yoshitaka Hara, Takashi Tsubouchi, and Akihisa Ohya, "Calibration of lens distortion for super-wide-angle stereo vision," 2015 IEEE International Conference on Automation Science and Engineering (CASE), pp 843-848, 2015
[19]Hongzhi Chen, Ning Xi, Bo Song, Liangliang Chen, Jianguo Zhao, King Wai Chiu Lai, and Ruiguo Yang, "Infrared Camera Using a Single Nano-Photodetector," IEEE Sensors Journal ( Volume: 13, Issue: 3, March 2013 ), 949 – 958.
[20]Bruno Sciolla, Philippe Delachartre, Lester Cowell, Thibaut Dambry, and Benoit Guibert. "Multigrid level-set segmentation of high-frequency 3D ultrasound images using the Hellinger distance," Image and Signal Processing and Analysis (ISPA), 2015 9th International Symposium on, 7-9 Sept. 2015.