跳到主要內容

臺灣博碩士論文加值系統

(35.172.136.29) 您好!臺灣時間:2021/07/26 21:55
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:胡博景
研究生(外文):HU,BO-JING
論文名稱:應用混合實境與物聯網於虛實串流影像救災機器人之實作
論文名稱(外文):Applying Mixed Reality & Internet of Things to Implement Virtual and Live Streaming Disaster Relief Robot
指導教授:陳世智陳世智引用關係
指導教授(外文):CHEN, SHIH-CHIH
口試委員:歐陽昆黃文楨陳世智
口試委員(外文):OU,YANG-KUNHUANG,WEN-CHENCHEN, SHIH-CHIH
口試日期:2019-05-10
學位類別:碩士
校院名稱:國立高雄科技大學
系所名稱:資訊管理系
學門:電算機學門
學類:電算機一般學類
論文種類:學術論文
論文出版年:2019
畢業學年度:107
語文別:中文
論文頁數:83
中文關鍵詞:實境技術微控制器數據可視化沉浸式可視化框架遠端監視系統即時運算網路分層演算理論
外文關鍵詞:Reality TechnologyMicrocontrollerData VisualizationImmersive Visualization FrameworkRemote Monitoring SystemReal-time ComputingNetwork Layered Calculus Theory
相關次數:
  • 被引用被引用:0
  • 點閱點閱:138
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
現今全世界使用實境設備主流為締造娛樂遊戲方面上佔多數,亦或是跨境旅遊、購物等,未來混合實境MR (Mixed Reality ) 擁有的實境市場,具有相當發展潛在力和影響力。為實現災難環境之相關救援研究,而以MR結合設計,協同物聯網 IoT (Internet of Things) 的方式,及人工智慧AI (Artificial Intelligence) 的技術,基於火場之救援應用,並將MCU (Microcontroller) 核心打造的機器人,本研究是為了設計一個具遠端監控和探查搜救有無受災人物身險環境中為目的,更是又踏出一種新興的研究道路所在。IoT本身的框架,講究於微控制器的搭配與組裝,也就是電路的設計和傳感器運用,從單純硬體再度延伸到網絡連結的多樣性,關乎遠端各式操作物質、紀錄Source的便利性,再將AI辨識功能尋找受困火場人們,同時偵測起火源點,利於搜救與滅火。本研究以這三種領域為研究基礎,架構出MR模擬現實環境供應使用者新穎的眼界視角,IoT則解決了無線遠距操控網際網路的資源為橋梁,AI即時辨識火源和受困人員利於盡速搜救。最後,開發MCU核心設計械構,協作開發與製造的實體機器人,可讓代替人前往惡劣險著的區域,從而勘查需要受救的人們正處在何地。
Today, the world's mainstream use of real-world equipment is the majority of entertainment games, or cross-border tourism, shopping, etc., the real market of the future Mixed Reality MR (Mixed Reality) has considerable development potential and influence . In order to realize the relevant rescue research in the disaster environment, the MR combined design, the IoT (Internet of Things) method, and the artificial intelligence AI (Artificial Intelligence) technology, based on the fire rescue application, and the MCU (Microcontroller) The core of the robot, this study is to design a remote monitoring and exploration search and rescue for the purpose of the disaster-hit environment, but also to embark on an emerging research path. The framework of IoT itself is about the matching and assembly of microcontrollers, that is, the design of circuits and the application of sensors. From the simple hardware to the diversity of network connections, it is related to the convenience of various operating substances at the far end and the record source. Then, the AI identification function is used to find people trapped in the fire, and at the same time, the source of fire is detected, which is conducive to search and rescue and fire fighting. Based on these three fields, this study is based on the novel vision of MR users in the real-world environment. IoT solves the problem of wireless remote control of the Internet resources, and the AI instantly identifies the source of fire and trapped people. Search and rescue as soon as possible. Finally, the development of the MCU core design mechanism, the collaborative development and manufacture of physical robots, allows replacements to travel to harsh areas, and to explore where the people who need to be rescued are located.
摘要…………………………………………………………………….………………i
Abstract…………………………………………………………….………………….ii誌謝……………………………………………………………….…………………iv目錄…………………………………………………………………………………….v
圖目錄…………………………………...…………………...…..…………………..viii
表目錄…………………………………...…………………...…..…………………….x
壹、緒論…………………………………………………...…………………………....1
1.1 研究背景………………………………………………………………………1
1.2 研究動機………………………………………………………………………3
1.3 硬體協作技術…………………………………………...………………….....6
1.4 研究目的…………...……………………………………………………….....6
貳、文獻探討………….………………………………...……………………………8
2.1 研究探討………………………………………………………………………8
2.1.1 PC裝載介面………….…………………………...………………….8
2.1.2 獨立頭戴式配備………..…………………………...………………....8
2.1.3 支援視頻形式…………..…………………………...…………………9
2.1.4 實境發展 Reality Development.………………………………………9
2.1.5 虛擬實境 Virtual Reality.……………...…………...………………..10
2.1.6 混合實境Mixed Reality..…………………………...………………..11
2.2 研究領域……………………………………………………………………..12
2.2.1 教育學習….…………………………………………………………..12
2.2.2 商業行銷……………………………………………………………...12
2.2.3 不動產觀屋…………………………………………………………...14
2.2.4 醫療科技……………………………………………………………...15
2.2.5 服裝品牌……………………………………………………………...15
2.2.6 跨境旅行……………………………………………………………...15
2.2.7 全息環境……………………………………………………………...16
2.2.8 通訊交流……………………………………………………………...16
2.2.9 應用推廣……………………………………………………………...17
2.3 VRTK………………………………………………………………………….17
2.4 訊息序列遠端傳輸-MQTT……………………….………………………….18
2.5 無線媒介協定-WiFi Protocol ………………………………………………..20
2.6 監控攝像鏡頭-Camera…..……....……………….…...……………………..20
2.7 影像串流-Video Streaming….………………..….………………………….20
2.8 即時串流協定-RTSP…….….…………………….………………………….20
2.9 串列阜傳輸協定 - Serial Port...………………….………………………….21
2.10 常微分演算法 - ODE.………………………….………………………….21
2.11 文獻評論...…..…………………………….…….………………………….22
叁、研究方法…………………………………………...…………………………..26
3.1 本研究使用硬體設備需求.………………………………………………….26
3.2 本研究計畫所使用之技術…………………………………………………..27
3.3 Open VR…………………...………………………………………………….28
3.4運行標準規格……………………………………..………………………….31
3.5 Acer Windows Mixed Reality……………………….....……………………..36
3.6 應用層面………………………………………………………………...…...37
3.7空間掃描可視化……………………………………………………………...37
3.8 構建場景輸出數據....………………………………………………………..38
3.9 緩存與連續空間映射…………………………………………………...…...39
3.10 IoT實作控制流程..………………………………………………...….........42
3.11 無限媒介協定 - WiFi Protocol…..………….……………………………..43
3.12 監控攝像鏡頭 - Realsense…………….…………………………………...44
3.13 MCU Arduino & WiFi ESP8266….………………………………………....45
3.14 環境感測器-Sensor…………………………………………………………46
肆、實驗結果與討論………..………………………...…………………………..50
4.1實體架構成果…………………………………………………………….…..50
4.2成果展現過程…………………………………………………………….…..52
伍、總結和未來市場展望…….……………………...…………………………..54
5.1 結論…………………………………………………………………………..54
5.2 未來投入職業 & 實境趨勢探討…………………………………………...55
參考文獻.…………………………………………………………………………….56
附錄A - Mixed Reality Unity Code…………………..…………………………61
附錄B - IoT Arduino MCU Code………………………………………………..65

[1] Xuhui, Z., Runlin, D., & Yongwei, L. (2017, June). Vr-based remote control system for rescue detection robot in coal mine. In 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) (pp. 863-867). IEEE.
[2] Martins, J., Gonçalves, R., Branco, F., Barbosa, L., Melo, M., & Bessa, M. (2017). A multisensory virtual experience model for thematic tourism: A Port wine tourism application proposal. Journal of destination marketing & management, 6(2), 103-109.
[3] Farshid, M., Paschen, J., Eriksson, T., & Kietzmann, J. (2018). Go boldly!: Explore augmented reality (AR), virtual reality (VR), and mixed reality (MR) for business. Business Horizons, 61(5), 657-663.
[4] Manis, K. T., & Choi, D. (2018). The virtual reality hardware acceptance model (VR-HAM): Extending and individuating the technology acceptance model (TAM) for virtual reality hardware. Journal of Business Research.
[5] Hudson, S., Matson-Barkat, S., Pallamin, N., & Jegou, G. (2018). With or without you? Interaction and immersion in a virtual reality experience. Journal of Business Research.
[6] Teisl, M. F., Noblet, C. L., Corey, R. R., & Giudice, N. A. (2018). Seeing clearly in a virtual reality: Tourist reactions to an offshore wind project. Energy policy, 122, 601-611.
[7] Ibáñez, M. B., Di Serio, Á., Villarán, D., & Kloos, C. D. (2014). Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness. Computers & Education, 71, 1-13.
[8] Van Kerrebroeck, H., Brengman, M., & Willems, K. (2017). Escaping the crowd: An experimental study on the impact of a Virtual Reality experience in a shopping mall. Computers in Human Behavior, 77, 437-450.
[9] Shin, D. (2018). Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?. Computers in Human Behavior, 78, 64-73.
[10] Bozgeyikli, E., Raij, A., Katkoori, S., & Dubey, R. (2019). Locomotion in virtual reality for room scale tracked areas. International Journal of Human-Computer Studies, 122, 38-49.
[11] Mackenzie, K., Buckby, S., & Irvine, H. (2009). A framework for evaluating business lead users’ virtual reality innovations in Second Life. Electronic Commerce Research, 9(3), 183-202.
[12] Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008). Measuring and defining the experience of immersion in games. International journal of human-computer studies, 66(9), 641-661.
[13] Chen, C. Y., Shih, B. Y., & Yu, S. H. (2012). Disaster prevention and reduction for exploring teachers’ technology acceptance using a virtual reality system and partial least squares techniques. Natural hazards, 62(3), 1217-1231.
[14] Cheng, L. K., Chieng, M. H., & Chieng, W. H. (2014). Measuring virtual experience in a three-dimensional virtual reality interactive simulator environment: a structural equation modeling approach. Virtual Reality, 18(3), 173-188.
[15] Wang, R., Lu, H., Xiao, J., Li, Y., & Qiu, Q. (2018, August). The design of an augmented reality system for urban search and rescue. In 2018 IEEE International Conference on Intelligence and Safety for Robotics (ISR) (pp. 267-272). IEEE.
[16] Chari, K. S., Ranjan, R., Baig, M. N. A., & Naresh, A. (2017, July). Mobile controlled multipurpose rescue robot using DTMF technology. In 2017 International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT)(pp. 1284-1289). IEEE.
[17] Wang, P., Xiao, J., Lu, H., Zhang, H., Yan, R., & Hong, S. (2017, October). A novel human-robot interaction system based on 3D mapping and virtual reality. In 2017 Chinese Automation Congress (CAC) (pp. 5888-5894). IEEE.
[18] Maach, I., Azough, A., & Meknassi, M. (2018, April). Development of a use case for virtual reality to visit a historical monument. In 2018 International Conference on Intelligent Systems and Computer Vision (ISCV) (pp. 1-4). IEEE.
[19] Kruijff, E., & Riecke, B. E. (2018, April). Navigation interfaces for virtual reality and gaming: Theory and practice. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (p. C11). ACM.
[20] Lee, B. W., Shih, H. Y., Chou, Y. T., & Chen, Y. S. (2017, May). Educational Virtual Reality implementation on English for Tourism Purpose using knowledge-based engineering. In 2017 International Conference on Applied System Innovation (ICASI)(pp. 792-795). IEEE.
[21] Agüero, C. E., Koenig, N., Chen, I., Boyer, H., Peters, S., Hsu, J., ... & Krotkov, E. (2015). Inside the virtual robotics challenge: Simulating real-time robotic disaster response. IEEE Transactions on Automation Science and Engineering, 12(2), 494-506.
[22] Nielsen, C. W., Goodrich, M. A., & Ricks, R. W. (2007). Ecological interfaces for improving mobile robot teleoperation. IEEE Transactions on Robotics, 23(5), 927-941.
[23] Negrello, F., Settimi, A., Caporale, D., Lentini, G., Poggiani, M., Kanoulas, D., ... & Ermini, L. (2018). The WALK-MAN Robot in a Postearthquake Scenario. RAM, (99).
[24] Luoto, A., & Systä, K. (2018). Fighting network restrictions of request-response pattern with MQTT. IET Software, 12(5), 410-417.
[25] Egger, J., Gall, M., Wallner, J., Boechat, P., Hann, A., Li, X., ... & Schmalstieg, D. (2017). HTC Vive MeVisLab integration via OpenVR for medical applications. PloS one, 12(3), e0173972.
[26] Patra, S. K. (2018). Intersubjectivity World of Virtual Reality: Facebook Users Behaviour in the Context of Privacy, Self and Identity. Media Watch, 9(2), 182-193.
[27] Howard, S. (2018). Get your headsets ready! Which Virtual Reality headset best suits your library?. In VALA, 13-15th February, 2018, Melbourne, Australia.

電子全文 電子全文(網際網路公開日期:20240520)
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top
無相關論文
 
無相關期刊
 
無相關點閱論文