臺灣博碩士論文加值系統

現今，有許多的多點觸控技術的實現，例如: 電阻式、電容式。然而，由於這些技術的限制，目前不能支援較大的螢幕。因此在本論文將提出並且實作出一套以多點觸控的檢測、追蹤及事件辨識之技術藉以提升應用性。本論文將透過四部紅外線攝影機，捕捉手指觸控到壓克力板的紅外線光，所捕捉到的紅外光點相當於手指的觸控點，可作為輸入設備並且提供便利的人機介面，並結合電腦視覺式的多點觸控技術。與傳統的觸控技術相比，多點觸控技術，允許用戶使用多根手指執行複雜指令。
多點觸控之手指光點偵測，將透過紅外線攝影機取得影像資訊，對影像資訊分離出影像上的明亮點物件，在以多點觸控之手指光點追蹤技術進行追蹤並記錄運動軌跡。然後再利用得到的明亮物件運動軌跡，再進行事件分析，判斷其相對應的事件。在應用方面，希望使用者只要透過簡單的點選動作就可以體驗到較為人性化介面所帶來的樂趣，因此也定義了手指連續點擊和手指滑動軌跡的事件。並且實作出類似桌子形式的觸控螢幕，該裝置可以同時提供多人針對該桌子進行互動。

Nowadays, multi-touch technology has become a popular issue. Multi-touch has been implemented in several ways including resistive type, capacitive type and so on. However, because of limitations, multi-touch by these implementations cannot support large screens. Therefore, this thesis proposes a multi-camera vision-based finger detection, tracking, and event identification techniques for multi-touch sensing with implementation. The proposed system detects the multi-finger pressing on an acrylic board by capturing the infrared light through four infrared cameras. The captured infrared points, which are equivalent to the multi-finger touched points, can be used for input equipments and supply man-computer interface with convenience. Additionally, the proposed system is a multi-touch sensing with computer vision technology. Compared with the conventional touch technology, multi-touch technology allows users to input complex commands.
The proposed multi-touch point detection algorithm identifies the multi-finger touched points by using the bright object segmentation techniques. The extracted bright objects are then tracked, and the trajectories of objects are recorded. Furthermore, the system will analyze the trajectories of objects and identify the corresponding events pre-defined in the proposed system. For applications, this thesis wants to provide a simple human-computer interface with easy operation. Users can access and input commands by touch and move fingers. Besides, the proposed system is implemented with a table-sized screen, which can support multi-user interaction.

摘　要 i
ABSTRACT ii
誌　謝 iv
目　錄 v
表目錄 vii
圖目錄 viii
第一章 緒論 1
1.1 研究背景與動機 1
1.2 文獻探討 2
1.2.1 電阻式觸控螢幕技術 3
1.2.2 電容式觸控螢幕技術 6
1.2.3 感測器陣列式多點觸控技術 8
1.2.4 電腦視覺式多點觸控技術 9
1.3 論文架構 11
1.4 論文貢獻 11
第二章 電腦視覺式觸控技術之改良的平台建置 12
2.1 紅外線攝影機的建置 13
2.2 紅外線LED和投影機擺設 16
2.3 觸控桌的建置 19
2.4 影像的拼接 25
第三章 多點觸控的檢測、追蹤及事件辨識之技術 27
3.1多點觸控之手指光點偵測與切割技術 29
3.2多點觸控之手指光點追蹤技術 33
3.3多點觸控之事件分析與辨識技術 36
第四章 嵌入式系統介紹與移植 42
4.1嵌入式平台介紹 42
4.2嵌入式平台建置 45
4.3嵌入式平台移植 48
第五章 實驗結果與分析 51
5.1 個人電腦平台實驗結果 51
5.2 嵌入式平台實驗結果 70
5.3 觸控桌平台Demo 73
第六章 結論與未來工作 74
6.1 結論 74
6.2 未來工作 74
參考文獻 75

[1]"數位式觸控面板." - http://www.aimtouch.com.tw/web-tw/touch_tech.htm
[2]"觸控面板關鍵技術發展與未來趨勢.",萬達光電科技股份有限公司.
[3]"各線式電阻的電極配線."- http://www.moneydj.com/kmdj/wiki/wikiviewer.aspx?Title=%E9%9B%BB%E9%98%BB%E5%BC%8F%E8%A7%B8%E6%8E%A7%E9%9D%A2%E6%9D%BF
[4]Steve Hodges,Shahram Izadi,Alex Butler,Alban Rrustemi,Bill Buxton, "ThinSight: Versatile Multi-touch Sensing for Thin Form-factor Displays."
[5]"Microsoft surface." - http://www.microsoft.com/surface/
[6]"Diffused Illumination. "- http://wiki.nuigroup.com/Diffused_Illumination_Plans
[7]J. Y. Han, "Low-cost multi-touch sensing through frustrated total internal reflection." in Proc. of UIST 2005, 2005, pp. 115-118.
[8]"A study on image splicing algorithm for large screen multi-touch technique.",2010 International Conference on Machine Vision and Human-machine Interface.
[9]"IR LED." - http://www.everlight.com
[10]"IR LED使用的電路板." - http://www.led-shop.com.tw/index.htm
[11]"Touchlib. " - http://www.nuigroup.com/touchlib/
[12]"TUIO." - http://www.tuio.org/
[13]"Open Sound Control." - http://opensoundcontrol.org
[14]"OpenCV." - http://www.opencv.org/
[15]Yen-Lin Chen ,Wen-Yew Liang,Chuan-Yen Chiang,Tung-Ju Hsieh,Da-Cheng Lee,Shyan-Ming Yuan,Yang-Lang Chang, "Vision-based finger detection, tracking,and event identification techniques for multi-touch sensing and displaying systems.", Sensors, vol. 11, no. 7, pp. 6868-6892, 2011.
[16]Otsu, N. "A threshold selection method from gray-level histograms. " IEEE Trans. Syst. Man Cybern. 1979, SMC-9, 62-66.
[17]Sinan S. Al Sheikh,Shawky M. Hanana,Yousif Al-Hosany,Bassel Soudan, "Design and Implementation of an FTIR Camera based Multi-Touch Display"
[18]" AM/DM37x EVM "- http://www.mistralsolutions.com
[19]"ARM Cortex™-A8 AM3715 and AM3703 Sitara™ MPUs"- http://www.arroweurope.com/suppliers/supplier-microsites/texas-instruments/innovation-update.html
[20]"Linux ez software development kit"- http://www.ti.com/tool/linuxezsdk-sitara
[21]Kim, J., Park, J., Kim, H., and Lee, C., “HCI (Human Computer Interaction) Using Multi-touch Tabletop Displays in Proceedings of the IEEE Pacific Rim Conference on Communication,Computers, and Signal Processing, 22-24 Aug. 2007, pp. 391 –394.
[22]Ahsanullah, Ahmad Kamil B. Mahmood, Suziah Sulaiman. "Design and Implementation of Multi-Touch System Using FTIR Technique for Optimization of FingerTouch Detection."
[23]Shahzad Malik, Joe Laszlo. "Visual Touchpad: A Two-handed Gestural Input Device"
[24]"Apple iphone" - http://www.apple.com./iphone
[25]"NUI Group Community Forums." - http://nuigroup.com/forums
[26]粘存賢,"設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕.",國立中央大學, 2009.
[27]魏正翰,高愷懃,"多點觸控系統的設計與建置.",大同大學,2009.