臺灣博碩士論文加值系統

本論文中以QR Code 取代擴增實境(augmented reality)中傳統的白底黑色邊框的標籤，並設計開發一套擴增實境系統。此系統利用QR Code，相較於傳統標籤具有下列優點：(1)QR Code 內建的錯誤修正的能力可以加強標籤被部分遮蔽時的辨識率，(2)QR Code 可攜帶遠高於傳統標籤的資訊量，(3)使用傳統的擴增實境開發環境時，使用者必須要先自己定義標籤，之後得再訓練應用程式認識這些標籤，本論文提出的方法，則不再需要這些動作，(4) 每當改變標籤，應用程式開發人員不再需要再重新編譯程式。另外, 本系統使用Kalman濾波器的方法，來預估標籤的位置，以解決標籤被部分或全部被遮蔽的問題。
我們設計及實現的系統將QR Code 解碼的動作委任給解碼模組，利用QR Code的三個牛眼標記追蹤標籤，相對於世界座標的位置與姿態以計算出轉換矩陣，最後使用計算出的轉換矩陣與QR Code解碼模組的解碼結果，畫出相對的3D虛擬物件。我們提出的方法，除具有前述的優點外，更進一步提高擴增實境與資料庫的動態結合，可用以產生出更進階的應用，在本論文中就提出由可在護照上貼上QR Code，使用我們開發的系統，配合資料庫，以產生護照持有人的3D立體圖像的新應用。

This thesis proposes to replace the conventional marker of Augmented Reality (AR) with the QR Code pattern and we design and implement a prototype AR system named QRAR (Quick Response Code with Augmented Reality) from scratch. The system has several advantages, compared with traditional black-square-boarder tags. These advantages are: (1) better error correction to reinforce occlusion immunity, (2) the ability of embedding much more information into the code, (3) users do not have to predefine markers and train their AR programs to recognize their markers in advance, and (4) It is also possible to modify (part of) information of makers without recompiling AR programs. In addition, we introduce Kalman filter to solve the marker occlusion issue.
The prototype of AR system uses the QR decoder which feeds back the information contained in the QR Code. The other major part of tasks in our prototype is to track the tilt angle and position of the marker with three bull-eye patterns which are the significant features of QR Code, related to the real world coordinate system. After that, we use part of the information contained in the QR Code to determine which virtual object we are about to draw and use the transformation matrix to make the virtual object in line with the tilt angle and position of the marker in the real world coordinate system. Our proposed system makes it possible to have applications fetch dynamic data from DB servers in the Intranet/Internet. Based on this, we implement a new application which could show a passport owner’s 3D image, assuming that a QR Code is attached with the passport, and our AR application can archive the image, stored in an internet database, identified by the QR Code.

中文摘要 I
ABSTRACT II
ACKNOWLEDGEMENT III
CONTENT IV
LIST OF FIGURES V
LIST OF TABLES VII
1. INTRODUCTION 1
1.1. Definition of AR 1
1.2. How AR Works 2
1.3. Motivation and Example Applications 4
2. BACKGROUND AND RELATEDWORK 10
2.1. Background 10
2.1.1. Principle of AR 10
2.1.1.1. Translation 10
2.1.1.2. Rotation 11
2.1.1.3. Scale 14
2.1.1.4. Transformation 14
2.1.2. Pose and Position Estimation--Kalman Filter 15
2.1.3. QR Code 18
2.2. Related Work 21
2.2.1. AR SDKs 21
2.2.2. Pros and Cons of SDKs 22
3. IMPLEMENTATION OF THE PROTOTYPE QRAR 24
3.1. System Overview 24
3.2. Camera Calibration 27
3.3. Stage1: QR Code identify ＆ Pose Track 28
3.4. Stage2: Decode QR Code and Draw an Virtual Object 41
3.5. Solution for temporary occlusion-Kalman Filter 43
4. EXPERIMENTS AND EVALUATION 45
5. CONCLUSION AND FUTURE WORK 51
REFERENCES 53

[1]Ronald T. Azuma, “A Survey of Augmented Reality, Teleoperators and Virtual Environments/MIT Press Journals, 6, 4, pp2-5, Aug 1997.
[2]Jurgen Zauner, Michael Haller, Alexander Brandl, Werner Hartmann, “Authoring of a Mixed Reality Assembly Instructor for Hierarchical Structures, IEEE International Symposium Mixed and Augmented Reality (ISMAR 03),Tokyo, Japan, p1, pp5-6, Oct 2003.
[3]J. Marescaux, F. Rubino, M. Arenas, D. Mutter, L. Soler, “Augmented-Reality–Assisted Laparoscopic Adrenalectomy, The Journal of the American Medical Association (JAMA), 292, 18, 2004.
[4]Tobias Sielhorst, Tobias Obst, Rainer Burgkart, Robert Riener, and Nassir Navab, “An Augmented Reality Delivery Simulator for Medical Training, Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery(AMIARCS 04), Rennes, France, p1,pp16-19, 2004.
[5]V. Vlahakis, J. Karigiannis, M. Tsotros, N. Ioannidis, D. Stricker, “Personalized Augmented Reality Touring of Archaeological Sites with Wearable and Mobile Computers, IEEE Sixth International Symposium on Wearable Computers(ISWC 10), Shanghai, China, p1, p8, Nov 2010.
[6]Sang Hwa Lee, Junyeong Choi, Jong-Il Park, “Interactive E-Learning System Using Pattern Recognition and Augmented Reality, IEEE Transactions on Consumer Electronics, 55, 2, pp1-6 May 2009.
[7]Steven J. Henderson, Steven Feiner, “Evaluating the Benefits of Augmented Reality for Task Localization in Maintenance of an Armored Personnel Carrier Turret, Proceedings of the 2009 8th IEEE international Symposium on Mixed and Augmented Reality (ISMAR), pp1-4, Oct 2009.
[8]Scott A. Green, Mark Billinghurst, XiaoQi Chen J., Geoffrey Chase, “Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design, International Journal of Advanced Robotic Systems, vol. 5, no.1, pp 1-7, 2008.
[9]Erick Mendez, Dieter Schmalstieg, “Importance Masks for Revealing Occluded Objects in Augmented Reality, Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology(VRST), Kyoto, Japan, pp1-2, Nov 2009.
[10]Steven Henderson, Steven Feiner, “Opportunistic Tangible User Interface for Augmented Reality, IEEE Transactions on Visualization and Computer Graphics (TVCG 10), pp1-9, 2010, http://www.youtube.com/watch?v=8XWExrVB12I.
[11]Jonathan Mooser, Suya You, Ulrich Neumann, “Real-Time Object Tracking for Augmented Reality Combining Graph Cuts
and Optical Flow, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Nara, Japan, pp1-2, Nov 2007.
[12]Andreas D?nser, Rapha?l Grasset, Mark Billinghurst, A Survey of Evaluation Techniques Used in Augmented Reality Studies, Human Interface Technology Laboratory New Zealand-Technical Report, TR-2008-02, pp4-6, Sep 2008.
[13]Hirokazu Kato, Inside ARToolKit, Human Interface Technology Laboratory, pp3-9, Dec 2006, http://www.hitl.washington.edu/artoolkit/Papers/ART02-Tutorial.pdf.
[14]Stephen Cawood, Mark Fiala, Augmented Reality A Practical Guide, The Pragmatic BookShelf, p28, pp281-289, Jan 2008, http://www.pragprog.com/titles/cfar/augmented-reality.
[15]Ministry of Foreign Affairs R.O.C., FAQ, Bureau of Consular Affairs
Ministry of Foreign Affiairs, R.O.C., Retrieved Apr 2010, http://www.boca.gov.tw/ct.asp?xItem=3190＆ctNode=263＆mp=1.
[16]Wikipedia, Kalman Filter, Wikimedia Foundation, Inc., Apr 2010, http://en.wikipedia.org/wiki/Kalman_filter .
[17]Greg Welch, Gary Bishop, “An introduction to Kalman Filter, ACM Special Interest Group on Computer Graphics (SIGGRAPH), California, USA, pp19-24, Aug 2001.
[18]Wikipedia, QR Code, 2010, Wikimedia Foundation Inc., Apr 2010, http://en.wikipedia.org/wiki/QR_Code#cite_note-3.
[19]Denso-wave, QR Code Standardization, Denso-wave Inc., Retrieved Apr 2010, http://www.denso-wave.com/qrcode/qrstandard-e.html
http://www.denso-wave.com/qrcode/qrgene3-e.html.
[20]THSR, Purchasing Ticket From Convenient Store, THSR, Retrieved August 2010, http://www.thsrc.com.tw/event/2010/100223_FamilyMart/index.html.
[21]Dieter Schmalstieg, Daniel Wagner, “Experiences with Handheld Augmented Reality, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR),Nara, Japan, pp3-4, Nov 2007, http://portal.acm.org/toc.cfm?id=1514339＆type=proceeding＆coll=GUIDE＆dl=GUIDE＆CFID=85558152＆CFTOKEN=27203144.
[22]Intel Corporation, Open Source Computer Vision/Reference Menual, Intel Corporation, Version -004, p1-1, p1-2, Dec 2001, http://developer.intel.com.
[23]Gary Bradski, Adrian Kaebler, Learning OpenCV Computer Vision with OpenCV Library, O’RELLY, pp21-22,pp26-27,pp395-413, 2008, http://developer.intel.com.
[24]Jackie Neider Tom Davis Mason Woo, OpenGL Programming guide/Redbook, Addison-Wesley, pp13-15, http://fly.cc.fer.hr/~unreal/theredbook/.
[25]PartiTek Software Team, PtQRDecoder for Linux, PartiTek Inc., Retrieved Dec 2009, http://www.PartiTek.com.