跳到主要內容

臺灣博碩士論文加值系統

(3.236.84.188) 您好!臺灣時間:2021/08/01 20:04
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:陳年麒
研究生(外文):Nien-Chi Chen
論文名稱:一套使用視覺通透式頭戴顯示器為輔助的擴增實境鋼琴學習系統
論文名稱(外文):PLSOH: An Augmented Reality Based Piano Learning System Using Optical See-Through Head Mounted Display
指導教授:歐陽明歐陽明引用關係
指導教授(外文):Ming Ouhyoung
口試委員:葉正聖楊傳凱
口試委員(外文):Jeng-Sheng YehChuan-Kai Yang
口試日期:2015-06-25
學位類別:碩士
校院名稱:國立臺灣大學
系所名稱:資訊工程學研究所
學門:工程學門
學類:電資工程學類
論文種類:學術論文
論文出版年:2015
畢業學年度:103
語文別:英文
論文頁數:57
中文關鍵詞:擴增實境虛擬實境視覺通透式頭戴顯示器深度影像音樂教育
外文關鍵詞:Augmented RealityVirtual RealityDepth ImageOptical See Through Head-mounted DisplayMusic Education
相關次數:
  • 被引用被引用:1
  • 點閱點閱:169
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
音樂學習對初學者來說是具有挑戰性的,尤其當學習的樂器較為複雜的時候,例如:鋼琴。對初學者來說,初期最困難的部分之一就是學習如何看懂樂譜。當樂譜上的記號複雜且讓人混淆時,初學者容易失去信心且容易忘記在課堂上學到的正確知識。
因此,我們提出另一種學習方式來克服這些令人沮喪的問題。由於擴增實境技術的進步,我們可以幫初學者創造一個易認知的學習環境。透過視覺通透式頭戴顯示器,初學者可以看到鋼琴上附加的額外虛擬輔助訊息。在系統中,包含了練習模式跟教學影片兩種模式可以選擇。
更重要的是,這個系統可以被應用在電子鋼琴和傳統鋼琴上。因為我們利用了深度攝影機來偵測琴鍵深度的變化,來判斷使用者是否正確地按下琴鍵。在系統中被特殊設計的輔助標記,不僅是拿來偵測,同時也可以增進使用者音樂的記憶性。
最後,小規模的使用者調查顯示這套系統可以讓沒有音樂背景的人,提高22%的進步。這個系統中的概念,希望在未來的音樂教育和娛樂上,能夠被使用到。


Music learning for beginners is challenging, especially when learning an intricate instrument such as a piano. The most difficult part for beginners at its preliminary stage should be developing the reading ability of sheet music. Once the music score is complicated and confused, beginners may lose self-confidence easily and simply for-get the instructor’s comments from lessons that they have learned before.
Therefore, we propose an alternative way to overcome these frustrating problems. Thanks to the well-developed technology of augmented reality, we can create a perceptive learning environment for beginners. By using an optical see through head-mounted display, beginners can see the additional helpful virtual information superimposed on the piano keys. Moreover, there are two modes, such as practice and tutorial videos mode, for users to select by their choice.
Most important of all, our system can be applied to not only electronic piano but also traditional piano. The reason is that we use a depth camera to detect whether user presses the correct piano keys by discriminating the depth change of piano keys. The markers in the system is purposely designed for not only feature detection but also improve the memorability of user.
Overall, the small-scale user test shows that the PLSOH system can successfully assist beginners who have no prior musical knowledge with 22% accuracy improvement in average. The concept of the system is expected it will have future usage in music education and entertainment in the future.


致謝 i
中文摘要 ii
ABSTRACT iii
CONTENTS v
LIST OF FIGURES vii
LIST OF TABLES x
Chapter 1 Introduction 1
1.1 Background and Traditional Methods 1
1.2 Motivation 3
1.3 Contributions 6
1.4 Thesis Organization 7
Chapter 2 Related Work 9
2.1 Mobile Device Based Methods 9
2.2 PC Based Methods 10
2.3 Augmented Reality Based Methods 12
2.3.1 Projection Based Methods 12
2.3.2 Camera Based Methods 15
2.3.3 Head-Mounted Display Based Methods 16
Chapter 3 Requirement Analysis 19
3.1 System Target Overview 19
3.2 Preliminary Requirement Research 20
3.3 Physical Setup 25
Chapter 4 System Design and Implementation 27
4.1 Augmented Reality Interface 27
4.1.1 Feature Detection 27
4.1.2 Keystroke Evaluation 31
4.1.3 User Interface 34
4.1.4 Interaction Analysis 37
4.2 Software Architecture 40
Chapter 5 Result 43
Chapter 6 Conclusion 47
Chapter 7 Future work 49
7.1 Adding sheet music recognizing function 49
7.2 Finger Position Correction 51
7.3 Entertainment Element 52
Bibliography 54
Resume 57


[1]I. Barakonyi, and D. Schmalstieg, “Augmented Reality Agents in the Develop-ment Pipeline of Computer Entertainment,” International conference on Enter-tainment Computing, Springer-Verlag Berlin, Heidelberg, pp. 345-356, 2005.
[2]J. Barzdins, R. Freivalds, and C. H. Smith, “Learning with Confidence,” Annual Symposium on Theoretical Aspects of Computer Science, Grenoble, France, pp. 22-24, 1996.
[3]J. Chow, H. Feng, R. Amor, and B. C. Wiinsche, “Music Education using Aug-mented Reality with a Head Mounted Display,” Australasian User Interface Conference, Darlinghurst, Australia, Australia, pp. 73-79, 2013.
[4]M. A. Dzulkifli, and M. F. Mustafar, “The Influence of Colour on Memory Per-formance: A Review,” The Malaysian Journal of Medical Sciences : MJMS, pp. 20(2), 3–9, 2013.
[5]L. Housley, T. Lynch, R. Ramnath, and J. Ramanathan, “Implementation Con-siderations in Enabling Visually Impaired Musicians to Read Sheet Music Using a Tablet,” Computer Software and Applications Conference, Washington, DC, USA, pp. 678-683, 2013.
[6]G. Percival, Y. Wang, and G. Tzanetakis, “Effective use of multimedia for computer-assisted musical instrument tutoring,” Proceedings of the International Workshop on Educational Multimedia and Multimedia Education, Emme, ACM, New York, NY, USA, pp. 67-76, 2007.
[7]D.N.E, Phon, M.B. Ali, and N.D.A. Halim, “Collaborative Augmented Reality in Education: A Review,” Teaching and Learning in Computing and Engineering (LaTiCE), Kuching, pp. 11-13, 2014.
[8]M. Rahman, K. Mitobe, M. Suzuki, C. Takano, and N. Yoshimura, “Analysis of dexterous finger movement for piano education using motion capture system,” International Journal of Science and Technology Education Research Vol. 2(2), pp. 22-31, 2011.
[9]L. Raymaekers, K. Luyten, J. Vermeulen, K. Coninx, “Game of Tones: Learning to Play Songs on a Piano Using Projected Instructions and Games,” CHI 2014, Toronto, ON, Canada, pp. 411-414, 2014.
[10]Rubycell, and JSC, Rubycell Entertainment, “Pianist HD,” http://rubycell.com/game_detail/Android/Pianist-HD/, 2012, Retrieved 13th June 2015.
[11]M. Sanchez, A. Joseph, and R. Dannenberg, “The Frank-Ratchye STUDIO for Creative Inquiry – The Piano Tutor,” http://studioforcreativeinquiry.org/projects/sanchez-joseph-dannenberg-the-piano-tutor-1990, 1990, Retrieved 13th June 2015.
[12]D. Scott, “A survey of the development of sight-reading skills in instructional piano methods for average-age beginners and a sample primer-level sight-reading curriculum,” M.S. thesis, University of South Carolina. 85 pages, Columbia, SC, USA, 2009.
[13]B. E. Shelton, “How Augmented Reality Helps Students Learn Dynamic Spatial Relationships,” Ph.D. dissertation, University of Washington, Seattle, WA, USA, 2003.
[14]Smule, Inc, “Magic Piano,” http://www.smule.com/apps#magic-piano, 2015, Re-trieved 13th June 2015.
[15]M. Weing, F. Schaub, A. Rohlig, B. Konings, K. Rogers, E. Rukzio, J. Gugen-heimer, and M. Weber, “P.I.A.N.O.: Enhancing Instrument Learning via Interac-tive Projected Augmentation,” UbiComp’13, Zurich, Switzerland, pp. 75-78, 2013.


QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top
無相關點閱論文