跳到主要內容

臺灣博碩士論文加值系統

(18.97.14.81) 您好!臺灣時間:2025/02/10 23:32
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:陳延祥
研究生(外文):Yen-Hsiang Chen
論文名稱:影像處理應用於鋼琴琴鍵打譜
論文名稱(外文):Apply Image Recognition to the Musical Composition Using Piano
指導教授:丁肇隆丁肇隆引用關係張瑞益張瑞益引用關係
口試日期:2017-07-31
學位類別:碩士
校院名稱:國立臺灣大學
系所名稱:工程科學及海洋工程學研究所
學門:工程學門
學類:綜合工程學類
論文種類:學術論文
論文出版年:2017
畢業學年度:105
語文別:中文
論文頁數:43
中文關鍵詞:按鍵判別樂器數位介面影像處理訊號分析
外文關鍵詞:Note on detectionmusical interfaceimage processingsignal analysis
相關次數:
  • 被引用被引用:0
  • 點閱點閱:293
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
本研究旨在建立一種新的琴譜紀錄方式。以鋼琴為實驗平台,配合當代電腦影像處理的技術,將傳統撰寫鋼琴琴譜的方式從硬體移植到軟體上。本研究的目的是在於提供打譜軟體使用者及音樂教育者能以更低成本,使用規範上更簡易的方式進行樂理中音調及拍數的紀錄。由於錄影設備及電腦使用的普及,當代的樂器演奏往往被以音訊或影像的方式記錄下來,然而除了以音訊的方式,若配合影像處理及電腦演算,其亦可將此種紀錄轉換成樂器學習者所使用的琴譜來呈現。本研究使用網路上以及一些錄製的影片來進行轉譜實驗,配合簡易的影像及訊號處理有效率地將影像中的可用特徵量化,並將實驗成果與過往研究相比較。
Online musical performances nowadays are popular as the online platforms, like Youtube or Yoku, are widely used. One specific type of performance among these is the instrument solo. Instruments solo using piano, flute, or guitar are recorded and being uploaded to the internet. Some are made as tutorial videos to teach the audiences to learn by themselves. In this paper we explore the possibility transcribing these tutorial video into readable sheet using current software technologies from signal processing and image processing, brining an improvement to the old-fashioned audio signal converting. The experiment is built upon piano solo-playing, as these kinds of performances can be found commonly on Youtube and are easier to perform the video segmentation. In the experiment the comparison between mutual information converting, the sound and video, and single information converting, which is the sound, are discussed. After the discussion, we come to a conclusion whether the adoption of correlative converting is applicable on the other instruments.
誌謝 i
摘要 ii
ABSTRACT iii
目錄 iv
圖例索引 vii
表格索引 ix
第1章、 緒論 1
1.1 研究動機與目的 1
1.2 研究貢獻 2
1.3 系統流程 2
1.4 論文架構 4
第2章、 樂理及數位音訊特徵介紹 5
2.1 基本樂理及工具術語簡介 5
2.2 八度音以及移調 7
2.3 和弦 8
2.4 曲速 8
2.5 電子樂器通訊傳輸格式 9
第3章、 琴鍵按壓辨識方法 10
3.1 實驗限制 10
3.2 相關文獻回顧 11
3.3 本實驗系統與方法 12
3.3.1 琴鍵區域提取 12
3.3.2 琴鍵計算器(Key Calculator) 16
3.3.3 琴鍵映射(Mapper) 19
3.3.4 特徵量化 19
3.3.5 特徵訊號處理 22
第4章、 結果比較 27
4.1 與第三方軟體之結果比較 27
4.1.1 複音研究 27
4.1.2 Digital Ear 28
4.1.3 WIDI 29
4.1.4 結果比對 30
4.2 與過去實驗之結果比較 32
4.3 實驗成果展示 34
4.3.1 John Legend – All of me (Pieces) 34
4.3.2 卡農(片段) 36
第5章、 結論 38
5.1 整合歸納 38
5.2 未來改善重點 38
5.2.1 光線環境 38
5.2.2 門檻值 38
5.2.3 樂譜 40
REFERENCE 41
[1]Potcharapol Suteparuk, “Detection of Piano Keys Pressed in Video”, 2014
[2]Gorodnichy, Dmitry O. and Arjun Yogeswaran. “Detection and tracking of pianist hands and fingers.” The 3rd Canadian Conference on Computer and Robot Vision (CRV''06) (2006): 63-63.
[3]Hashimoto, M., & Oka, A. (2013). Marker-less piano fingering recognition using sequential depth images. The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, 1-4.
[4]Eddins, S.L., González, R.C., & Woods, R.E. (2004). Digital image processing using MATLAB.
[5]Haralick, R. M., and L. G. Shapiro, Computer and Robot Vision, Vol. I, Addison-Wesley (1992): 158-205.
[6]Boomgaard, Rein van den and Richard van Balen. “Methods for fast morphological image transforms using bitmapped binary images.” CVGIP: Graphical Model and Image Processing 54 (1992): 252-258.
[7]Toiviainen, P., & Eerola, T. (2016). MIDI Toolbox 1.1., https://github.com/miditoolbox/1.1
[8]PiannoKeyz., https://www.youtube.com/watch?v=q3YKrf7F3IU
[9]Mido., http://mido.readthedocs.io/en/latest/midi_files.html
[10]Ron Brinkmann, “The Art and Science of Digital Compositing.” Morgan Kaufmann (1999): 184.
[11]Charles A. Poynton, “Digital Video and HDTV: Algorithms and Interfaces.” Morgan Kaufmann (2003)
[12]Nicholas Boughen, “Lightwave 3d 7.5 Lighting.” Wordware Publishing (2003)
[13]Stephen Johnson, “Stephen Johnson on Digital Photography.” O''Reilly (2006).
[14]Image Analyst, https://www.mathworks.com/matlabcentral/fileexchange/28512-simplecolordetectionbyhue--
[15]Ron Brinkmann, “The Art and Science of Digital Compositing.” Morgan Kaufmann. (1999): 184.
[16]OTSU, N. (2008). Tlreshold Selection Method from Gray-Level Histograms.
[17]A. Rosenfeld , A. C. Kak (1982), Digital Picture Processing, Academic Press, Inc.
[18]Cheng, CC; Peng, GJ; Hwang, WL (2009), "Mathworks: Pixel Connectivity", IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, 18 (1): 52–62
[19]Cheng, CC; Peng, GJ; Hwang, WL (2009), "Pixel Connectivity", IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, 18 (1): 52–62
[20]Jean Serra, “Image Analysis and Mathematical Morphology.” (1982)
[21]Jean Serra, “Image Analysis and Mathematical Morphology, Volume 2: Theoretical Advances.” (1988)
[22]Edward R. Dougherty, “An Introduction to Morphological Image Processing” (1992)
[23]Soille, P., Morphological Image Analysis: Principles and Applications, Springer-Verlag, 1999, pp. 173-174.
[24]Addison-Wesley, “Design Patterns: Elements of Reusable Object-Oriented Software.” (1995)
[25]Anderson R., “The Credit Scoring Toolkit. Oxford University Press.” (2007)
[26]Refaat M., “Data Preparation for Data Mining Using SAS.” Morgan Kaufmann (2006)
[27]Refaat M., “Credit Risk Scorecards: Development and Implementation Using SAS.” lulu.com, 2011.
[28]Lyn C. Thomas, David B. Edelman, and Jonathan N. Crook, “Credit Scoring and Its Applications.” Society for Industrial and Applied Mathematics (2002)
[29]Nishio, S., Takegawa, Y., & Terada, T. (2006). Design and Implementation of a Real-Time Fingering Detection System for Piano Performance. ICMC.
[30]WIDI, by Widisoft, MP3 to MIDI and WAVE to MIDI Converter. https://www.widisoft.com/
[31]Digital Ear, Convert Audio (.wav) files to MIDI. http://www.digital-ear.com/digital-ear/index.asp
[32]Furuya, Shinichi et al. “Hand kinematics of piano playing.” Journal of neurophysiology 106 6 (2011): 2849-64.
[33]Letessier, Julien and François Bérard. “Visual tracking of bare fingers for interactive surfaces.” UIST (2004).
[34]Mackie, J., & McCane, B., “Finger Detection with Decision Trees.” (2004)
[35]Adams, R., "Radial Decomposition of Discs and Spheres," Computer Vision, Graphics, and Image Processing: Graphical Models and Image Processing, Vol. 55, Number 5, pp. 325–332, September 1993.
[36]Jones, R., and P. Soille, "Periodic lines: Definition, cascades, and application to granulometrie," Pattern Recognition Letters, Vol. 17, pp. 1057–1063, 1996.
[37]Powers, David M W (2011). "Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation" (PDF). Journal of Machine Learning Technologies. 2 (1): 37–63
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top