臺灣博碩士論文加值系統

A music conducting system analyzes a conductor's gestures and interprets their intentions. Such a system is useful when training conductors because it can save human resources when preparing a practice. In the movie and entertainment industry, more touching music can be achieved by reshaping electronic music using a conducting system. For some, conducting systems can even be an interesting game.
Existing conducting systems have problems with tempo control whereby their tempo control method induces erratic tempo changes. In this paper, we propose a better tempo control method that is stable and can immediately respond to a conductor’s intentions. We also implement volume and instrument control that has been proposed in other research. We want to build an advanced conducting system that allows users to control each musical detail.

在音樂的領域中，互動式的音樂指揮系統可以有許多的應用。例如音樂的教育和訓練、電影產業中的音樂使用、或是作為個人的娛樂等等。然而，過去的指揮系統雖然完成了音量以及部門的控制，但是卻沒有一個好方法作到既穩定又即時的速度控制。
在這次的研究目標，我們提出了一個更好的速度控制方法，讓速度控制有更準確的判斷。此外，我們建造出一個虛擬的樂團讓演奏者的模型可以跟著使用者的行為有所反應，使用者可以更清楚的知道自己指揮的情況。最後，我們實作了以前的研究中所完善的音量控制以及部門控制的方法，以期望能夠將此指揮系統更貼近真正的指揮。

Contents
List of Figures iv
1 INTRODUCTION 1
2 RELATEDWORK 3
3 OVERVIEW OF CONDUCTING DATA AND TRAJECTORY 5
4 METHODOLOGY AND IMPLEMENTATION 8
4.1 Beats Recognition and Pattern Recognition . . . . . . . . . . . . . . . . . 8
4.2 Volume Recognition and Instrument Recognition . . . . . . . . . . . . . . 10
4.3 Tempo Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
5 EXPERIMENTAL EVALUATION 16
5.1 Response Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
5.2 Beat Recognition, Volume Recognition and Instrument Recognition . . . . 17
5.3 Pattern Recognition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
5.4 Delay of Tempo Control . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
5.5 Analyzing Conducting Velocity and Acceleration . . . . . . . . . . . . . . 22
6 CONCLUSION 27
References

References
[1] J. Borchers, E. Lee, W. Samminger, and M. M‥uhlh‥auser. Personal orchestra: a real-
time audio/video system for interactive conducting. Multimedia Syst., 9(6):594–594,
2004.
[2] J. O. Borchers, W. Samminger, and M. M‥uhlh‥auser. Engineering a realistic real-time
conducting system for the audio/video rendering of a real orchestra. In MSE ’02:
Proceedings of the Fourth IEEE International Symposium on Multimedia Software En-
gineering, page 352, Washington, DC, USA, 2002. IEEE Computer Society.
[3] E. Lee, I. Gr‥ull, H. Kiel, and J. Borchers. conga: A framework for adaptive conduct-
ing gesture analysis. In NIME 2006 International Conference on New Interfaces for
Musical Expression, pages 260–265, Paris, France, June 2006.
[4] E. Lee, H. Kiel, S. Dedenbach, I. Gr‥ull, T. Karrer, M. Wolf, and J. Borchers. isym-
phony: an adaptive interactive orchestral conducting system for digital audio and video
streams. In CHI ’06: CHI ’06 extended abstracts on Human factors in computing sys-
tems, pages 259–262, New York, NY, USA, 2006. ACM.
[5] E. Lee, T. M. Nakra, and J. Borchers. You’re the conductor: a realistic interactive
conducting system for children. In NIME ’04: Proceedings of the 2004 conference
on New interfaces for musical expression, pages 68–73, Singapore, Singapore, 2004.
National University of Singapore.
[6] E. Lee, M. Wolf, and J. Borchers. Improving orchestral conducting systems in public
spaces: examining the temporal characteristics and conceptual models of conducting
gestures. In Proceedings of the CHI 2005 conference on Human factors in computing
systems, Portland, Oregon, April 2005. ACM, ACM Press.
[7] D. Murphy, T. H. Andersen, and K. Jensen. Conducting audio files via computer vision.
In Gesture Workshop, pages 529–540, 2003.
[8] C.-J. K. Y.-S. C. Yi-Lan Liu, Carlos Rene Argueta. iconduct : Music control in the
interactive conducting system.
2