臺灣博碩士論文加值系統

電影是一種具有複雜且豐富內容的影片，電影的分析比起監視系統的影片，運動影片或者是紀錄片的分析來得複雜許多。本論文提出以隱藏式馬可夫模型方法將電影的場景分類；本論文將分析電影中兩種常出現的場景：對話場景與動作場景。從電影場景中的每個畫面中抽取顏色及動態特徵。這些從連續畫面中抽取的特徵，將為一時間序列，並且被高斯混合隱藏式馬可夫模型所學習與辨認。在論文實驗中，由兩部電影共有41個對話場景及15個動作場景被實驗，最高的準確率可達80%。

Movie is a kind of complex video with rich content. The analysis of movie is more complicated than other types of videos like surveillance, sport games, and documentaries. In this paper, a statistical approach using hidden Markov model to classify movie scenes is proposed. Two important kinds of movie scenes, dialogue and fighting scenes, are classified. Color and motion features are extracted for each frame. Features of all frames within a scene are regarded as a time series of observations that are statistically modeled by Gaussian mixture ergodic hidden Markov model. Two movies with 41 dialogue scenes and 15 fighting scenes are experimented. The highest accuracy rate can achieve 80%.

目錄
中文摘要 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧i
英文摘要 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧ii
誌謝 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧iii
目錄 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧iv
表目錄 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧vi
圖目錄 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧vii
第一章 緒論 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧1
1.1 研究動機與背景 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧1
1.2 相關研究 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧2
1.3 論文方法與論文架構圖 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧5
1.4 論文章節架構 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧7
第二章 場景定義 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧8
2.1 對話場景分析與定義 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧12
2.2 中國動作場景分析與定義 ‧‧‧‧‧‧‧‧‧‧‧‧‧18
第三章 電影內容分析所使用的特徵抽取 ‧‧‧‧‧‧‧‧‧23
3.1 顏色特徵 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧24
3.2 動態特徵 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧27
第四章 電影內容分析所使用的隱藏式馬可夫模型 ‧‧‧‧‧‧34
4.1 隱藏式馬可夫模型介紹 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧34
4.2 電影內容分析所使用的隱藏式馬可夫模型 ‧‧‧‧‧‧46
第五章 實驗與討論 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧48
5.1 實驗結果 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧50
5.2 實驗討論 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧53
第六章 結論與未來研究方向 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧54
參考文獻 ‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧‧55

[1] J. Boreczky and L. Wilcox, “A hidden markov model framework for video segmentation using audio and image features,” Proceeding International Conference on Acoustics Speech and Signal Processing, Vol. 6, pp. 3741-3744, 1998.
[2] C.-L. Huang and C.-Y. Chang, “Video summarization using hidden Markov model,” Proceedings, International Conference Information Technology Coding and Computing, pp. 473-477, 2001.
[3] C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, “On clustering and retrieval of video shots,” ACM Multimedia Conference, pp. 51-60, 2001.
[4] T. Kwawshima, K. Tateyama, T. Iijima, and Y. Aoki, ”Indexing of baseball telecast for content-based video retrieval,” IEEE International Conference on Image Processing, pp. 216-227, 1997.
[5] P. Xu, L. Xie, S.-F. Chang, A. Divakaran, A. Vetro, and H. Sun, “Algorithms and system for segmentation and structure analysis in soccer video,” Proceedings IEEE International Conference on Multimedia and Expo, pp. 928-931, 2001.
[6] T. Lin and H.-J. Zhang, “Automatic video scene extraction by shot grouping,” International Conference on Pattern Recognition, Vol. 4, pp. 39-42, 2000.
[7] Jihua Wang, Tat-Seng Chua and Liping Chen. “Cinematic-based model for scene boundary detection,” Proceedings of Multimedia Modeling Conference, pp. 3-18, 2001.
[8] H.-B. Kang, “A hierarchical approach to scene segmentation,” Content-Based Access of Image and Video Libraries, pp. 65-71, 2001.
[9] Y. Rui, S. Huang, and S. Mehrota, “Exploring video structures beyond the shots,” Proceedings of IEEE Conference Multimedia Computing and Systems, pp. 237-242, 1998.
[10] M. M. Yeung and B. L. Liu, “Time-constrained clustering for segmentation of video into story unit,” Proceedings IEEE of International Conference on Pattern Recognition, pp. 375-380, 1996.
[11] R. Qian, N. Hearing and I. Sezan, “A computational approach to semantic event detection,” Proceedings Computer Vision and Pattern Recognition, Vol. 1, pp. 200-206, 1999.
[12] I.L. MacDonald and W. Zucchini, “Hidden Markov and other models for discrete-valued time series,” Chapman and Hall 1997.
[13] L. Rabiner, “A tutorial on hidden markov models and selected applications in speech recognition,” Proceedings of the IEEE, Vol. 77, Issue 2, pp. 257-286, 1989.
[14] L. R. Rabiner and B. H. Juang, “An Introduction to hidden Markov model,” IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 4-16, 1986.
[15] A. Krogh, S.I. Mian and D. Haussler, “A hidden Markov model that finds genes in E. Coli DNA,” Nucleic Acids Research, Vol. 22, No. 22, pp. 4769-4778, 1994.
[16] Z. Liu, J. Huang, and Y. Wang, “Classification of TV programs based on audio information using hidden Markov model,” Proceedings of 1998 IEEE Second Workshop on Multimedia Signal Processing, pp. 27-31, 1998.
[17] C. Taskiran, C. A. Bouman, and E. J. Delp, “Discovering video structure using the pseudo-semantic trace,” Proceedings of the SPIE Conference on Storage and Retrieval for Media Databases, Vol. 4315, pp. 571-578, 2001.
[18] W. Wolf, “Hidden Markov model parsing of video programs,” Proceedings International Conference on Acoustics Speech and Signal Processing, Vol. 4, pp. 2609-2611, 1997.
[19] L. Tiecheng and K. John, “A hidden Markov model approach to the structure of documentaries,” Proceedings IEEE Workshop on Content-based Access of Image and Video Libraries, pp. 111-115, 2000.
[20] J. R. Jain and A. K. Jain, “Displacement measurement and its application in inter- frame image coding,” IEEE Transaction on Communications, pp. 1799-1808, 1981.