臺灣博碩士論文加值系統

由於多媒體系統軟硬體大量普及，帶動數位多媒體內容急速增加，對這些數位化資料進行快速檢索成為一個迫切問題，而鏡頭偵測(Shot detection)是處理數位化影片，如分類、註解、儲存等之第一步，不同鏡頭間變換，其銜接方式大致上可分為兩類，突然性鏡頭轉換(Abrupt shot change)和漸進式鏡頭轉換（Gradual Transition），而漸進式鏡頭轉換目前最為常見者即是溶解(dissolve)，由於漸進式鏡頭轉換是人為之編輯動作，所以如有發生此種鏡頭轉換之所在者，可以說具有重要事件如場景變動。
在本篇論文中利用一種新影像編碼特徵：碎形正交基底技術，由於其滿足下列性質：
(a) 相似影像有相似碎形函數；
(b) 相似歸結圖有相似碎形函數；
(c) 兩碎形函數不相似，其歸結圖亦不相似；
(d) 兩影像不相似，其碎形函數亦不相似；
所以可作為影像間相似度比對之良好特徵。
利用此特徵提出一個方法，量化不同畫面間相似度，並利用此資訊作為進行鏡頭轉換偵測依據，由於不需和傳統方法一般需要使用臨界值，所以具有良好之強韌性。

The developing of multimedia to make the video data to increase very quickly.So how to acquire the data that we want in a short time is a more important topic.

Shot change detection is the first step for latter operation like classification and annotations. There are two type of shot change, one is abrupt shot change and the other one is gradual transition. Dissolve is the one of gradual transition that often seen but hard to detection, so in the paper would to propose a robust method to solve this problem.

In this paper we use fractal orthonormal basis for our feature to compare frames in the video to the first frame of video, and use the quantification between those frames to draw a graph.

By analyzing the graph and the characteristic of dissolve in the graph we can locate the approximately the start frame and the end frame of the dissolve. But by the action of video camera or motion of object in frame we may obtained the inaccurate start frame or end frame of the dissolve. So we need to refine the more accurate start and end frame of the dissolve, and we will explain about this in Chapter 3-4

中文摘要 1
目錄 2
圖表目錄 4
第一章 偵測影像畫面變化相關研究 6
1.1影片階層分類 6
1.2鏡頭變換種類 7
1.2.1 突然性鏡頭轉換(Abrupt Cut) 7
1.2.2漸進式鏡頭轉換（Gradual Transition） 9
1.3 判斷時使用特徵 16
1.3.1像素(Pixel) 16
1.3.2 直方圖(Histograms) 19
1.3.3 Compression feature 23
1.3.4 Edge Tracking 27
1.4 研究概述 31
第二章碎形基本理論 34
2.1 轉換之收歛性 37
2.2 迭代函數系統 (iterative function system) 37
2.3 影像分割 38
2.4 迭代函數 39
2.5 碎形在影像搜尋之應用 42
2.6 Orthogonal Basis IFS 44
第三章 研究方法步驟及結果 50
3.1 以碎形進行影像間差異值量化 50
3.2取出可能之轉換過程位置 57
3.2.1基本轉換過程表示 57
3.2.2 轉換過程分類 59
3.2.3可能之轉換過程所在 62
3.3精鍊起終點轉換位置 66
3.4方法比較 75
第四章結論 92
REFERENCES 93

[1]Zhang, H. J., A. Kankanhalli, and S. W. Smoliar, “Automatic partitioning of full-motion video, ”Multimedia Systems, Vol.1, No.1, pp.10-28 , Jun. 1993.
[2]R. Kasturi and R. Jain, Dynamic vision, Computer Vision: Principles (Kasturi and Jain Eds), IEEE Computer Society Press, pp 469-480, 1991.
[3]Hampapur, A., Jain, R., and Weymouth, T., “Digital Video Segmentation,” Proc. ACM Multimedia 94, San Francisco ,CA, October, pp 357-364, 1994.
[4]Nagasaka, A. and Tanaka, Y., “Automatic Video Indexing and Full-Video Search for Object Appearances,” in Visual Database Systems II, Knuth, E., Wegner, L., Editors, Elsevier Science Publishers, pp 113-127,1992.
[5]Arman, F., Hsu, A., and Chiu, M-Y., “Image Processing on Encoded Video Sequences,” Multimedia Systems Vol.1, No. 5, pp. 211-219,1994.
[6]Zabih, R., Miller, J., and Mai, K., “A Feature-Based Algorithm for Detecting and Classifying Scene Breaks,” Proc. ACM Multimedia 95, San Francisco, CA, November, pp. 189-200,1993.
[7]Nilesh V. Patel & Ishwar K. Sethi, “Video shot detection and characterization for video databases,” Pattern Recognition, vol. 30, no. 4 pp.583-592, 1997.
[8]Otsuji, K., and Y. Tonomura, “Projection detecting filter for video cut detection,” in Proc. of ACM Intl.Conf. on Multimedia, pp. 251-257, 1993.
[9]Bhandarkar, S.M. and A.A. Khombhadia, “Motion-based parsing of compressed video,” in Proc. of IEEE Intl. Workshop on Multi-Media Database Management Systems, pp. 80 –87, 1998.
[10]Lee CM, Ip MC. “A robust approach for camera break detection in Color video sequences,” In: IAPR International Workshop on Machine Vision Applications, Kawasaki, Japan, p. 502-5, Dec. 1994.
[11]Soo-Chang Pei, Yu-Zuong Chou, “Efficient MPEG compressed video analysis using macroblock type information,” IEEE Trans. on Multimedia, Vol.1, No.4, pp.321-331, Dec. 1999.
[12]B. Mandelbrot, “The Fractal Geometry of Natur”e, San Francisco, CA: Freeman, 1982.
[13]M. F. Barnsley, “Fractals Everywhere”, Academic Press, San Diego, 1988.
[14]Arnaud E. Jacquin, “A Fractal Theory of Iterated Markov Operators with Applications to Digital Image Coding”, Ph.D. Thesis, Georgia Institute of Technology, 1989.
[15]Khanh Vu, Kien A. Hua, “Image retrieval based on region of interest,” IEEE Trans. on knowledge and data engineering, vol. 15, no. 4, 2003.
[16]Yuval Fisher, E. W. Jacobs, and R.D. Boss, “Iterated Transformation image compression,” NOSC Thec. Rep. TR-1408, Naval Oceans Systems Center, San Diego, CA, 1991.
[17]A.E. JACQUIN, “Image Coding based on a fractal theory of iterated contractive image transformation,” IEEE Trans. on Image Process. ,1992.
[18]Hui Xu, Mengyang Liao, “Cluster-Based Texture Matching for Image Retrieval,” Image Processing ICIP 98. Proceedings International Conference on, Vol. 2, pp. 766-769, 1998.
[19]Gaurav Aggrwal, Ashwin T. V., ans Sugata Ghosal, “An Image Retrieval System With Automatic Query Modification,” IEEE Trans. on Multimedia, Vol. 4, NO. 2, June. 2002.
[20]Young Deok Chum, “Image retrieval using BDIP and BVLC moments,” IEEE Trans. on circuits and systems for video technology, vol. 13, no. 9, 2003.
[21]John Y. Chiang, Z. Z. Tsai, “Image based on Fractal Signatures,” National Computer Symposium in Taichung, 2003.
[22]Maron and T. Lozano-P´erez, “A framework for multiple-instance learning,” in Advances in Neural Information Processing Systems, Vol. 10, pp. 570-576, 1997.
[23]Z. Wang, Z. Chi and D. Feng, “Shape based leaf image retrieval,” IEEE Trans. on Image Signal Progress, vol.150, no. 1, 2003.
[24]Fernando, W.A.C., C.N. Canagarajah, and D.R. Bull,“A unified approach to scene change detection in uncompressed and compressed video,” IEEE Trans. on Consumer Electronics, Vol. 46, No. 3, pp. 769 –779, Aug. 2000.
[25]W. A. C. Fernando, C. N. Canagarajah, D. R. Bull. “Scene change detection algorithms for content-based video indexing and retrieval,” IEEE Electronics and Communications Engineering Journal, 13(3): 117-126,2001.
[26]Heng, WJ and Ngan, KN “Shot classification for hard transition,” IEEE International Symposium on Circuits and Systems, USA, Institute of Electrical and Electronic Engineers, Inc., 2: pp 321-324,2001.
[27]C.-L. Huang and B.-Y. Liao, “A robust scene change detection method for video segmentation,” IEEE Trans. on Circuits and Systems for Video Technology, Vol. 11, No. 12, pp. 1281-1288, Dec. 2001.
[28]Heng, WJ, and Ngan, KN “Shot Boundary Refinement for Long Transition,” IEEE Trans. on Multimedia, 4:4, pp 434-445, 2002.
[29]H. J. Zhang, C. Y. Low, S. W. Smoliar, and J. H. Wu. “ Video parsing, retrieval and browsing: An integrated and content-based solution,” Proc. of ACM Multimedia''95, Nov. 1995.
[30]G. Lupatini, C. Saraceno, R. Leonardi, “Scene Break Detection: A Comparison,” Proceedings of the Workshop on Research Issues in Database Engineering, p.34, 23-24,Feb. 1998.
[31]Boreczky, JS & Rowe, LA, “Comparison of video shot boundary detection techniques,” in Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases, pp. 170-179,1996
[32]Ullas Gargi, Rangachar Kasturi, Susan H. Strayer: “Performance characterization of video-shot-change detection methods,” IEEE Trans. Circuits Syst. Video Techn. 10(1): 1-13,2000.
[33]Gonzalez R, Woods R, “Digital Image Processing,” Addison-Wesley Publish Company,1993
[34]B. Yeo and B.Liu, "Rapid scene analysis on compressed video," IEEE Trans. on Circuits and Syst. for Video Tech, 1995.