臺灣博碩士論文加值系統

內容式影像擷取(Content-based image retrieval)已成為現今設計圖像資料庫(Image database)的趨勢。在此研究計劃中，我們結合了顏色(color)，形狀(shape)和空間關係(spatial relation)等數種特徵來做圖形相似性的索引和測量，以便從影像資料庫中快速的去擷取所求之影像，而所有以顏色為基礎的影像擷取方式，都有兩個必須解決的問題：一是顏色空間的選取，二是顏色解析度(resolution)的簡化以減低計算複雜度並加快圖形搜尋時的計算速度。因此，在此研究計劃中，我們研究並比較了數種廣泛地應用在電腦繪圖上的顏色空間(color space)，從中找出最好的顏色叢集，以便做到顏色的簡化既顏色叢集(color clustering)，另外， 根據顏色叢集的方法，我們提出一套自動產生圖形資料庫索引的機制，此索引機制可使圖形的過濾更有效率，自動的先為我們消去一堆主要不相關的圖形。而且，我們提出的 Seed-Filling 演算法可以精確的算出圖像中物件的形狀及空間的關係。除此之外，本研究也針對圖形的形狀作比對，我們提出了對圖形的形狀作正規化的演算法，使得圖形經由旋轉，縮放的情形下能做更精確的比對，不會有誤認同一張圖形為兩張不同的圖形這種情形發生。爾且，我們亦對物件的空間關係做了詳細的研究，藉由顏色的區塊，找出每個圖片中不同的物件，藉由每個物件他們之間的前後關係，去與另一張圖形所找出的前後關係，兩張相互做空間關係的比對，使得空間關係的計算能更加準確。然後結合上述三個的相似值，去計算資料庫中最相似的圖形，給予使用者選取，並讓使用者可以從中找出他想要的圖，讓系統做多次的學習，了解使用者真正的要求，使使用者可以找出更多他們所想要，更相近的圖形。最後，使用者可經由本系統所提供的圖形式使用者介面，如：繪圖、圖片、相似色等，以簡易的操作方式，輸入查詢的條件，快速地找出所求的圖像。

Content-based image retrieval has become more desirable for developing large image database. We propose a new method of retrieving images from an image database in this research plan. We combine the color, shape and spatial relation features of a picture to index and measure the similarity of images. For any color-based image retrieval system, the key issues are the selection of color space and reducing the resolutions of the color histograms in order to decrease the computing complexity and to increase the performance of similarity measurement. In this plan, several color spaces that widely used in computer graphic were discussed and compared for color clustering. In addition, we propose a new automatic indexing scheme of image database according to our clustering method, which could filter the image efficiently. As a technical contribution, a Seed-Filling like algorithm that could extract the shape and spatial relationship feature of image is proposed. Also, we propose a shape normalization algorithm to increase the precision of image retrieval. And, we extend temporal interval relation by means of a complete analysis for spatial computation of the image. Besides, the system is incorporated with a friendly graphic user interface, which allows the user to retrieval the image easily.

第一章 緒論 1-1
1.1 研究動機與目的 1-1
1.2 背景知識 1-4
1.3 系統架構 1-9
1.4 論文組織 1-11
第二章 前處理 2-1
2.1 在顏色方面 2-1
2.1.1顏色空間 2-2
2.1.2顏色空間之量化及正規化 2-6
2.2 在空間關係方面 2-10
2.3 兩者的整合 2-17
第三章 圖形資料庫 3-1
3.1 在資料庫中存放的內容 3-1
3.2 在資料庫中呈現的架構 3-3
3.3 在資料庫中搜尋的方法 3-4
第四章 相似度測量和比對方法 4-1
4.1 相似度測量 4-1
4.2 比對方法 4-4
第五章 系統實作與技術 5-1
5.1 功能介紹 5-2
5.2 實作技術 5-7
第六章 結論與未來研究方向 6-1
6.1 結論與貢獻 6-1
6.2 未來研究的方向 6-4
參考文獻 R-1
附錄Ａ 簡易使用手冊 A-1
A.1 系統簡介 A-1
A.2 操作方法 A-1
附錄Ｂ 英文論文 B-1
附錄Ｃ 相關之論文發表成果 C-1

[1]http://www.ee.ntu.edu.tw/www/faculty/sc-pei/pub-sc-pei.htm
[2]http://neural.cs.nthu.edu.tw/jang/
[3]M. Flicker, H. S. Saehney, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele and P. Yanker, "Query by Image and Video Content: The QBIC System,” IEEE Computers, Vol.28, No.9, pp.23~32, 1995.
[4]J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, and C. fe Shu, “The Virage image search engine: An open framework for image management,“ in Proc. SPIE Conf. On Vis. Commun, and Image Proc.
[5]A. Pentland, R. Picard, and S. Sclaroff, “Photobook: Content-based manipulation of image databases,” International Journal of Computer Vision, 1996.
[6]J. R. Smith and S, F, Chang, “VisualSEEK: a fully automated content-base image query system,” Proceeding of ACM International Conference Multimedia, Boston, MA, pp.87~98, November. 1996.
[7]Babu M. Mehtre, Mohan s. Kankanhalli and Wing Foon Lee, “Content-Based Image Retrieval Using a Composite Color-Shape Approach,” Information Processing & Management, Vol.34, No.1, pp.109~120, 1998.
[8]Cheng-Chia Chang, Jyh-Shing Roger Jang and Ling-Ling Wang, ”Color Image Retrieval Based on 2D Strings*,” Proceeding of Conference on Computer Vision, Graphics and Image Processing, Taipei, pp.1~8, 1998.
[9]Xia Wan and C.-C Jay Kuo, “Color Distribution Analysis and Quantization for Image Retrieval,” in SPIE storage an Retrieval for Image an Video Database IV, Vol. SPIE 2670, pp.9-16, Feb. 1996.
[10]Jia Wang, Wen-jann yang and Raj Acharya, ”Color Clustering Techniques for Color-Content-Based Image Retrieval from Image Databases,” Proceeding of IEEE International Conference on Multimedia Computing and Systems, ICMCS, pp.442~449, Jun 3-6. 1997.
[11]M.J. Swain and .H. Ballard, "Color index,” Internal Journal of Computer Vision, Vol.7, No.1, pp.11~32, 1991.
[12]Xia Wan and C.-C Jay Kuo,"A New Approach to Image Retrieval with Hierarchical Color Clustering,” IEEE Transaction on Circuit and Systems for Video Technology, Vol.8, No.5, pp.628~643, September 1998.
[13]Soo-Chang Pei an Hui-Lirng Shiue, “Indexing and Retrieval of Color Image Database,” Proceeding of Conference on Computer Vision, Graphics and Image Processing, Taipei, pp.196~199, 1998.
[14]Youping Niu, M. Tamer Ozsu and Xiaobo Li, ”2D-h Trees: An Index Scheme for Content-Base Retrieval of Image in Multimedia Systems,” Proceeding of IEEE International Conference on Intelligent Processing Systems, pp.1710~1715, October 28-31. 1997.
[15]D. Kapur, Y. N. Lakshman, and T. Saxena, "Computing invariants using elimination methods," in Proc. IEEE ,Int. Conf. on Image Proc., 1995.
[16]H. G. Barrow, "Parametric correspondence and chamfer matching: Two new techniques for image matching," in Proc 5th Int. Joint Conf. Artificial Intelligence, 1977.
[17]G. Borgefors, "Hierarchical chamfer matching: A parametric edge matching algorithm," IEEE Trans. Patt. Recog. and Mach. Intell., 1988.
[18]E. M. Arkin, L. Chew, D. Huttenlocher, K. Kedem, and J. Mitchell, "An efficiently computable metric for comparing polygonal shapes," IEEE Trans. Patt. Recog. and Mach. Intell., vol. 13, March 1991.
[19]G. C.-H. Chuang and C.-C. J. Kuo, "Wavelet descriptor of planar curves: Theory and applications," IEEE Trans. Image Proc., vol. 5, pp. 56-70, January 1996.
[20]B. Li and S. D. Ma, "On the relation between region and contour representation," in Proc. IEEE Int. Conf. on Image Proc., 1995.
[21]B. M. Mehtrc, M. Kankanhalli, and W. F. Lee, "Shape measures for content based image retrieval: A comparison," Information Processing & Management, vol. 33, no. 3, 1997.
[22]H. Wang, F. Guo, D. D. Feng and J. S. Jin, “A Signature for Content-Based Image Retrieval Using a Geometrical Transform,” in ACM Multimedia ’98 Proc., pp. 229-234, 1998.
[23]J. R. Parker, “Algorithms for Image Processing and Computer Vision,” John Wiley & Sons, Inc., pp. 291-298, 1997.
[24]Pentland, R. Picard, and S. Sclaroff, “Photobook: Content-based manipulation of image databases,” International Journal of Computer Vision, 1996.
[25]Gupta and R. Jain, “ Visual information retrieval,” communications of the ACM, vol. 40, no. 5, 1997.
[26]James F. Allen , “ Maintaining Knowledge about Temporal Intervals ” ,Communications of the ACM , Vol. 26 , No. 11 , 1983.
[27]Young Francis Day, et. al. ,“ Spatio-Temporal Modeling of Video Data for On-Line Object-Oriented Query Processing ,” in proceedings of the International Conference on Multimedia Computing and Systems, Washington DC,U.S.A., May 15-18 ,1995 , pp. 98-105 .
[28]John Z. Li, M. TamerOzsu, and Duane Szafron, “ Spatial Reasoning Rules in Multimedia Management Systems,”in proceedings of the 1996 Multimedia Modeling international conference (MMM¢96), Toulouse, France, November 12-15,1996,pp 119-133.
[29]Thomas D. C. Little and Arif Ghafoor, “ Spatio-Temporal Composition of Distributed Multimedia Objects for Value-Added Networks,” IEEE Computer, October 1991, pp. 42-50.
[30]Thomas D. C. Little and Arif Ghafoor “ Interval Based Conceptual Models for Time-Dependent Multimedia Data,” IEEE transactions on knowledge and data engineering , Vol. 5, No. 4,1993, pp. 551-563.
[31]Timothy K. Shih, Steven K. C. Lo, Szu-Jan Fu, and Julian B. Chang, “ Using Interval Temporal Logic and Inference Rules for the Automatic Generation of Multimedia Presentations,” in Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Hiroshima, Japan, June 17-23, 1996, pp. 425-428.
[32]Timothy K. Shih, Chin-Hwa Kuo, Huan-Chao Keh, Chao T. Fang-Tsou, and Kuan-Shen An, “ An Object-Oriented Database for Intelligent Multimedia Presentations,” in proceedings of the 1996 IEEE International Conference on Systems, Man and Cybernetics, Beijing, China, October 14-17, 1996.
[33]Michael Vazirgiannis, Yannis Theodoridis, and Timos Sellis “ Spatio-Temporal Composition in Multimedia Applications,” in proceedings of the International Workshop on Multimedia Software Development, March 25-26, Berlin, Germany, 1996, pp. 120-127.
[34]施威銘，“PC影像處理技術”，旗標資訊圖書公司
[35]Jarol Potts“Visual Basic4 Multimedia,”CORIOLIS GROUP BOOKS