臺灣博碩士論文加值系統

在本篇論文中，我們提出一演算法，使其能夠在一張人臉影像中偵測眼睛的位置，並且在該人臉有戴眼鏡時，去除眼鏡的干擾。此系統包含三個模組：臉部位置偵測，眼睛偵測，以及當受測者有戴眼鏡時，去除眼鏡的方法。首先，我們使用通用膚色圖偵測臉部區域，以確保在周遭光源條件變化時，仍有足夠的適應性。接著，採用在臉部傾向及旋轉上有良好不變性的環狀頻率濾波器，偵測眼睛區域。最後，由於眼鏡的普遍使用，提出以邊緣偵測及改良的模糊規則型式的濾波器，預測眼鏡區域的像素值。結果顯示，我們提出的方法在眼睛偵測是有效率的，並且在眼鏡去除上也能得到良好的品質。

This thesis addresses an algorithm to automatically detect the eye location from a given face image and remove the glasses while one has worn. Our system consists of three modules: face segmentation, eye detection, and eyeglasses removal while one has worn on eyeglasses. First, we use the universal skin-color map to detect the face regions, which can ensure sufficient adaptability to ambient lighting conditions. Then, a special filter, called circle-frequency filter, is used to locate the eye regions because of its invariant characteristic in wide face orientations and rotations. Finally, for the widely using of glasses, we proposed a novel method to remove the eyeglasses automatically based on edge detection and modified fuzzy rule-based (MFRB) filter. The simulation and results demonstrate that our approach detects eye location efficiently and demonstrates high fidelity to the non-wearing-glasses facial image after glasses removal.

摘要 ………………………………….……………………………………………… i
ABSTRACT ………………………………………………………………………… ii
ACKNOWLEDGEMENT ………………………………………………………… iii
CONTENTS ………………………………………………………………….…….. iv
LIST of FIGURES ………………………………………………………….……… vi
LIST of TABLES …………………………………………………………………. viii

CHAPTER 1 INTRODUCTION ………………………………………………... 1
1.1 Motivation of This Research ……………………………………………........ 1
1.2 Face Detection ……………………………………………………………….. 2
1.3 Eye Location ……………………………………………………………….... 4
1.4 Glasses Existence Detection and Glasses Removal …………………………. 5
1.5 Flowchart of Eye Detection and Glasses Removal System …………….…… 6
1.6 Thesis Outline …………………………………………………..…………… 7

CHAPTER 2 FACE SEGMENTATION ………………………………………. 10
2.1 Introduction ………………………………………………………………… 10
2.2 Color Analysis ……………………………………………………………… 11
2.3 Face Segmentation Algorithm ……………………………………………… 13

CHAPTER 3 EYE DETECTION and GLASSES REMOVAL ..….………….. 23
3.1 Introduction to Eye Detection ….………………………………………....... 23
3.2 Circle-Frequency Filter …………………………………………………….. 24
3.3 “Between-Eyes” Candidate Evaluation …………………………………..… 26
3.4 Tracking “Between-Eyes” ………………………………………………….. 27
3.5 Glasses Existence Detection ……………………………………………...… 28
3.6 Eye Location While Wearing Glasses …………………………………….... 29
3.7 Glasses Removal ………………………………………………………….... 30

CHAPTER 4 SIMULATION and RESULTS ……………………………….… 39
4.1 Non-Wearing Glasses Cases ……………………………………………...… 39
4.2 Wearing Glasses Cases ……………………………………………………... 44

CHAPTER 5 CONCLUSION ………………………………………………….. 52

REFERENCES ………………………………………………………………….… 54

[1] E. Hjelmas and B. K. Low, “Face detection: A survey,” Computer Vision and Image Understanding, vol. 83, pp. 236–274, 2001.

[2] D. Chai and K. N. Ngan, “Face segmentation using skin-color map in videophone applications,” IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 551–564, 1999.

[3] R. L. Hsu, M. A. Mottaleb, and A. K. Jain, “Face detection in color images,” IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 696–706, 2002.

[4] H. Wu, Q. Chen, and M. Yachida, “Face detection from color images using a fuzzy pattern matching method,” IEEE Trans. Pattern Anal. Machine Intell., vol. 21, pp. 557–563, 1999.

[5] J. Yang and A. Waibel, “A real-time face tracker,” in Proc. 3rd IEEE Workshop on Application of Computer Vision, 1996, pp. 142–147.

[6] R. Féraud, O. J. Bernier, J. E. Viallet, and M. Collobert, “A fast and accurate face detection based on neural network,” IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 42–53, 2001.

[7] D. Maio and D. Maltoni, “Real-time face location on gray-scale static images,” Pattern Recognition, vol. 33, pp. 1525–1539, 2000.

[8] C. Garcia and G. Tziritas, “Face detection using quantized skin color regions merging and wavelet packet analysis,” IEEE Trans. Multimedia, vol. 1, pp. 264–27, 1999.

[9] K. K. Sung and T. Poggio, “Example-based learning for view-based human face detection,” IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 39–51, 1998.

[10] K. C. Yow and R. Cipolla, “Feature-based human face detection,” Image and Vision Computing, vol. 15, pp. 713–735, 1997.

[11] S. A. Sirohey and A. Rosenfeld, “Eye detection in a face image using linear and nonlinear filters,” Pattern Recognition, vol. 34, pp. 1367–1391, 2001.

[12] G. C. Feng and P. C. Yuen, “Multi-cues eye detection on gray intensity image,” Pattern Recognition, vol. 34, pp. 1033–1046, 2001.

[13] R. Thilak Kumar, S. Kumar Raja, and A. G. Ramakrishnan, “Eye detection using color cues and projection functions,” in Proc. IEEE Int. Conf. Image Processing, 2002, vol. 3, pp. 24–28.

[14] Z. Liu, X. He, J. Zhou, and G. Xiong, “A novel method for eye region detection in gray-level image,” in Proc. IEEE Int. Conf. Communications, Circuits and Systems and West Sino Expositions, 2002, vol. 2, pp. 1118–1121.

[15] S. Kawato and J. Ohya, “ Two-step approach for real-time eye tracking with a new filtering technique,” in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2000, vol. 2, pp. 1366–1371.

[16] X. Jiang, M. Binkert, B. Achermann, and H. Bunke, “Towards detection of glasses in facial images,” in Proc. 14th Int. Conf. Pattern Recognition, 1998, vol. 2, pp. 1071–1073.

[17] Z. Jing and R. Mariani, “Glasses detection and extraction by deformable contour,” in Proc. 15th Int. Conf. Pattern Recognition, 2000, vol. 2, pp. 933–936.

[18] C. Wu, C. Liu, H. Y. Shum, Y. Q. Xu, and Z. Zhang, “Automatic eyeglasses removal from face images,” in Proc. 5th Asia Conf. Computer Vision, 2002, pp. 23–25.

[19] J. Y. Cheng and S. M. Lu, “Image blocking artifact suppression by the modified fuzzy rule-based filter,” in Proc. IEEE Int. Conf. Syst., Man., Cybern., 2003, vol. 1, pp. 486–491.

[20] J. Fan, D. K. Y. Yau, A. K. Elmagarmid, and W. G. Aref, “Automatic image segmentation by integrating color-edge extraction and seeded region growing,” IEEE Trans. Image Processing, vol. 10, pp. 1454–1466, 2001.

[21] J. Fan, R. Wang, L. Zhang, D. Xing, and F. Gan, “Image sequence segmentation based on 2-D temporal entropy,” Pattern Recognition Lett., vol. 17, pp. 1101–1107, 1996.

[22] K. Arakawa, “Fuzzy rule-based signal processing and its application to image restoration,” IEEE J. Select. Areas Commun., vol. 12, pp. 1495–1502, 1994.