臺灣博碩士論文加值系統

眨眼的資訊顯示一個人的疲勞程度，眨眼的偵測可用於監控或警
示系統，例如當駕駛員太過勞累時提出警告可以避免車禍的發生。本
論文將提出一套快速的人眼定位以及眨眼偵測演算法，適用於複雜背
景以及受測者戴眼鏡的情況。我們首先利用膚色的資訊對全圖做出膚
色遮罩，然後以形態學運算填補膚色遮罩中的缺陷，由填補後的遮罩
計算出人臉範圍區塊，在此範圍中經由水平投影的統計配合人臉的特
徵算出眼睛的位置。經由眼睛範圍內深色點數變化量的統計，我們標
記出眨眼的時間點。

The information about eye blinks shows one’s fatigue. Detecting
blink is useful to monitoring system or warning system. Automatically
detecting fatigue of drivers may save them from accidents. We propose a
fast algorithm for eye location and eye blink detection. This algorithm is
adapted to the complex background and the situation which people wear
glasses. In the first place, we classify pixels as skin color and non-skin
color to build a skin mask of original image. Second, we patch the skin
mask with morphological operations and locate the face bounding block.
Applying horizontal projection to the bounding block and filtering with
face feature conditions, we locate eye region. After gathering statistics of
pixels in eye region, we can find out which frames contain eye blinks.

[1] R.L. Hsu, M. Abdel-Mottaleb, and A.K. Jain, ”Face Detection in
Color Images,” IEEE Trans. on Pattern Analysis and Machine
Intelligence, Vol. 24, No. 5, pp. 696-706, 2002.
[2] Z. Zhu, Q. Ji, “Robust real-time eye detection and tracking under
variable lighting conditions and various face orientations,” Computer
Vision and Image Understanding, Vol. 98, Issue 1, pp. 124-154, April,
2005.
[3] Q. Ji, “3D Face pose estimation and tracking from a monocular
camera,” Image and Vision Computing, Vol. 20, Issue 7, pp. 499-511,
May 1, 2002.
[4] S. Kawato, N. Tetsutani, “Detection and tracking of eyes for
gaze-camera control,” Image and Vision Computing, Vol. 22, Issue
12, pp. 1031-1038, October 1, 2004.
[5] X. Xie, R. Sudhakar, and H. Zhuang, “On improving eye feature
extraction using deformable templates,” Pattern Recognition, Vol.
27 ,pp. 791–799, 1994.
[6] M. Kampmann, L. Zhang, “Estimation of eye, eyebrow and nose
features in videophone sequences,” Int. Workshop on Very Low
Bitrate Video Coding (VLBV 98), Urbana, USA, 1998.
[7] G.C. Feng, P.C. Yuen, “Variance projection function and its
application to eye detection for humanface recognition,” Int. Conf.
Computer Vision, Vol. 19, pp. 899–906, 1998.
[8] T.N. Bhaskar, F.T. Keat, S. Ranganath, and Y.V. Venkatesh, “Blink
detection and eye tracking for eye localization,” TENCON 2003 Conf.
on Convergent Technologies for Asia-Pacific Region, Vol. 2, 15-17,
pp. 821-824, October, 2003.
[9] S. Kawato, J. Ohya,” Real-time detection of nodding and
head-shaking by directly detecting and tracking the between-eyes,”
Proc. 4th IEEE Int. Conf. on Automatic Face and Gesture
Recognition, pp. 40–45, 2000.
[10] S. Kawato, N. Tetsutani, “Real-time detection of between-the-eyes
with a circle frequency filter,” Proc. ACCV2002, Vol. 1, pp. 442–447,
2002.
26
[11] S. Kawato, J. Ohya, “Two-step approach for real-time eye tracking
with a new filtering technique,” 2000 IEEE Int. Conf. on Systems,
Man, and Cybernetics, Vol. 2, 8-11, pp. 1366-1371, October 2000.
[12] Q. Ji, X. Yang, ”Real time visual cues extraction for monitoring
driver vigilance,” Proc. Int. Workshop on Computer Vision Systems,
Vancouver, Canada, 2001.
[13] Y. Ebisawa, S. Satoh, “Effectiveness of pupil area detection
technique using two light sources and image difference method,”
Proc. the 15th Annual Int. Conf. of the IEEE Eng. In Medicine and
Biology Society, San Diego, CA, pp. 1268-1269, 1993.
[14] Y. Ebisawa, “Improved video-based eye-gaze detection method,
“ IEEE Trans. Instrument. Meas. 47 (2), pp. 948–955, 1998.
[15] C. Morimoto, D. Koons, A. Amir, and M. Flickner, “Pupil detection
and tracking using multiple light sources,” Technical Report
RJ-10117, IBM Almaden Research Center, 1998.
[16] C. Morimoto, M. Flickner, “Real-time multiple face detection using
active illumination,” Proc. fourth IEEE Int. Conf. on Automatic Face
and Gesture Recognition 2000, Grenoble, France, 2000.
[17] A. Haro, M. Flickner, and I. Essa. “Detecting and tracking eyes by
using their physiological properties, dynamics, and appearance,”
Proc. IEEE CVPR 2000, Hilton Head Island, South Carolina, 2000.
[18] R. Bartoszynski and M. Niewiadomska-Bugaj, Probability and
Statistical Inference, Wiley Inter. Science.
[19] K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd
Edition, Academic Press.
[20] R.C. Gonzalez and R.E. Woods, Digital Image Processing, 2nd
Edition, Prentice Hall.
[21] T. Kawaguchi, D. Hidaka, and M. Rizon, “Detection of Eyes from
Human Faces by Hough Transform and Separability Filter,” Proc. Int.
Conf. on Image Processing, Vol. 1, 10-13, pp. 49-52, September 2000.