臺灣博碩士論文加值系統

交通事故死亡率總是佔國內前十大死因之一，其中肇事原因之一是因為駕駛者精神不集中而發生交通意外。故許多學者積極地在車內裝設偵測眨眼頻率的設備，以便預測駕駛者的精神狀態，若是想打瞌睡的時候，趕緊發出警告喚醒駕駛者。
本論文的目的在於使用一般攝影設備拍攝駕駛中的駕駛者，克服光線變化的問題即時從影像中偵測駕駛者眨眼狀況，以應用於偵測駕駛者的精神狀態。在偵測駕駛者眨眼狀況的過程中，主要可分成四步驟：臉部偵測、眼睛偵測、眼睛追蹤與眨眼偵測。首先從輸入的影像中，結合不同來源的色度偵測膚色的區域，快速地擷取駕駛者的臉部，並且使用邊線的資訊修復這個臉部，之後使用橢圓的資訊找出臉部真正的位置。在偵測到駕駛者臉部後，依據人臉比率找出眼睛的範圍，並在這範圍內根據膚色的資訊、眼睛的特徵以及連續數張影像的輔助，準確偵測出駕駛者的眼睛部分。接著使用眼睛的形狀與位置，在連續影像中追蹤眼睛的位置，並且同時利用顏色的資訊判斷駕駛者的眨眼狀況。

Since car accidents may be caused by a driver's drowsiness, some assistance systems have been designed to warn the driver before he falls asleep. Such a system could monitor the driver’s eyes to detect blinking. If the blinking becomes to frequent or prolonged, then it may indicate drowsiness.
We propose a vision-based eye blinking detection system in this paper. Four steps, extracting a human face, detecting eye location, tracking the eyes and detecting blinking are developed for our system. Using a video camera mounted in the image of the driver’s face is first extracted based on skin color. Second, the location of the eyes of the driver is detected according to eye features. Third, we track the eyes’ location in next frame based on the shape and the location of human eyes relative to the face. Finally, we detect eye blinking of the driver. Our system has been tested during actual driving, and shows that it can be adapted to changing illumination while the car is in motion.

第一章、簡介
1.1 引言
1.2 文獻探討
1.2.1 臉部的偵測
1.2.2 眼睛的偵測
1.3 論文架構
第二章、系統架構
2.1 系統設置
2.2 系統運作
第三章、臉部偵測
3.1 截取膚色部位的方法
3.2 膚色部位截取
3.3 修復破碎膚色
3.4 計算近似橢圓
第四章、眼睛偵測
4.1 萃取眼睛帶
4.2 篩選眼睛候選者
4.3 擷取眼睛區塊
第五章、眼睛追蹤
5.1 眼睛追蹤
5.2 眨眼偵測
第六章、實驗結果
第七章、結論及未來方向
7.1 結論
7.2未來的方向

[Ada00] Y. Adachi, A. Imai, M. Ozaki and N. Ishii, “Extraction of Face Region by Using Characteristics of Color Space and Detection of Face Direction through an Eigenspace,” Proc. of 4th Int’l Conf. on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, vol. 1, pp. 393 -396, Aug. 2000.

[Bag04] A. M. Bagci, R. Ansari, A. Khokhar and E. Cetin “Eye tracking using Markov models,” Proc. of the 17th Int’l Conf. on Pattern Recognition, vol. 3, pp. 818 -821, Aug. 2004.

[Bir97] S. Birchfield, “An Elliptical Head Tracker,” Conference Record of the Thirty-First Asilomar Conf. on Signals, Systems & Computers, vol. 2, pp. 1710 -1714, Nov. 1997.

[Bir98] S. Birchfield, “Elliptical Head Tracking Using Intensity Gradients and Color Histograms,” Proc. of 1998 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 232 -237, Jun. 1998.

[Can02] J. L. Cantero, M. Atienza and R. M. Salas, “Human Alpha Oscillations in Wakefulness, Drowsiness Period, and REM Sleep: Different Electroencephalographic Phenomena within the Alpha Band,” Neurophysiol Clin 32:54–71, 2002.

[Cha99] D. Chai and K. N. Ngan, “Face Segmentation Using Skin-Color Map in Videophone Applications,”IEEE Trans on Circuits and Systems for Video Technology, vol. 9, no. 4, pp. 551-564, Jun. 1999.

[Che03] D. S. Chen and Z. K. Liu, “A Novel Approach to Detect and Correct Highlighted Face Region in Color Image,” Proc. Of IEEE Conf. on Advanced Video and Signal Based Surveillance, pp. 7 -12, Jul. 2003.

[Chi03] M. C. Chi, M. J. Chen, C. T. Hsu and J. W. Chen, “ROI Video Coding Based on H.263+ with Robust Skin-color Detection Technique,” IEEE Trans. on Consumer Electronics, vol. 49, no. 3, pp. 724 -730, Aug. 2003.

[Con02] C. Conceicao, R. Silva and R. Guerreiro, “Early Detection of Drowsiness Using a Neuro-fuzzy Detector,” Workshop on Biomedical Engineering 27 Setembro, pp. 82 -86, Dec. 2002.

[Din98] D. F. Dinges, M. M. Mallis, G. M. Maislin and J. W. Powell, “Evaluation of Techniques for Ocular Measurement as an Index of Fatigue and the Basis for Alertness Management,” Dept. Trans. Highway Safety, pub. 808 762, Apr. 1998.

[Dio03] J. J. de Dios and N. Garcia, “Face Detection Based on A New Color Space YCgCr,” Proc. of Int’l Conf. on Image Processing, vol. 3, pp. 909 -912, Sept. 2003.

[Esk03] A. Eskandarian and R. Sayed, “Driving Simulator Experiment: Detecting Driver Fatigue by Monitoring Eye and Steering Activity,” Proc. of NDIA Symp. on Annual Intelligent Vehicles Systems, Jun. 2003.

[Fan03] J. Fang and G. Qiu, “Human Face Detection Using Angular Radial Transform and Support Vector Machines, ” Proc. 2003 International Conference on Image Processing, vol. 1, pp. I - 669-72, Sep. 2003.

[Gra98] R. Grace, V. E. Byrne, D. M. Bierman, J.-M. Legrand, D. Gricourt, B. K. Davis, J. J. Staszewski and B. Carnahan, “A Drowsy Driver Detection System for Heavy Vehicles,” Proc. of AIAA/IEEE/SAE 17th DASC Conf. on Digital Avionics Systems, vol. 2, pp. I36/1 -I36/8, Oct. 1998.

[Hay02] T. Hayami, K. Matsunaga, K. Shidoji and Y. Matsuki, “Detecting Drowsiness while Driving by Measuring Eye Movement - a Pilot Study,” Proc. of IEEE 5th Int'l Conf. on Intelligent Transportation Systems, pp. 156 -161, Sep. 2002.

[Hor04] W. B. Horng, C. Y. Chen , Y. Chang and C. Hai Fan, “Driver Fatigue Detection Based on Eye Tracking and Dynamic, Template Matching,” Proc. of IEEE Int’l Conf. on Networking, Sensing and Control, vol. 1, pp. 7 -12, Mar. 2004.

[Hsu02] R.L. Hsu, A. M. Mottaleb and A. K. Jain, “Face Detection in Color Images,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 696 -706, May 2002.

[Hua03] W. Huang, C. W. Kwan, L.C. De. Silva “Eye Tracking with Statistical Learning and Sequential Monte Carlo Sampling,” Proc. of the Fourth Pacific Rim Conf. on Information, Communications and Signal, Proc. of the 2003 Joint Conf. of the Fourth Int’l Conf. on Multimedia, vol. 3, pp. 1873 -1878, Dec. 2003.

[Hua04] S. H. Huang and S. H. Lai, “Real-time Face Detection in Color Video, ” Proc. of 10th International Conference on Multimedia Modelling, pp. 338 -345, Jan. 2004.

[Ike03] O. Ikeda, “Segmentation of Faces in Video Footage Using HSV Color for Face Detection and Image Retrieval,” Proc. of 2003 Int’l Conf. on Image Processing, vol. 3, pp. III - 913-6, Sep. 2003.

[Ito02] T. Ito, S. Mita, K. Kozuka, T. Nakano and S. Yamamoto, “Driver Blink Measurement by the Motion Picture Processing and Its Application to Drowsiness Detection,” Porc. of IEEE 5th Int’l Conf. on Intelligent Transportation Systems, pp. 168 -173, Sep. 2002.

[Ji04] Q. Ji, Z. Zhu, P. Lan, “Real-time Nonintrusive Monitoring and Prediction of Driver Fatigue,” Trans. of IEEE on Vehicular Technology, vol. 53, no. 4, pp. 1052 -1068, Jul. 2004.

[Kuo03] C. J. Kuo, T. G. Lin, R. S. Huang, and S. F. Odeh, “Facial Model Estimation from Stereo/Mono Image Sequence,” IEEE Trans. on Multimedia, vol. 5,no. 1, pp. 8 -23, Mar. 2003.

[Lie04] M. Lievin and F. Luthon, “Nonlinear Color Space and Spatiotemporal MRF for Hierarchical Segmentation of Face Features in Video,” IEEE Trans. on Image Processing, vol. 13, no. 1, pp. 63 -71, Jan. 2004.

[Lin97] S. H. Lin, S. Y. Kung and L. J. Lin, “Face Recognition/Detection by Probabilistic Decision-based Neural Network,” IEEE Trans. on Neural Networks, vol. 8, no. 1, pp. 114 -132, Jan. 1997.

[Liu03] C. Liu and H. Y. Shum, “Kullback-Leibler Boosting,” Proc. of IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. I-587 -I-594, Jun. 2003.

[Lu03] X. Lu, N. Zheng and S. Zheng, “Linear Sparse Feature Based Face Detection in Gray Images,” Proc. 2003 International Conf. on Image Processing, vol. 3, pp. III - 889-92, Sep. 2003.

[Lv03] Y. X. Lv, Z. Q. Liu and X. H. Zhu, “Real-time Face Detection Based on Skin-color Model and Morphology Filters,” Conf. of 2003 Int’l on Machine Learning and Cybernetics, vol. 5, pp. 3203 -3207, Nov. 2003.

[Mar03] B. Martinkauppi, M. Soriano and M. Pietikainen, “Detection of Skin Color under Changing Illumination: A Comparative Study,” Proc. of 12th Int’l Conf. on Image Analysis and Processing, pp. 652 -657, Sep. 2003.

[Mit03] Y. Mitsukura, H. Takimoto, M. Fukumi and N. Akamatsu, “Face Detection and Emotional Extraction System Using Double Structure Neural Network,” Proc. of the International Joint Conference on Neural Networks, vol. 2, pp. 1253 -1257, Jul. 2003.

[Mor96] C. Moreno, M. Gou, E. K. Boukas and C. L. Nadeau, “Transparent Driver’s Drowsiness Detector: An Approach.” Montral: Centre de recherche sur les transports, 1996.

[Nak79] Y. Nakagawa and A. Rosenfeld, “Some Experiments on Variable Thresholding,” Pattern Recognition, vol. 11, pp. 191 -204, 1979.

[Nan04] H. Nanda and K. Fujimura, “A Robust Elliptical Head Tracker,” Proc. of Sixth IEEE Int’l Conf. on Automatic Face and Gesture Recognition, pp. 469 -474, May 2004.

[Ngu04] H. T. Nguyen and A. W. M. Smeulders, “Fast Occluded Object Tracking by A Robust Appearance Filter,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 1099 -1104, Aug. 2004.

[Niu03] D. Niu, Y. Z. Zhan and S. L. Song, “Research and Implementation of Real-time Face Detection, Tracking and Protection,” Conf. of 2003 Int’l on Machine Learning and Cybernetics, vol. 5, pp. 2765 -2770, Nov. 2003.

[Per01] C. A. Perez, A. Palma, C. A. Holzmann, and C.Pena, “Face and Eye Tracking Algorithm Based on Digital Image Processing,” IEEE Int’l Conf. on Systems, Man, and Cybernetics, 2001, Vol. 2, pp. 1178 -1183, Oct. 2001.

[Phi03] S. Phimoltares, C. Lursinsap and K. Chamnongthai “Tight Bounded Localization of Facial Features with Color and Rotational Independence,” Proc. of the 2003 Int’l Symp. on Circuits and Systems, vol. 5, pp. V-809 -V-812, May 2003.

[Pop03] J. C. Popieul, P. Simon and P. Loslever, “Using Driver's Head Movements Evolution as a Drowsiness Indicator,” Proc. of IEEE on Intelligent Vehicles Symposium, pp. 616 -621, Jun. 2003.

[Rui03]J. Ruiz-del-Solar, A. Shats, and R.Verschae, “Real-Time Tracking of Multiple Persons,” Proc. of 12th Int’l Conf. on Image Analysis and Processing, pp. 109 -114, Sep. 2003.

[Sab96] E. Saber and A. M. Tekalp, “Face Detection and Facial Feature Extraction Using Color, Shape and Symmetry-based Cost Functions,” Proc. of the 13th Int’l Conf. on Pattern Recognition, vol. 3, pp. 654 -658, Aug. 1996.

[Sil03] J. Sil and T. Srikanthan, “A Hybrid Approach to Designing An Autonomous Driving Alert System Using Geometrical Features and Gray Level Information of Face Images, ” Conf. of IEEE on Annual Technical, pp. 33 -38, Apr. 2003.

[Smi00] P. Smith, M. Shah and N. da Vitoria Lobo, “Monitoring Head/Eye Motion for Driver Alertness with One Camera,” Proc. of 15th Int'l Conf on Pattern Recognition, vol. 4, pp. 636-642, Sep. 2000.

[Sug96] F. Sugasawa, H. Ueno, M. Kaneda, J. Koreishi, R. Shirato and N. Fukuhara, “Development of Nissan's ASV,” Proc. of IEEE Symp. on Intelligent Vehicles, pp. 254 -259, Sep. 1996.

[Sun03] Z. Sun; G.Bebis,; R. Miller, “Boosting Object Detection Using Feature Selection,” Proc. of IEEE Conf. on Advanced Video and Signal Based Surveillance, pp. 290 -296, Jul. 2003.

[Tak03] I. Takai, K. Yamamoto, K. Kato, K. Yamada, and M. Andoh, “Robust Detection Method of the Driver’s Face and Eye Region for Driving Support System,” Proc. of 16th Int’l Conf. on Vision Interface, Halifax, Canada, pp. 148 -153, Jun. 2003.

[Uen94] H. Ueno, M. Kaneda and M. Tsukino, “Development of Drowsiness Detection System,” Proc. of Conf. on Vehicle Navigation and Information Systems, pp. 15 -20, Aug. 1994.

[Ver03] R. C. Verma, C. Schmid, and K. Mikolajczyk, “Face Detection and Tracking in A Video by Propagating Detection Probabilities,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1215 -1228, Oct. 2003.

[Vuc02] A. Vuckovic, V. Radivojevic, A. C. N. Chen and D. Popovic, “Automatic Recognition of Alertness and Drowsiness from EEG by An Artificial Neural Network,” Journal of Medical Engineering & Physics, vol. 24, no. 5, pp. 349 -360, Jun. 2002.

[Won03]K. W. Wong, K. M. Lam and W. C. Siu, “An Efficient Color Compensation Scheme for Skin Color Segmentation,” Proc. of the 2003 Int’l Sym. on Circuits and Systems for ISCAS '03., vol. 2, pp. II-676 -II-679, May 2003.

[Wu04] Y. Wu, H. Liu and H. Zha “A New Method of Detecting Human Eyelids Based on Deformable Templates,” IEEE Int’l Conf. on Systems, Man and Cybernetics, vol. 1, pp. 604 -609, Oct. 2004.

[Xia04] R. Xiao; M. J. Li and H. J. Zhang, “Robust Multipose Face Detection in Images, ” IEEE Trans. on Circuits and Systems for Video Technology, vol. 14, no. 1, pp. 31 -41, Jan. 2004.

[Yan02] M. H. Yang, D. J. Kriegman, and N. Ahuja, “Detecting Faces in Images: a Survey,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 34 -58, 2002.

[Zha03] Y. Zhao and T.-S.Chua, “Automatic Tracking of Face Sequences in MPEG Video,” Proc. of Computer Graphics International, pp. 170 -175, Jul. 2003.

[Zha04] S. C. Zhang and Z. Q. Liu, “A real-time Face Detector,” IEEE Int’l Conf. on Systems, Man and Cybernetics, vol. 3, pp. 2197 -2202, Oct. 2004.

[Zha05] S. C. Zhang and Z. Q. Liu, “A Robust, Real-time Ellipse Detector,” Pattern Recognition, vol. 38, no. 2, pp. 273 -287, Feb. 2005.

[Zhu03] Y. Zhu, K. Fujimura, “Driver Face Tracking Using Gaussian Mixture Model(GMM) ,” Proc. of IEEE on Intelligent Vehicles Symposium, pp. 587 -592, Jun. 2003.