臺灣博碩士論文加值系統

近年來，全球人口趨於老年化，自動偵測居家跌倒行為成為一個相當重要的議題。在本論文中，藉由二維影像萃取特徵的方式，解析彩色影像中的虛擬高度、物件外形、物件特徵點的多維特徵，搭配學習的演算法—隱藏式條件機率域(Hidden Conditional Radom Fields)，來辨識家庭中常有的行為，如走路、坐下、蹲下、跌倒。尤其是分辨出類跌倒的坐下、蹲下與跌倒，三個確切類別。
藉由二維影像萃取特徵的特徵，總共可以分成三類，第一類是擷取人在畫面中的陰影以預測虛擬高度；第二類是使用GIST描述人的外觀輪廓；第三類是使用空間金字塔匹配(Spatial Pyramid Matching)描述人的外觀特徵點。採用隱藏式條件隨機場的架構融合三種特徵，並且考慮到特徵於序列間的前後關係，加強各類別影像序列的識別準確率。本論文還比較了隱藏式馬可夫模型(Hidden Markov Model)、稀疏時空特徵(Cuboids)於跌倒與非跌倒的行為辨識。其辨識率與二者相比都有不錯的表現。

In recent years, the global population has begun to age rapidly. Automatic fall detection for senior citizens has become an important issue for smart home. In this research, we propose a novel video-based human fall detection system that can detect a human fall in real-time with a high detection rate. This fall detection system is based on Hidden Conditional Random Fields model, and an intelligent combination of height estimation and appearance cues. Our system can efficiently distinguish “fall-down incidents” from “fall-like incidents” such as sit-down and squat. Experimental results indicate that the proposed human fall detection system can achieve a high detection rate and low false alarm rate. Also, the proposed system outperforms Hidden Markov Chain and Cuboids in terms of detection rate.

摘要 I
ABSTRACT II
致謝 III
目錄 IV
圖目錄 VII
表目錄 IX
第一章 緒論 1
1.1 研究動機與目的 1
1.2 文獻探討 2
1.3 章節安排 4
第二章 研究背景 5
2.1 支持向量機(SUPPORT VECTOR MACHINES –SVM) 5
2.2 隱藏式馬可夫模型(HIDDEN MARKOV MODEL -- HMM) 8
第三章 影像辨識架構與演算法 12
3.1 系統架構 12
3.2 前背景分離與物件陰影切割 13
3.2.2 虛擬高度(Virtual Height) 19
3.3 物件外形特徵 23
3.3.1 GIST_SVM 物件外形描述符 23
3.3.2 Spatial Pyramid Matching _SVM物件外觀特徵點描述符 25
3.4 行為分類器—隱藏式條件隨機場(HIDDEN CONDITIONAL RANDOM FIELDS) 28
第四章 實驗 32
4.1 DATASET 與使用平台簡介 32
4.2 單張影像的姿態辨識效能比較 32
4.3 影像辨識演算法比較 40
4.3.1 各行為類別辨識率比較 41
4.3.2 跌倒-非跌倒辨識率比較 45
第五章 結論 47
參考文獻 48
附錄一 50
附錄二 51
附錄三 52
附錄四 53
附錄五 54
附錄六 55
附錄七 56
附錄八 57

[1] A. Quattoni, S. Wang, L. P. Morency, M. Collins, and T. Darrell, "Hidden conditional random fields," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, pp. 1848-1853, Oct 2007.
[2] Piotr Doll′ar, Vincent Rabaud, Garrison Cottrell,and Serge Belongie “Behavior Recognition via Sparse Spatio-Temporal Features” IEEE VSPETS, pp. 65 – 72, 2005.
[3] G. Willems, T. Tuytelaars, and Luc Van Gool "An Efficient Dense and Scale-Invariant Spatio-Tempal Interest Point Detector," European Conf. Computer Vision, 2008.
[4] Ronald Poppe "A survey on vision-based human action recognition" Image and Vision Computing 28 (2010) 976–990
[5] S. Lazebnik, C. Schmid, and J. Ponce, "Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories," IEEE Computer Vision and Pattern Recognition, Page(s): 2169 - 2178 , 2006.
[6] Alexei A. Efros, Alexander C. Berg, G. Mori, Jitendra Malik “Recognizing Action at a Distance” ICCV, vol.2, pp. 726-733, 2003.
[7] A. Oliva and A. Torralba, “Building the Gist of a Scene: The Role of Global Image Features in Recognition,” Progress in Brain Research: Visual perception, vol. 155, pp. 23-36, June 2006.
[8] T. Ojala , M. Pietikäinen ,“Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns” IEEE Transactions Pattern Analysis and Machine Intelligence VOL.24 NO.7 JULY 2002.
[9] W. Wu, A. Y. C. Chen, L. Zhao, and J. J. Corso, "Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features," International Journal of Computer Assisted Radiology and Surgery, vol. 9, pp. 241-253, Mar 2014.
[10] J. G. Liu, J. B. Luo, and M. Shah, “Recognizing Realistic Actions from Videos in the Wild”, IEEE Computer Vision and Pattern Recognition, pp. 1996-2003, 2009
[11] I. Laptev, "On space-time interest points," International Journal of Computer Vision, vol. 64, pp. 107-123, Sep 2005.
[12] V. Syrris, V. Petridis “A lattice-based neuro-computing methodology for real-time human action recognition” Information Sciences 181 (2011) 1874–1887
[13] L. Zelnik-Manor, M. Irani “Event-Based Analysis of Video” In CVPR, pageII:123-130, 2001
[14] T. Horprasert, D. Harwood, and L.S. Davis, “A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection ” Proc. IEEE Int’l Conf. Computer Vision, Frame Rate Workshop, pp. 1-19, 1999
[15] E. Auvinet, F. Multon, A. Saint-Arnaud, J. Rousseau, and J. Meunier, "Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution," IEEE Transactions on Information Technology in Biomedicine, vol. 15, pp. 290-300, Mar 2011.
[16] A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, pp. 257-267, Mar 2001.
[17] P. Guo and Z. Miao, "Motion description with local binary pattern and motion history image: Application to human motion recognition," in Proc. of IEEE Int. Workshop on Haptic Audio Visual Environments and Games, Oct. 2008, pp. 171–174..
[18] B. C. Ko, S. H. Kim, and J. Y. Nam, "X-ray Image Classification Using Random Forests with Local Wavelet-Based CS-Local Binary Patterns," Journal of Digital Imaging, vol. 24, pp. 1141-1151, Dec 2011.
[19] W. L. Lao, J. G. Han, and P. H. N. de With, "Automatic Video-Based Human Motion Analyzer for Consumer Surveillance System," Ieee Transactions on Consumer Electronics, vol. 55, pp. 591-598, May 2009.
[20] O. Barnich and M. Van Droogenbroeck “ViBe: A universal background subtraction algorithm for video sequences,” In IEEE Transactions on Image Processing, 20(6):1709-1724, June 2011.
[21] Y. Mu and T. B. Z. Shuicheng Yan ; Yi Liu ; Huang, "Discriminative local binary patterns for human detection in personal album," presented at the Computer Vision and Pattern Recognition, Anchorage, AK, 2008 , pp.1-8.
[22] N. Thome, S. Miguet, and S. Ambellouis, "A Real-Time, Multiview Fall Detection System: A LHMM-Based Approach," Ieee Transactions on Circuits and Systems for Video Technology, vol. 18, pp. 1522-1532, Nov 2008.
[23] T. Ahonen, A. Hadid, and M. Pietikainen, “Face Description with Local Binary Patterns: Application to Face Recognition”, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp.2037-2041, Dec. 2006.
[24] C. C. Chang, C. J. Lin “LIBSVM – A Library for Supprt Vector Machines,” http://www.csie.ntu.edu.tw/~cjlin/libsvm/ , April 1, 2014.
[25] Z. X. Lin, “Introduction to Support Vector Machines, ” http://www.cmlab.csie.ntu.edu.tw/~cyy/learning/tutorials/SVM2.pdf