臺灣博碩士論文加值系統

一家企業是否會成功，成功的要素很大一部分歸咎於「人才」。「企業要的不是最優秀的人才，而是最合適的夥伴」說明好人才除了具備專業能力之外，人格特質也要符‬合公司的企業文化，能讓企業投入的資源有所價值，並按照企業規劃的中長期計劃來進行發展。本論文研究如何在第一階段篩選履歷時，根據面試者所拍攝的影片提取影像和音頻特徵來預測應徵者其五大人格特質。我們的研究比較起基於單一影像或聲音的資料所做的模型更為準確。我們的研究能讓面試官有更多參考資訊且更精準地判斷出應徵者性格是否符合企業文化及應聘職務。‬

Whether a company will succeed or not, a large part of the success factor is human resource management. "What an enterprise wants is not the best talents, but the most suitable partners." ‪It‬ shows that the ‪good talents not only have professional abilities, but also meet the personality traits.‬ The good talents make the resources invested by the company valuable, and develop in accordance with the long-term ‪processes‬ of the company's planning. We extract visual and voice features from interview videos to predict the five major personality traits of candidates during the first stage of screening resumes. Our ‪proposed method‬ is more accurate than models using only a single image or voice data‪ supported‬. Our research allows interviewers to have more reference information and more accurately determine whether the applicant's personality fits the culture and job position.

誌謝 i
中文摘要 ii
英文摘要 iii
目錄 iv
圖目錄 vi
表目錄 vii
第壹章 緒論 01
第一節 研究背景與動機 01
第二節 研究目的 02
第三節 研究貢獻 03
第貳章 文獻回顧 04
第一節 第一印象 04
第二節 人格特質 06
第三節 五大人格 07
第四節 人臉辨識 08
第五節 語音辨識 09
第六節 視覺模式分析-卷積神經網路10
第七節 音頻模式分析 13
第參章 研究方法 16
第一節 研究架構 17
第二節 評估模型 19
第肆章 研究分析 20
第一節 資料來源 20
第二節 原始資料分析 20
第三節 實驗結果評估 28
第伍章 結論與建議 31
參考文獻 33

一、中文文獻
王小川 (2004) 語音訊號處理，全華科技圖書公司。
許智威 (2009) 人臉特徵與個性之分析，淡江大學資訊工程學系碩士在職專班碩士論文。
張春興 (2000) 現代心理學，東華書局。
陳明熒 (1994) PC電腦語音辨認實作，旗標出版公司。
陳松琳 (2002) 以類神經網路為架構之語音辨識系統，國立中山大學電機工程學系碩士論文。
陳種成 (2009) 人臉追蹤與語音辨識應用於移動式機器人之研究，國立勤益科技大學電子工程係研究所碩士論文。
楊煒達 (2007) 簡易方法之少量人臉辨識系統，國立中央大學資訊工程研究所碩士論文。
劉傳仁 (2012) 人格特質對工作績效之影響-以工作特性為干擾變數，中原大學企業管理學系碩士論文。
簡浩揚 (2021) 基於深度學習聲音辨識之技術研究與應用，國立東華大學資訊工程學系碩士論文。

二、英文文獻
Alam, F. and Riccardi, G. (2014) Predicting Personality Traits Using multimodal information. In Proceedings of the 2014 ACM Multi Media on Workshop on Computational Personality Recognition: 15-18.

Alam, F., Stepanov, E. A. and Riccardi, G. (2013) Personality Traits Recognition on Social Network-Facebook. Proceedings of the International AAAI Conference on Web and Social Media, 7(2): 6-9.

Allport, G. W. (1973) Attitude in the History of Social Psychology. Neil Warren and Marie Jahoda (Ed). Attitude, Harmondsworth: Penguin Books Ltd.

Allport, G. W. and Odbert, H. S. (1936) Trait Names: A Psycholexical Study. Psychological Monographs, 47(211): 1-171.

Belhumeur, P. N., Hespanha, J. P. and Kriegman, D. J. (1997) Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Transaction on Pattern Analysis and Machine Intelligence, 19(7): 711-720.

Bendiksen, A. and Steiglitz, K. (1990) Neural Networks for Voiced / Unvoiced Speech Classification, IEEE International Conference on Acoustics, Speech and Signal Processing, 1(90): 521-524.

Biel, J.-I., Teijeiro-Mosquera, L. and Gatica-Perez, D. (2012) Facetube: Predicting Personality from Facial Expressions of Emotion in Online Conversation Video. In ICMI: 53-56.

Brunelli, R. and Poggio, T. (1993) Face Recognition: Feature versus Templates. IEEE Transaction on Pattern Analysis and Machine Intelligence, 15(10): 1042-1052.

Cattell, R. B. (1943) The Description of Personality: Basic Trait Resolved into Clusters. Journal of Abnormal and Social Psychology, 38: 476-506.

ChaLearn (2017) First Impressions V2 (CVPR’17) Dataset. http://chalearnlap.cvc.uab.es/dataset/24/description, accessed: 2019-04-30.

Costa, P. T. and McCrae, R. R. (1992) The Five-Factor Model of Personality and Its Relevance to Personality Disorders. Journal of Personality Disorders, 6: 343-359.

Digman, J. M. (1990) Personality Structure: Emergence of The Five-Factor Model. Annual Review of Psychology, 41: 417-440.

Fukushima, K. (1980) Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position. Biological Cybernetics, 36(4): 193-202.

Goldberg, L. R. (1981) Language and Individual Differences: The Search for Universals in Personality Lexicons. Review of Personality and Social Psychology, 2: 141-165.

Gucluturk, Y., Guclu, U., Gerven, M. A. J. van and Lier, R. van (2016) Deep Impression: Audiovisual Deep Residual Networks for Multimodal Apparent Personality Trait Recognition. ECCV ChaLearn Workshop: 1-10.

G¨urpınar, F., Kaya, H. and Salah, A. A. (2016) Combining Deep Facial and Ambient Features for First Impression Estimation. In Proceedings of the European Conference on Computer Vision, Ser. ECCV ’16. Springer: 372-385.

Heisele, B., Ho, P., Wu, J. and Poggio, T. (2003) Face Recognition: Component-Based versus Global Approaches. Computer Vision and Image Understanding, 91(1): 6-12.

Hubel, D. H., and Wiesel, T. N. (1959) Receptive Fields of Single Neurons in the Cat's Striate Cortex. Journal of Physiology, I48: 574-591.

Ilmini, K. and Fernando, T. G. I. (2016) Persons Personality Traits Recognition Using Machine Learning Algorithms and Image Processing Techniques. Advances in Computer Science: An International Journal, 5(1): 40-44.

Ji, S., Xu, W., Yang, M. and Yu, K. (2013) 3D Convolutional Neural Networks for Human Action Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35: 221–231.

Junior, J. C. J., Güçlütürk，Y., P'erez M. A., Güçlü，U., Bar'o, X., Escalante, H., Guyon, I., Gerven, M. V., Lier, R. V. and Escalera, S. (2019) First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysis. IEEE Transactions on Affective Computing, 99: 1-21.

Madzlan, N., Han, J., Bonin, F. and Campbell, N. (2014) Towards Automatic Recognition of Attitudes: Prosodic Analysis of Video Blogs. Speech Prosody, Dublin, Ireland: 91–94.

Moghaddam, B. and Pentland, A. (1994) Face Recognition Using View-Based and Moudlar Eigenspaces. Automatic Systems for the Identification and Inspection of Humans, SPIE, 2277: 1-7.

Norman, W. T. (1963) Toward and Adequate Taxonomy of Personality Attributes: Replicated Factor Structure. Journal of Abnormal and Social Psychology, 66: 574-583.

Nowson S. and Gill, A. J. (2014) Look! Who’s Talking? Projection of Extraversion Across Different Social Contexts. In Proceedings of the 2014 ACM Multi Media on Workshop on Computational Personality Recognition: 23-26.

Peabody, D. (1987) Selecting Representative Trait Adjective. Journal of Personality and Social Psychology, 52: 59-77.

P´erez-Rosas, V., Abouelenien, M., Mihalcea, R. and Burzo, M. (2015) Deception Detection Using Real-Life Trial Data. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, ACM: 59-66.

Pianesi, F., Mana, N., Cappelletti, A., Lepri, B. and Zancanaro, M. (2008) Multimodal Recognition of Personality Traits in Social Interactions. In Proceedings of the 10th International Conference on Multimodal Interfaces, Ser. ICMI ’08. ACM: 53-60.

Ponce-L´opez,V., Chen B., Oliu, M., Corneanu, C., Clap´es, A., Guyon, I., Bar´o, X., Escalante, H. J. and Escalera, S. (2016) ChaLearn Lap 2016: First Round Challenge on First Impressions-Dataset and Results. In Proceedings of the European Conference on Computer Vision, Ser. ECCV ’16. Springer: 400-418.


Qin, R., Gao, W., Xu, H. and Hu, Z. (2016) Modern Physiognomy: An Investigation on Predicting Personality Traits and Intelligence from the Human Face. Science China Information Sciences, 61: 1-3.

Sarkar, C., Bhatia, S., Agarwal, A. and Li, J. (2014) Feature Analysis for Computational Personality Recognition Using Youtube Personality Data Set. In Proceedings of the 2014 ACM Multi Media on Workshop on Computational Personality Recognition: 11-14.

Subramaniam, A., Patel, V., Mishra, A., Balasubramanian, P. and Mittal, A. (2016) Bi-Modal First Impressions Recognition Using Temporally Ordered Deep Audio and Stochastic Visual Features. In book: Computer Vision - ECCV 2016 Workshops: 337-348.

Todorov, A. and Porter, J. (2014) Misleading First Impressions Different for Different Facial Images of the Same Person. Psychological Science, 25(7): 1404-1417.

Todorov, A., Said, C. and Verosky, S. (2012) Personality Impressions from Facial Appearance. Oxford Handbook of Face Perception.

Tran, D., Bourdev, L., Fergus, R., Torresani, L. and Paluri, M. (2015) Learning Spatiotemporal Features with 3D Convolutional Networks. In: Proceedings of the IEEE International Conference on Computer Vision: 4489-4497.

Trapnell, P. D. and Wiggins, J. S. (1990) Extension to the Interpersonal Adjectives Scales to Include the Big Five Dimension of Personality. Journal of Personality and Social Psychology, 59(4): 781-790.

Tupes, E. C. and Christal, R. E. (1992) Recurrent Personality Factors Based on Trait Ratings. Journal of Personality, 60: 225-251.

Valente, F., Kim, S. and Motlicek, P. (2012) Annotation and Recognition of Personality Traits in Spoken Conversations from the AMI Meetings Corpus. In Thirteenth Annual Conference of the International Speech Communication Association, Ser. InterSpeech ’12: 1183-1186.

Vernon, R. J., Sutherland, C. A., Young, A. W. and Hartley, T. (2014) Modeling First Impressions from Highly Variable Facial Images. Proceedings of the National Academy of Sciences, 111(32): E3353-E3361.

Vinciarelli, A. and Mohammadi, G. (2014) A Survey of Personality Computing. IEEE Transactions on Affective Computing, 5(3): 273–291.

Wei, X., Zhang, C., Zhang, H. and Wu, J. (2018) Deep Bimodal Regression of Apparent Personality Traits from Short Video Sequences. IEEE Transactions on Affective Computing, 9(3): 303-315.

Wills, J. and Todorov, A. (2006) First Impressions Making Up Your Mind After a 100-ms Exposure to a Face. Psychological Science, 17(7): 592-598.

Yan, Y. (1999) Understanding Speech Recognition Using Correlation - Generated Neural Network Targets, IEEE Trans. on Speech and Audio Processing, 7,(3): 350-352.

Yang, K., Mall, S. and Glaser, N. (2017) Prediction of Personality First Impressions with Deep Bimodal LSTM. Technical Report, arXiv. URL http://cs231n.stanford. edu/reports/2017/pdfs/713.pdf.

Zhang, C. -L., Zhang, H., Wei, X. -S. and Wu, J. (2016) Deep Bimodal Regression for Apparent Personality Analysis. In Hua G., Jégou H. (eds.) Computer Vision–ECCV 2016 Workshops, 9915: 311-324.