臺灣博碩士論文加值系統

本研究提出一種以車載網路訊號為基礎的車內設備聲控系統。該系統可分為兩個部分：第一個部分是要瞭解透過車載網路傳送的內容是什麼，此一部分包括使用逆向工程技術研究車載網路上傳輸訊號的含義; 第二部分是如何透過人類的聲音命令，將訊號經由車載網路發送到汽車的電子系統上，這包括使用谷歌智能助理軟體開發套件在樹莓派上設計和建立語音辨識系統，並使用 MCP2515 車載網路模塊連接到樹莓派來發送車載網路訊號, 和一個使用 Python 開發的關鍵字觸發程式來聯結它們。實驗結果證明，該系統能夠在實驗車輛上透過駕駛員的聲音來控制雨刷、大燈、電動車窗、車內空調等車內電子設備。此外，在實驗工作中，並研究了一種降低錯誤拒絕率並提升語音識別的成功率的方法。

This study proposes a voice control system for vehicle electrical equipment based on the controller area networks (CAN) bus. This system architecture is divided into two parts. The first part is what to send into the CAN bus. This includes reverse engineering the meaning of data be transmitted in the CAN bus. The second part is how to send CAN bus signals into the in-vehicle networks using the human voice. This includes speech recognition design and implementation on a Raspberry Pi (RPI) using the Google assistant software development Kit (SDK) as well as a MCP2515 CAN bus module connected to RPI to send CAN bus signals. A keyword response application was developed in the Python environment to connect each other. The experimental results indicate that the proposed system could achieve windshield wiper, headlight, power windows and air conditioning control using the driver’s voice commands in an experimental vehicle. In the final experimental work, a method for reducing the false rejection rate (FRR) is studied to improve the speech recognition rate.

中文摘要 i
ABSTRACT ii
CONTENTS iii
LIST OF FIGURES v
LIST OF TABLES vii
LIST OF SYMBOLS viii

CHAPTER 1
INTRODUCTION 1
1-1 Motivation for this study 1
1-2 Literature review 3
1-3 Overview of this thesis 9

CHAPTER 2
PRINCIPLE OF CONTROLLER AREA NETWORKS 11
2-1 Overview of controller area networks 11
2-2 CAN bus fundamentals 12
2-3 CAN bus gateway 14
2-4 On­board diagnostics parameter IDs 15

CHAPTER 3
PRINCIPLE OF SPEECH RECOGNITION 21
3-1 Overview of speech recognition 21
3-2 A brief of the hidden Markov model 21
3-3 A brief of the Gaussian mixture model 22
3-4 Artificial neural networks 23

CHAPTER 4
VOICE CONTROL SYSTEM EXPERIMENT FOR VEHICLE ELECTRICAL EQUIPMENT BASED ON CAN BUS 26
4-1 Overview of the experiment 26
4-2 What to send into the CAN bus? 26
4-2-1 Step-by-step method 28
4-2-2 Tag notation method 28
4-3 How to send CAN bus signals using the human voice? 30
4-4 Experiment and improving method of the speech recognition rate 31

CHAPTER 5
CONCLUSIONS 45

REFERENCES 46

[1] B. Obama, "Self-Driving, Yes, But also Safe," The Pittsburgh Post-Gazette, 20 Sep 2016.
[2] 中華民國交通部台灣區國道高速公路局, "105年國道事故檢討分析," 106.
[3] National Highway Traffic Safety Administration, "2014 Fatal Motor Vehicle Crashes: Overview," 2014.
[4] National Highway Traffic Safety Administration, "2015 Fatal Motor Vehicle Crashes: Overview," 2015.
[5] National Highway Traffic Safety Administration, "2016 Fatal Motor Vehicle Crashes: Overview," 2016.
[6] National Highway Traffic Safety Administration, "2017 Fatal Motor Vehicle Crashes: Overview," 2017.
[7] J. C. Stutts, D. W. Reinfurt, L. Staplin and E. A. Rodgman, "The Role of Driver Distraction in Traffic Crashes," University of North Carolina Highway Safety Research Center, Aug 2001.
[8] C. Carney, K. K. Harland and D. V. McGehee, "Examining Teen Driver Crashes and The Prevalence of Distraction: Recent Trends, 2007–2015," Journal of Safety Research, vol. 64, pp. 21-27, Feb 2018.
[9] National Highway Traffic Safety Administration, "Overview of The National Highway Traffic Safety Administration’s Driver Distraction Program," Apr 2010.
[10] E. Murphy-Chutorian and M. M. Trivedi, "Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness," IEEE Transactions on Intelligent Transportation Systems, vol. 11, no. 2, pp. 300-311, Jun 2000.
[11] Y. Liang, M. L. Reyes and J. D. Lee, "Real-Time Detection of Driver Cognitive Distraction," IEEE Transactions on Intelligent Transportation Systems, vol. 8, no. 2, pp. 340-350, Jun 2007.
[12] P. Smith, M. Shah and N. da Vitoria Lobo, "Determining Driver Visual Attention with One Camera," IEEE Transactions on Intelligent Transportation Systems, vol. 4, no. 4, pp. 205-218, Apr 2003.
[13] J. A. Healey and R. W. Picard, "Detecting Stress During Real-World Driving Tasks Using Physiological Sensors," IEEE Transactions on Intelligent Transportation Systems, vol. 6, no. 2, pp. 156-166, Jun 2005.
[14] P. Taylor, N. Griffiths, A. Bhalerao, S. Anand, T. Popham, Z. Xu and A. Gelencser, "Data Mining for Vehicle Telemetry," Applied Artificial Intelligence, vol. 30, no. 3, pp. 233-256, Apr 2016.
[15] J. E. Meseguer, K. T. Chai, C. T. Cala, J.-C. Cano and P. Manzoni, "Drivingstyles: a Mobile Platform for Driving Styles and Fuel Consumption Characterization," Journal of Communications and Networks, vol. 19, no. 2, pp. 162-168, May 2017.
[16] J. N. O. Fernandes, "A Real-Time Embedded System for Monitoring of Cargo Vehicles, Using Controller Area Network (CAN)," IEEE Latin America Transactions, vol. 14, no. 3, pp. 1086-1092, Mar 2016.
[17] S. Freiberger, M. Albrecht and J. Käufl, "Reverse Engineering Technologies for Remanufacturing of Automotive Systems Communicating via CAN Bus," Journal of Remanufacturing, 2011.
[18] K. Rokicki and K. Szczurowski, "Methods of Identification of Data Transmitted in The In-Vehicle CAN-BUS Networks," in 2015 20th International Conference on Methods and Models in Automation and Robotics (MMAR), 2015, pp. 946-949.
[19] K. Koscher, A. Czeskis, F. Roesner, S. Patel, T. Kohno, S. Checkoway, D. McCoy, B. Kantor, D. Anderson, H. Shacham and S. Savage, "Experimental Security Analysis of a Modern Automobile," in 2010 IEEE Symposium on Security and Privacy, 2010, pp. 447-462.
[20] N. Dehak, P. A. Torres-Carrasquillo, D. Reynolds and R. Dehak, "Language Recognition via I-Vectors and Dimensionality Reduction," in INTERSPEECH-2011, 2011, pp. 857-860.
[21] G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath and B. Kingsbury, "Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, Oct 2012.
[22] V. W. Zue and J. R. Glass, "Conversational Interfaces: Advances and Challenges," Proceedings of the IEEE, vol. 88, no. 8, pp. 1166-1180, Aug 2000.
[23] L. Fernando D’Haro, R. Córdoba, J. Ignacio Rojo, J. Diez, D. Avendaño and J. María Bermudo, "Low-Cost Speaker and Language Recognition Systems Running on a Raspberry Pi," IEEE Latin America Transactions, vol. 12, no. 4, pp. 755-763, Jul 2014.
[24] J. A. Ansari, A. Sathyamurthy and R. Balasubramanyam, "An Open Voice Command Interface Kit," IEEE Transactions on Human-Machine Systems, vol. 46, no. 3, pp. 467-473, Jun 2016.
[25] "CAN bus," Wikipedia: the Free Encyclopedia, Dec 2016. [Online]. Available: https://en.wikipedia.org/wiki/CAN_bus.
[26] Robert Bosch GmbH, "CAN Specification Version 2.0," 1991.
[27] G. Leen and D. Heffernan, "Expanding Automotive Electronic Systems," Computer, vol. 35, no. 1, pp. 88-93, Aug 2002.
[28] J. A. Cook and J. S. Freudenberg, "Controller Area Network (CAN)," EECS 461, pp. 1-8, 2008.
[29] K. M. Lynch, N. Marchuk and M. L. Elwin, Embedded Computing and Mechatronics with the PIC32, Oxford: Newnes, 2016, pp. 249 - 265.
[30] H. Schweppe, A. Zimmermann and D. Grill, "Flexible On-Board Stream Processing for Automotive Sensor Data," IEEE Transactions on Industrial Informatics, vol. 6, no. 1, pp. 81-92, Feb 2010.
[31] "OBD-II PIDs," Wikipedia: the Free Encyclopedia, Dec 2016. [Online]. Available: https://en.wikipedia.org/wiki/OBD-II_PIDs.
[32] C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing, Cambridge, MA: MIT Press, 1999.
[33] L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, Feb 1989.
[34] P. Zolfaghari and T. Robinson, "Formant Analysis Using Mixtures of Gaussians," in Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96, 1996, pp. 1229-1232.
[35] A. V. D. Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior and K. Kavukcuoglu, "WaveNet: A Generative Model for Raw Audio," in The 9th ISCA Speech Synthesis Workshop, 2016, pp. 125-125.
[36] A. H. Michaely, X. Zhang, G. Simko, C. Parada and P. Aleksic, "Keyword Spotting for Google Assistant Using Contextual Speech Recognition," in 2017 IEEE Automatic Speech Recognition and Understanding Workshop, 2017, pp. 272-278.