臺灣博碩士論文加值系統

在視訊監控的應用，PTZ攝影機具有彈性的取像視角和動態監視行動物體的諸多好處，因此長期以來被廣泛使用。傳統的PTZ攝影機是由單一攝影機和三個以上的步進馬達及複雜的機構所組成，因此造成體積龐大、耗電量大、成本高且常需要進行機械維護。本研究設計了一個數位PTZ攝影機系統，可以有效解決上述傳統機械式PTZ攝影機的諸多缺點。
此一數位PTZ系統整合了I2C取像控制器、AHB高速匯流排系統及DMA控制器等三個模組構成一個可對多個影像感測器平行取像的高速取像控制器，結合高性能的數位PTZ控制器核心，可透過PELCO D/P通訊協定，遠端對攝影機進行X、Y及Z三軸的即時運動控制。
我們採用MIAT設計方法論進行數位PTZ系統的嵌入式硬體設計。系統架構具有階層式，模組化的特色，可以方便整合驗證和未來的修改擴充。為了達到即時處理多重影像的能力，我們設計了一個管線化控制器來平行整合所有硬體模組。
最後我們將完整的系統實作在FPGA上，並整合兩個五百萬像素的攝影機和VGA顯示模組，最後於PC端設計一個PTZ模擬控制面板，完成一個高速數位PTZ實機展示系統。實驗顯示，我們的系統可達到每秒可處理320幅VGA格式(640x480)影像的取像速度和即時PTZ控制性能。此一研究成果將可以應用在高性能視訊監控、多攝影機系統。

In terms of video surveillance application, PTZ surveillance camera has the capability in capturing extreme angles as well as dynamic surveillance of moving objects. Therefore it’s still widely used in the video surveillance industry today. Traditional PTZ camera is made up from a single camera, three or more stepper motors and a complex mechanical structure combined together. Due to its size and power consumption, maintenance cost is considerably huge and impractical. This research aims in achieving a digital PTZ camera system that will improve such weaknesses and enhance its functionalities.
The PTZ digital camera system compromises module mode based I2C image controller, AHB high-speed bus system and DMA controller integration into a high speed multi imaging sensors controller capable in parallel image capturing. Through PELCO D/P communication protocol, it can distance control the camera’s X，Y and Z axis moving direction making it a high performance digital camera.
Using the MIAT designed methodology in creating the digital PTZ camera system and hardware, it enables us to have a hierarchical and module-mode structure allowing integration verification and future alterations. Pipeline controller is also used in order to maintain the hardware module mode integration.
Finally, this research aims to conclude by operating the system on top of FPGA, while installing two 5-megapixel cameras, a VGA display module and forming a PC simulation control panel. Research proven, the system can process up to 320 VGA frames (640x480) per second and PTZ real time control performance. The end result is a high performing digitized multi camera video surveillance system.

摘要 ··········································································································· i
ABSTRACT ································································································ ii
誌謝 ········································································································· iv
目錄 ·········································································································· v
圖目錄 ····································································································· vii
表目錄 ······································································································ ix
第一章 緒論 ······························································································· 1
1-1 研究動機與目標 ··············································································· 1
1-2 論文結構 ························································································ 4
第二章 CMOS影像感測器原理及控制 ······························································ 5
2-1 影像感測器 ····················································································· 5
2-2 影像感測的原理 ··············································································· 9
2.3 數位影像取像控制 ·········································································· 11
2.4 多重影像感測器系統 ······································································· 13
第三章 高性能多重影像感測系統 ·································································· 15
3.1 多重影像感測系統架構 ···································································· 16
3.2 多重CMOS感測器高速取像 ····························································· 17
3.2.1主控制流程 ············································································ 18
3.2.2 I2C控制器 ············································································· 20
3.2.3 直接記憶體存取(DMAC) ·························································· 26
3.2.4 Multi-layer advanced high-performance bus(MAHB)··························· 28
3.2.5 Advanced peripheral bus(APB) ····················································· 29
3.2.6 Advanced peripheral bus bridge(APB bridge) ···································· 31
3.3多重影像感測控制器設計 ·································································· 32
第四章 基於多重影像融合的數位PTZ ···························································· 36
4.1 Pelco P/D協定 ················································································ 37
4.1.1 Pelco D協定 ··········································································· 38
4.1.2 Pelco P協定 ··········································································· 41
4.2單一影像的數位PTZ ········································································ 43
4.3影像插補 ······················································································· 44
4.4 多重影像融合的數位PTZ ································································· 45
第五章 系統實作與驗證 ·············································································· 55
5.1實驗平台 ······················································································· 55
5.2多重影像感測控制器電路合成 ···························································· 57
5.3 數位PTZ系統實作與展示 ································································ 60
第六章 結論 ····························································································· 65
參考文獻 ·································································································· 66

[1]J. Nakamura, Image Sensor and Signal processing for Digital Still Cameras, Taylor & Francis Group, 2006.
[2]AMBA Multi-layer AHB Overview, ARM Inc, 2001.
[3]A. Dehnhardt, M. Kulaczewski, L. Friebe, S. Moch, P. Pirsch, H. Stolberg, and C. Reuter, “A multi-core SoC design for advanced image and video compression,” Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP ''05). IEEE International Conference on, 2005, pp. v/665-v/668 Vol. 5.
[4]AMBA Specification, Rev. 2.0, ARM Inc, 1999.
[5]“Advanced High Performance Bus Controller (AHBC)” by Tality Corporation 2001.
[6]R.C. Gonzalez and R.E. Woods, Digital Image Processing, Prentice Hall, 2002.
[7]T. Moriya, F. Beniyama, K. Utsugi, T. Minakawa, H. Takeda, and K. Ando, “Multi-camera and multi-projector based seamless live image display system,” Multimedia Modelling Conference, 2004. Proceedings. 10th International, 2004, pp. 265-272.
[8]G. Scotti, L. Marcenaro, C. Coelho, F. Selvaggi, and C. Regazzoni, “Dual camera intelligent sensor for high definition 360 degrees surveillance,” Vision, Image and Signal Processing, IEE Proceedings -, vol. 152, 2005, pp. 250-257.
[9]S. Ikeda, T. Sato, and N. Yokoya, “High-resolution panoramic movie generation from video streams acquired by an omnidirectional multi-camera system,” Multisensor Fusion and Integration for Intelligent Systems, MFI2003. Proceedings of IEEE International Conference on, 2003, pp. 155-160.
[10]CHEN, Ching-Han; DAI, Jia_Hong; “Design and high-level synthesis of discrete-event controller”, National Conference of Automatic Control and Mechtronics System, vol.1, 2002, pp. 610–615.
[11]K. Jack, Video Demystified, Elsevier Inc., 2005.
[12]R.S. Prodan, “Multidimensional digital signal processing for television scan conversion,” Phillips J. Res., Vol.41, pp.576–603, 1986.
[13]N. Shezaf, H. Abramov-Segal, I. Sutskover, and R. Bar-Sella, “Adaptive low complexity algorithm for image zooming at fractional scaling ratio,” Electrical and ELectronic Engineers in Israel, 2000. The 21st IEEE Convention of the, 2000, pp. 253-256.