臺灣博碩士論文加值系統

一般的攝影機在拍攝時，會因為人手的抖動、車子行駛顛簸的震動、風力的吹動以及其他外力干擾下而使拍攝出來的影像序列會產生不必要的抖動。本論文擬提出基於數位PI控制器之數位影像穩定(Digital Image Stabilization；DIS)技術用以去除不必要的抖動影響以保留原影像的真實性。所提影像穩定技術主要分為全域移動向量，即移動向量估測單元與防止抖動又可讓影像序列平滑移動的移動補償向量，即移動補償單元。
移動向量估測方面則先利用Sobel邊緣偵測法找出整張影像中物件的邊緣，並根據物件的邊緣最明顯的部分，進而訂定出特徵區塊；接著在特徵區塊內求得區域移動向量，再以眾數法從區域移動向量中求得全域移動向量，此全域移動向量就是實際的影像移動向量。而移動向量補償方面則以平滑指標(Smoothness Index；SI)和移動誤差(Moving Error；ME)來評估影像穩定系統性能的好壞；同時亦以多目標粒子群演算法(Multi-Objective Particle Swarm Optimization；MOPSO)的適應值用於數位PI控制器參數的調整依據，進而達到讓影像序列可以在不同干擾環境下既可防止抖動又可平滑移動的效果。經手持實測的實驗結果顯示所提之數位影像穩定系統，除能有效的防止影像序列的晃動外，並且能在影像平移時消除影像延遲的缺點。

General camera while shooting, because of manpower jitter, car driving Britain slope vibration, wind blowing, and other external interference leaving the shooting out of the image sequence will produce unwanted jitter. This thesis intends to propose a digital PI-based digital image stabilization technology to remove unwanted jitter effect such that the authenticity of the original image can be preserved. Proposed image stabilization technology includes the global mobile vector (the motion vector estimation unit) and the motion compensation vector (the motion compensation unit) which can prevent jitter and allow smooth movement of the image sequence.
First the Sobel edge detection method will be applied to find the edges of objects in the entire image for the motion vector estimation, and the feature block will be established according to the most visible part of the object edges. Then the feature area within the block move vector can be obtained and the global motion vectors can be derived from the local motion vectors using the mode algorithm. The global motion vector should be the actual image motion vector. For the motion vector compensation, the smoothing index (SI) and moving error (ME) will be used to evaluate the performance of the image stabilization system. Meanwhile, the parameters of the digital PI controller will be adjusted according to the fitness value of the multi-objective particle swarm algorithm such that the effects of the jitter prevention and smooth movement for the image sequences can be achieved in different interference environments. The handheld experimental results show that the proposed digital image stabilization system not only can prevent the judder of the image sequence effectively but also eliminate the image delay due to the image translation.

摘要 I
Abstract II
誌謝 III
目次 IV
圖目次 VI
表目次 VIII
第一章 緒論 1
1-1 研究動機 1
1-2 研究目標與方法 1
1-3 文獻回顧 2
1-4 論文架構 3
第二章 系統硬體與軟體 5
2-1 硬體介紹 5
2-2 系統軟體開發環境建立 8
第三章 數位影像穩定系統 9
3-1 數位影像穩定系統原理 9
3-2 數位影像穩定系統流程 10
3-3 區域移動估測 11
3-3-1 區塊匹配法 11
3-3-2 二步搜尋法 13
3-3-3 自動搜尋較佳搜尋區域的位置 16
3-4 全域移動估測 18
3-5 移動補償 20
3-5-1 傳統移動補償向量估測法 21
3-5-2 加入Clipper函數的傳統移動補償向量估測法 22
3-5-3 數位PI控制器用於數位影像穩定 24
3-5-4 改良型數位PI控制器用於數位影像穩定 25
3-6 移動補償器的效能評估 28
第四章 多目標粒子群 29
4-1 多目標最佳化 29
4-1-1 多目標最佳化法 30
4-1-2 Pareto最佳化 32
4-2 粒子群演算法 34
4-3 多目標粒子群 36
4-3-1 演算法分析 37
4-3-2 演算法流程 38
第五章 實驗結果 40
5-1 影像穩定系統的模擬 40
5-2 影像穩定系統實測結果 59
第六章 結論與未來展望 69
6-1 結論 69
6-2 未來展望 69
文獻參考 70

[1] C. T. Lin, C. T. Hong, and C. T. Yang, “Real-time digital image stabilization system using modified proportional integrated controller,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 19, pp. 427-431, 2009.
[2] S. C. Hsu, S. F. Liang, and C. T. Lin, “A robust digital image stabilization technique based on inverse triangle method and background detection,” IEEE Trans. Consumer Electronics, vol. 51, no. 2, pp. 335-345, 2005.
[3] H. H. Chen, C. K. Liang, Y. C. Peng, and H. A. Chang, “Integration of digital stabilizer with video codec for digital video cameras,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 17, pp. 801-813, 2007.
[4] 光學式的移動補償振動法，http://www.rainbowphoto.com.tw/function/is.htm
[5] S. J. Ko, S. H. Lee and K. H. Lee, “Digital image stabilizing algorithms based on bit-plane matching,” IEEE Trans. Consumer Electronics, vol. 44, pp. 617-622, 1998.
[6] J. K. Paik, Y. C. Park, and D. W. Kim, “An adaptive motion decision system for digital image stabilizer based on edge pattern matching,” IEEE Trans. on Consumer Electronics, vol. 38, no. 3 , pp. 607-616, 1992.
[7] F. Vella and A. Castorina, “Digital image stabilization by adaptive block motion vectors filtering,” IEEE Trans. on Consumer Electronics, vol. 48, no. 3, 2002.
[8] S. Erturk, “Image sequence stabilization: motion vector integration (MVI) versus frame position smoothing,” Proceedings of IEEE Eurasip Symposium on Image and Signal Processing and Analysis, pp. 604-271, 2001.
[9] A. A. Yeni and S. Erturk, “Fast digital image stabilization using one bit transform based sub-image motion estimation,” IEEE Trans. on Consumer Electronics, vol. 51, no. 3, pp. 917-921, 2005.
[10] Visual Studio MSDN:http://msdn.microsoft.com/zh-tw/vstudio/aa718325
[11] 勝勇、劉盛，基於OpenCV的計算機視覺技術實現，科學出版社，2008。
[12] Y. Zhang, M. Xie, L. Mao, and D. Tang, “An adaptive digital image stabilization based on empirical mode decomposition,” IEEE 2010 International Conference on. Communications, Circuits and Systems (ICCCAS), pp. 327-330, 2010.
[13] A. A. Amanatiadis and I. Andreadis, “Digital image stabilization by independent component analysis,” IEEE Trans. on Instrumentation and Measurement, vol. 59, pp. 1755-1763, 2010.
[14] M. H. Shakoor and M. Moattari, “Digital image stabilization using histogram-based sorting,” IEEE 2009 Second International Symposium on Knowledge Acquisition and Modeling, vol. 3, pp. 266-268, 2009.
[15] M. H. Shakoor and M. Moattari, “A fuzzy method based on bit-plane images for stabilizing digital images,” IEEE 2010 20th International Conference on Electronics, Communications and Computer (CONIELECOMP), pp. 106-108, 2010.
[16] G. Bradski and A. Kaehler, Learning OpenCV: Computer Vision with the OpenCV Library, O'Reilly Media, 2008.
[17] S. Erturk and T. J. Dennis, “Image sequence stabilization based on DFT filtering,” IEE Proceedings on Image Vision and Signal Processing, vol. 127, pp. 95-105, 2000.
[18] M. H. Shakoor and M. Moattari, “Statistical digital image stabilization,” Journal of Engineering and Technology Research, vol. 3, pp. 161-167, 2011.
[19] B. Montrucchio and D. Quaglia, “New sorting-based lossless motion estimation algorithms and a partial distortion elimination performance analysis,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 15, pp. 210-220, 2005.
[20] K. Ioannidis and A. Ioannis, “A Digital Image Stabilization Method Based on the Hilbert–Huang Transform,” IEEE Trans. on Instrumentation and Measurement, vol. 61, pp. 2446-2457, 2012.
[21] M. H. Shakoor and M. Moattari, “A new fast method for digital image stabilization,” IEEE 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE), vol. 2, pp. 35-354, 2010.
[22] H. M. Jong, L. G. Chen, and T. D. Chiueh, “Parallel architectures for 3-step hierarchical search block-matching algorithm,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, no. 4, pp. 407-416, 1994.
[23] R. Li, B. Zeng and M. L. Liou, “A new three-step search algorithm for block motion estimation,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, pp. 438-443, 1994.
[24] L. M. Po and W. C. Ma, “A novel four-step search algorithm for fast block motion estimation,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 6, pp. 313-317, 1996.
[25] W. J. Jong, A Real-Time Image Tracking System Based on Optical Flow Computation, Master Thesis, Dept. of Elec., NCKU, Taiwan, 2001.
[26] J. Y. Tham, S. Ranganath, M. Ranganath, and A. A. Kassim, “A novel unrestricted center-biased diamond search algorithm for block motion estimation,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 8, pp. 369-377, 1998
[27] C. Zhu, X. Lin, and L. P. Chau, “Hexagon-based search pattern for fast block motion estimation,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 12, pp. 349–355, 2002.
[28] 陳碩宏，即時視訊錄製系統設計，國立臺灣師範大學機電科技研究所碩士論文，2007。
[29] 眾數，http://zh.wikipedia.org/wiki/
[30] C. F. Wu, C. J. Lin, Y. J. Shiue, and C. Y. Lee, “Digital image stabilization using a functional neural fuzzy network,” Proceedings of the 2011 2nd International Congress on Computer Applications and Computational Science, Springer Berlin Heidelberg, pp. 231-237, 2012.
[31] 徐聖哲、林進燈，“模糊推論在數位影像穩定技術上的應用,” 影像與識別, vol. 13, pp. 55-66, 2007.
[32] 林政緯，以聚類為基礎的全域最佳解搜尋法應用於多目標粒子群聚最佳化的研究，國立東華大學電機工程研究所碩士論文，2003。
[33] F. Cheng, F. Ye, and J. Yang, “Multi-objective optimization of collaborative manufacturing chain with time-sequence constraints," The International Journal of Advanced Manufacturing Technology, vol. 40, pp. 1024-1032, 2009.
[34] 徐業良，工程最佳化設計，國立編譯館，1995。
[35] J. Kennedy and R. Eberhart, “Particle swam optimization,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, pp. 1942-1948, 1995.
[36] J. L. Fernandez-Martinez and E. Garcia-Gonzalo, “Stochastic stability analysis of the linear continuous and discrete PSO models,” IEEE Trans. on Evolutionary Computation, vol. 15, pp. 405-423, 2011.
[37] J. L. F. Martínez and E. G Gonzalo, “The PSO family: deduction, stochastic analysis and comparison,” Swarm Intelligence, vol. 3, pp. 245-273, 2009.
[38] 張利彪、周春光、馬銘、劉小華， “基於粒子群演算法求解多目標優化問題,” 計算機研究與發展, vol. 41, pp. 1286-1291, 2004.