臺灣博碩士論文加值系統

影像處理演算法藉由修改原始圖像像素的強度，可以將影像的形狀、紋理、邊緣和其他重要影像特徵作增強。此類演算法可以應用在許多顯示設備上，例如筆記型電腦，掌上電腦，顯示器，照相手機...等。
在一般情況下，影像處理演算法必須針對視訊影像的每一張畫面重新計算，因此提高了視頻處理應用的複雜性。

為了維持視訊影像處理品質，並進一步縮短處理時間，本論文提出了一種基於視頻編解碼標準擷取之運動向量的效能增強演算法。
運動向量是藉由尋找畫面中每一個marcoblock在目前畫面與參考畫面之間的距離而得的偏移量。
當前一張畫面和本張畫面只有些許改變時，藉由分析運動向量的數量可以簡化視訊影像處理演算法另一方面當畫面出現很大變化時也能維持視訊增強的品質。

我們將所提出的方法實作在H.264聯合模型參考軟體(JM 17)上，並藉由峰值訊噪比(PSNR)及程式執行時間分別驗證了我們提出方法能有效提供良好的視訊增強品質避免過度失真並且進一步降低計算複雜度。

Image processing methods involve modifying the intensity of pixels from the original image to represent the shape, texture, edge, and other significant features for many display devices, including laptops, PDAs, monitors, mobile camera phones, and so on. In general, image processing methods should be applied to every frame of a sequence, thus increasing the complexity of video processing applications.

In order to keep the processing effect and reduce the processing time, this thesis proposes a performance enhancement method based on the extraction of motion vectors in video codec standards. Motion vector is offset between the position of the current partition and the prediction region in the reference picture, calculated by finding matching blocks in the current frame corresponding to blocks in the reference frame. Analysing the amount of motion vectors can simplify the image processing methods when the current frame only changes a little, while presenting the original processing effect during the current frame which has great contextual change in the video sequence.

The proposed performance enhancement method is implemented by using MVs of the H.264 Joint Model reference software (version JM 17.0). Experimental result uses PSNR and processing time to demonstrate the effectiveness of the proposed method in providing the processing effect without serious distortion and low computational cost.

誌謝 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .iv
中文摘要. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . vi
Abstract. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . .1
1.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
1.2 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.3 Organization of This Thesis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2 Image Contrast Enhancement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.1 Introduce to Image Contrast Enhancement. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.2 Global Correction Method. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
2.3 Local Correction Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.4 Discussion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3 Advanced Video Coding. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
3.1 Overview of H.264 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
3.2 Intra Prediction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
3.3 Motion Compensation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.4 Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4 Proposed Method. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
4.1 Spatial Change . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.2 Temporal Variation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.3 Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
5 Experiments Rusults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
5.1 Measurement of Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
5.2 Time Consumption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
6 Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

[1]D. Xu and J. An, ``Robust global motion estimation method for aerial imagery," {\it Opt. Eng.}, vol. 44, no. 9, pp. 090501, Sep. 2005.

[2]S.-C. Hsu, S.-F. Liang, K.-W. Fan, and C.-T. Lin, ``A robust in-car digital image stabilization technique," {\it IEEE Trans. Syst., Man, Cybern. C, Appl. Rev.}, vol. 37, no. 2, pp. 234-247, Mar. 2007.

[3]M. T. Pourazad, P. Nasiopoulos, and R. K. Ward, ``An H.264-based scheme for 2D to 3D video conversion," {\it IEEE Trans. Consum. Electron.}, vol. 55, no. 2, pp. 742-748, May 2009.

[4]V. Sanchez, P. Nasiopoulos, and R. Abugharbieh, ``Novel lossless fMRI image compression based on motion compensation and customized entropy coding," {\it IEEE Trans. Inf. Technol. Biomed.}, vol. 13, no. 4, pp. 645-655, Jul. 2009.

[5]C. Poppe, S. D. Bruyne, T. Paridaens, P. Lambert, and R. V. Walle, ``Moving object detection in the H.264/AVC compressed domain for video surveillance applications," {\it J. Vis. Commun. Image Representation}, vol. 20, no. 6, pp. 428-437, Aug. 2009.

[6]K. Mehmood, M. Mrak, J. Calic, and A. Kondoz, ``Object tracking in surveillance videos using compressed domain features from scalable bit-streams," {\it Signal Process.: Image Commun.}, vol. 24, no. 10, pp. 814-824, Nov. 2009.

[7]G. Ginesu, A. Mansouri, A. M. Aznaveh, F. Torkamani-Azar, and F. Kurugollu, ``A low complexity video watermarking in H.264 compressed domain," {\it IEEE Trans. Inf. Forensics Security}, vol. 5, no. 4, pp. 649-657, Dec. 2010.

[8]K. Iqbal, M. O. Odetayo, and A. James, ``Integrated image enhancement method for biometric security," {\it IEEE International Conference on Systems, Man, and Cybernetics (SMC)}, pp.1716-1721, Oct. 2011.

[9]Du Shan, and R. K. Ward, ``Adaptive Region-Based Image Enhancement Method for Robust Face Recognition Under Variable Illumination Conditions," {\it IEEE Trans. on Circuits and Syst. for Video Technol.}, vol.20, no.9, pp.1165-1175, Sept. 2010

[10]Jae-Ho Jang, Sung-Deuk Kim, and Jong-Beom Ra, ``Enhancement of Optical Remote Sensing Images by Subband-Decomposed Multiscale Retinex With Hybrid Intensity Transfer Function," {\it IEEE Geoscience and Remote Sensing Letters}, vol.8, no.5, pp.983-987, Sept. 2011

[11]S. Dippel, M. Stahl, R. Wiemker, and T. Blaffert, ``Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform," {\it IEEE Trans. on Medical Imaging}, vol.21, no.4, pp.343-353, April 2002

[12]Xuanqin Mou, and Min Zhang, ``Nonlinear multi-scale contrast enhancement for chest radiograph," {\it IEEE International Conference on Image Processing(ICIP)}, pp.3184-3187, 12-15 Oct. 2008

[13]Chulwoo Lee, Chul Lee, Young-Yoon Lee, and Chang-Su Kim, ``Power-Constrained Contrast Enhancement for Emissive Displays Based on Histogram Equalization," {\it IEEE Trans. on Image Processing}, vol.21, no.1, pp.80-93, Jan. 2012

[14]Y. Yang, Z. Su and L. Sun, ``Medical image enhancement algorithm based on wavelet transform," {\it Electronics Letters}, vol.46, no.2, pp.120-121, January 21 2010

[15]Hrushikesh Garud, Debdoot Sheet, Amit Suveer, Phani Krishna-Karri, K.-Ajoy Ray, Manjunatha Mahadevappa, and Jyotirmoy Chatterjee, ``Brightness preserving contrast enhancement in digital pathology," {\it International Conference on Image Information Processing (ICIIP)}, vol., no., pp.1-5, 3-5 Nov. 2011

[16]E. Lee, W. Kang, S. Kim, and J. Paik, ``Color shift model-based image enhancement for digital multifocusing based on a multiple color-filter aperture camera," {\it IEEE Transactions on Consumer Electronics}, vol.56, no.2, pp.317-323, May 2010

[17]J. P. Oakley, and Bu Hong, ``Correction of Simple Contrast Loss in Color Images," {\it IEEE Trans. on Image Processing}, , vol.16, no.2, pp.511-522, Feb. 2007

[18]R. Schettini, F. Gasparini, S. Corchs, F. Marini, A. Capra, and A. Castorina, ``Contrast image correction method," {\it J. Electron. Imaging}, vol. 19, no. 2, pp. 023005, Apr.-Jun. 2010.

[19]N. Moroney, ``Local colour correction using nonlinear masking," {\it IS\&T Eighth Color imaging conference}, Vol. 8, IS\&T, pp. 108-896, 2000.

[20]E. H. Land and J. J. McCann, ``Lightness and retinex theory," {\it J. Opt. Soc. Am}, Vol. 61, Issue 1, pp.1 , 1971

[21]R. C. Gonzalez and R. E. Woods, ``Digital Image Processing," 3rd ed. Prentice Hall, 2008.

[22]B. M. Oh, M. Chen, J. Dorsey, and F. Durand, ``Image-based modeling and photo editing," {\it Proc. ACM SIGGRAPH Conf. Computer Graph.}, pp. 433-442, Aug. 2001.

[23]F. Durand and J. Dorsey, ``Fast bilateral filtering for the display of high-dynamic-range images," {\it ACM Trans. Graph.}, vol. 21, no. 3, pp. 257-266, Jul. 2002.

[24]C. Liu, W. T. Freeman, R. Szeliski, and S. B. Kang, ``Noise estimation from a single image," {\it Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit.}, vol. 1, pp. 901-908, Jun. 2006.

[25]W. G. Zhang, Q. Zhang, and C. S. Yang, ``Improved bilateral filtering for SAR image despeckling," {\it Electron. Lett.}, vol. 47, no. 4, pp. 286-288, Feb. 2011.

[26]F. Porikli, ``Constant time O(1) bilateral filtering," {\it Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit.}, pp. 1-8, Jun. 2008.

[27]C. Tomasi and R. Manduchi, ``Bilateral filtering for gray and color images," {\it Proc. IEEE Int. Conf. Comput. Vision},pp. 839-846, Jan. 1998.

[28]Iain E. Richardson, The H.264 Advanced Video Compression Standard. Wiley, 2010.

[29]W. Lin, K. Panusopone, D. M. Baylon, M.-T. Sun, Z. Chen, and H. Li, ``A fast sub-pixel motion estimation algorithm for H.264/AVC video coding," {\it IEEE Trans. Circuits Syst. Video Technol.}, vol. 21, no. 2, pp. 237-242, Feb. 2011.

[30]H.264 Reference Software Group [Online]. Available: http://iphome.hhi.de/suehring/tml/download/