臺灣博碩士論文加值系統

視訊品質評估在視訊處理系統中扮演重要的角色。由於以受測者來評估視訊品質過於昂貴及不便，所以人們希望能設計出由電腦自動評估視訊品質的方法。考慮到現有的影像品質評估方法大多沒有符合人眼通常只專注在視訊畫面中的重要部份而非整個畫面的特性，本篇論文利用影像中的顯著度和影片中的移動強度來更精準地抓出人眼視覺較專注的區域並加以處理。視訊品質的分數由每一幅幀算出來的分數分別依照時間順序套用不同的權重結合而成。最後我們使用包含多種失真視訊的LIVE視訊品質資料庫來驗證我們的方法，而實驗數據顯示出我們已成功地改善現有的影像品質評估方法來套用在視訊品質評估上，並且擁有計算複雜度低且運行時間短等優點。

Video quality assessment algorithms play an important roles in video processing systems. Since the evaluation by human is much expensive and inconvenient, it is necessary to design an automatic methods that evaluate the quality of videos by computer. Since the existing image/video quality assessment is not conform to the fact that human beings pay more attention to the important parts of video frames than whole image, we proposed a video quality assessment with utilization of saliency and motion strength in each frame to accurately detect the region that attract human attention.
After evaluating with LIVE video quality database which includes different video distortion types, the experimental results show that the proposed algorithm can successfully improve the performance of image quality metrics and video quality assessment at low computation complexity.

中文摘要 i
ABSTRACT ii
誌謝 iii
CONTENTS iv
LIST OF FIGURE v
LIST OF TABLE vi
Chapter 1 Introduction 7
Chapter 2 Related Works 10
Chapter 3 Proposed Method 11
3.1 Modeling Spatial Attention 12
3.2 Modeling Temporal Attention 15
3.3 Frame Quality Assessment 18
3.4 Temporal Pooling 21
Chapter 4 Experimental Result 23
Chapter 5 Conclusion 27
Reference 28

[1] Z. Wang, A. Bovik, "A universal image quality index", IEEE Signal Processing Letters, vol. 9, pp. 81-84, 2002.
[2] Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 600–612, 2004.
[3] Y. Tong, F. AlayaCheikh, A. Tremeau and H. Konick, "Full Reference Image Quality Assessment Based on Saliency Map Analysis," Accepted for publication in the International Journal of Imaging Systems and Technology, 2010.
[4] A. Ninassi , O. L. Meur , P. L. Callet and D. Barbba "Does where you gaze on an image affect your preception of quality? applying visual attention to image quality metric", Proc. IEEE Int. Conf. Image Process., vol. 2, pp.169 -172, 2007.
[5] A. Guo, D. Zhao, L. Shaohui, X. Fan, and W. Gao, “Visual attention based image quality assessment,” in Proceedings of the IEEE International Conference on Image Processing (ICIP ’11), pp. 3297–3300, 2011.
[6] C.-W. Tang, “Spatiotemporal visual considerations for video coding,” IEEE Trans. Multimedia, vol. 9, no. 2, pp. 231–238, 2007.
[7] B. Fu; Z. Lu; X. Wen; L. Wang; H. Shao, "Visual attention modeling for video quality assessment with structural similarity," Wireless Personal Multimedia Communications (WPMC), 2013 16th International Symposium on , pp.1,5, 24-27, 2013.
[8] L. Xu; L. Ma; K.-N. Ngan; W. Lin; Y. Weng, "Visual quality metric for perceptual video coding," Visual Communications and Image Processing (VCIP), pp.1,5, 17-20, 2013
[9] Y.-F. Ma and H.-J. Zhang, Mingjing Li, “A user attention model for video summarization”, Proceedings of the tenth ACM international conference on Multimedia, 2002.
[10] Y.-F. Ma and H.-J. Zhang, “A New Perceived Motion based Shot Content Representation”. IEEE International Conference on Image Processing, Vo1.3.pp.426-429, 7-10, 2001.
[11] J. You, J. Korhonen, and A. Perkis, “Attention modeling for video quality assessment: Balancing global quality and local quality,” in Proc. IEEE Int. Conf. Multimedia Expo. (ICME), pp. 914–919, 2010.
[12] A. K. Moorthy and A. C. Bovik, “Visual importance pooling for image quality assessment,” IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 193–201, 2009.
[13] K. Seshadrinathan and A. C. Bovik, “Motion-based perceptual quality assessment of video,” in Proc. SPIE—Human Vision and Electronic Imaging, 2009.
[14] K. Seshadrinathan and A. C. Bovik, “Motion tuned spatio-temporal quality assessment of natural videos,” IEEE Trans. Image Process., vol. 19, no. 2, pp. 335–350, 2010.
[15] A. Toet, “Computational versus psychophysical bottom-up image saliency: a comparative evaluation study,” IEEE Trans. PAMI, vol. 33, pp. 2131-2146, 2011.
[16] A. Borji and L. Itti, “State-of-the-art in visual attention modeling,” IEEE Trans. PAMI, vol. 35, pp. 185-207, 2013.
[17] M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu, “Glogal contrast based salient region detection,” In CVPR, pp.409-416, 2011.
[18] W.-J. Tsai; Y.-S. Liu, "Foveation-based image quality assessment," Visual Communications and Image Processing Conference, 2014 IEEE , pp.25,28, 7-10, 2014.
[19] K. Seshadrinathan, R. Soundararajan, A. C. Bovik and L. K. Cormack, "LIVE Video Quality Database, " Available [Online]: http://live.ece.utexas.edu/research/
quality/live_video.html.
[20] K. Seshadrinathan, R. Soundararajan, A. C. Bovik and L. K. Cormack, “A Subjective Study to Evaluate Video Quality Assessment Algorithms,” Proc. SPIE Human Vision and Electronic Imaging XV, 2010.
[21] K. Seshadrinathan, R. Soundararajan, A. C. Bovik and L. K. Cormack, "Study of Subjective and Objective Quality Assessment of Video", IEEE Transactions on Image Processing , vol.19, no.6, pp.1427-1441, 2010.
[22] M. H. Pinson and S. Wolf, “A new standardized method for objectively measuring video quality,” IEEE Trans. Broadcast., vol. 50, no. 3, pp. 312–322, 2004.
[23] VQM [Online]. Available: http://www.its.bldrdoc.gov/n3/video/VQM_software.php
[24] H. R. Sheikh and A. C. Bovik, “A visual information fidelity approach to video quality assessment,” in 1st Int. Conf. Video Processing and Quality Metrics for Consumer Electronics, 2005.
[25] H. R. Sheikh and A. C. Bovik, “Image information and visual quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp. 430–444, 2006.
[26] Skbkekas, “Scatterplot comparing Pearson and Spearman correlation.” Available [Online]: https://commons.wikimedia.org/wiki/File:Spearman_fig2.svg
[27] H. R. Sheikh and A. C. Bovik, “Image information and visual quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp. 430–444, 2006.