臺灣博碩士論文加值系統

在視訊畫面率轉換的領域，使用動作向量來插補畫面，其品質會隨著動作向量的準確與否而有很大的差異。在這份論文中，我們提出一個穩定且有效率的擬真動作向量估計演算法去提昇動作向量的精確度。在本論文中，數個在一般視訊編碼系統常用的技術將被引用到這個演算法中。首先，因為隨著搜尋回數的增加，動作向量間的空間相關性也會跟著增加，因此，多回次動作向量的搜尋技術將可以把動作向量場修飾得更為精確。其次，變動方塊大小的技術可以依照每個移動物件的外形，來量身訂做一個適合的動作向量估計演算法。再者，動作向量收斂訊息的傳遞和較少的候選搜尋點將有效地降低多層次動作向量搜尋的時間複雜度。最後，本篇論文亦提出一個能取代傳統最小絕對誤差總和的誤差估計函數，它能更有效地抵抗雜訊和陰影對擬真動作向量估計的干擾。

The quality of the motion vector based interpolated frame in frame rate up conversion is predominantly dependent on the accuracy of the motion vectors. In this Thesis, we propose a robust true motion estimation algorithm to enhance the accuracy of the motion vector field. Several techniques used in general video coding systems are introduced into this algorithm. Firstly, a technique of multi-pass motion search can refine motion vector field more accurately as spatial motion correlation is growing up with passes. Secondly, according to the shape of moving objects, variable block size will apply a suitable block size to motion estimation. Thirdly, the methods of converge propagation and few candidate search points can efficiently reduce the time-consume multi-pass motion search. Finally, differing to traditional SAD measurement, a new distortion criterion is proposed to enhance resistance to noise and shadow.

CONTENTS i
LIST OF FIGURES iv
LIST OF TABLES vi
Chapter 1 INTRODUCTION 1
1.1. Overview of Frame Rate Up Conversion (FRUC) 1
1.2. Problems Must Be Solved in FRUC 3
1.2.1. Overview of the features in video sequences 3
1.2.2. Problems of motion estimation in FRUC 4
1.2.3. Problems of motion compensation in FRUC 7
1.3. Divergence between True Motion Estimation and Motion Estimation Used in Coding Systems 9
1.4. Organization of This Thesis 10
Chapter 2 BACKGROUND 11
2.1. Overview of Block-based Motion Estimation (BME) 11
2.2. The Concept of True Motion Estimation 11
2.3. Overview of True Motion Search Technologies 13
2.4. The Problem of Local Minimal SAD in True Motion Estimation 15
2.5. Overview of 3DRS Algorithm 18
2.6. Overview of Other Techniques Used in FRUC 20
2.6.1. Motion estimations used in FRUC 20
2.6.2. Motion compensations Used in FRUC 24
Chapter 3 MULTI-PASS TRUE MOTION ESTIMATION WITH VARIABLE BLOCK SIZE 26
3.1. Overview of Multi-pass True Motion Algorithm in This Thesis 26
3.2. Flow Diagram of The Proposed Algorithm 29
3.3. Multi-pass Block-Matching Motion Estimation 31
3.4. Candidate Motion Vector 34
3.4.1. Predictive motion vector (PMV) 34
3.4.2. Update vector sets 38
3.5. Variable Block-Size Technique 40
3.5.1. Motions with small block size 41
3.5.2. Motions with large block size 42
3.6. Distortion Criterion 45
3.7. Converge Decision 50
3.8. Converge Propagation 52
Chapter 4 SIMPLE MOTION COMPENSATION 55
Chapter 5 EXPERIMENTAL RESULTS 56
5.1. MVF of Several Sequences Produced by The Proposed Algorithm 57
5.2. MVF Produced by 3DRS 60
5.3. Interpolated Frames: Comparing 3DRS with The Proposed Algorithm 61
5.4. Computation Complexity: Comparing 3DRS with The Proposed Algorithm 64
5.5. Noise Resistance: Comparing 3DRS with The Proposed Algorithm 65
5.6. Quantization Resistance: Comparing 3DRS with The Proposed Algorithm 68
Chapter 6 PARAMETERS IN THIS THESIS 70
Chapter 7 CONCLUSIONS AND FUTURE WORKS 72
7.1. Conclusions 72
7.2. Future Works 72
REFERENCE 74
BIOGRAPHY 77

[1]Byung-Tae Choi, Sung-Hee Lee, Sung-Jea Ko, “New frame rate up-conversion using bi-directional motion estimation”, IEEE Transactions on Consumer Electronics, Volume 46, Issue 3, pp. 603 – 609, Aug. 2000.
[2]Jisheng Wang, Dong Wang, Wenjun Zhang, “Temporal compensated motion estimation with simple block-based prediction”, IEEE Transactions on Broadcasting Volume 49, Issue 3, pp.241 - 248, Sept. 2003.
[3]Taehyeun Ha, Seongjoo Lee, Jaeseok Kim, “Motion compensated frame interpolation by new block-based motion estimation algorithm”, IEEE Transactions on Consumer Electronics, Volume 50, Issue 2, pp.752 - 759, May 2004.
[4]de Haan G., Biezen P.W.A.C., Huijgen H., Ojo, O.A., “True-motion estimation with 3-D recursive search block matching”, IEEE Transactions on Circuits and Systems for Video Technology, Volume 3, Issue 5, pp.368 - 379, 388, Oct. 1993.
[5]Demin Wang, Vincent A., Blanchfield P., “Hybrid de-interlacing algorithm based on motion vector reliability”, IEEE Transactions on Circuits and Systems for Video Technology, Volume 15, Issue 8, pp.1019 – 1025, Aug. 2005.
[6]Ralph Braspenning, Gerard de Haan, “True-Motion Estimation using Feature Correspondence”, SPIE, Proceedings of VCIP, pp. 396-407 , Jan. 2004,
[7]Elias D.P., Kingsbury N.G., “An efficient block segmentation algorithm for true motion estimation”, Sixth International Conference on Image Processing and Its Applications, Volume 1, 14-17, pp.209 – 213, July 1997.
[8]Biswas M., Nguyen T., “A novel motion estimation algorithm using phase plane correlation for frame rate conversion”, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, Volume 1, 3-6, pp.492 – 496, Nov. 2002.
[9]Biswas M., Nguyen, T., “A novel de-interlacing technique based on phase plane correlation motion estimation”, Proceedings of the 2003 International Symposium on Circuits and Systems ISCAS '0., Volume 2, 25-28, pp.604-607, May 2003.
[10]Mertens M.J.W., Haan, G. de “Motion vector field improvement for picture rate conversion with reduced halo” Proc. of the SPIE/IST VCIP, San Jose, CA, 21-26, pp. 352-362, January 2001.
[11]Fujiwara S., Taguchi A., “Motion-Compensated Frame Rate Up-Conversion Based on Block Matching Algorithm with Multi-size blocks”, Proceedings of 2005 International Symposium on Intelligent Signal Processing and Communication Systems, 2005. ISPACS 2005. 13-16, pp.353 - 356, Dec. 2005
[12]“Robust motion-compensated video upconversion” Ojo O.A., de Haan G., IEEE Transactions on Consumer Electronics, Volume 43, Issue 4, pp.1045 - 1056, Nov. 1997.
[13]Sung-Hee Lee, Ohjae Kwon, Rae-Hong Park, “Weighted-adaptive motion-compensated frame rate up-conversion” IEEE Transactions on Consumer Electronics, Volume 49, Issue 3, pp.485 - 492, Aug. 2003.
[14]EePing Ong, Hua Wang, Ping Xue, “Video coding based on true motion estimation”, (ICASSP '03). 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceeding, Volume 3, 6-10, pp. 409-12, April 2003.
[15]Libo Yang, Yu, K., Jiang Li, Shipeng Li, “An Effective Variable Block-Size Early Termination Algorithm for H.264 Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, Volume 15, Issue 6, pp.784 - 788, June 2005
[16]Yen-Kuang Chen, Yun-Ting Lin, Kung S.Y., “A feature tracking algorithm using neighborhood relaxation with multi-candidate pre-screening”, International Conference on Image Processing, 1996. Proceedings, Volume 1, 16-19, pp.513 - 516, Sept. 1996
[17]Hilman, K., Hyun Wook Park, Yongmin Kim, “Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences”, IEEE Transactions on Circuits and Systems for Video Technology, Volume 10, Issue 6, pp.869 – 877, Sept. 2000.
[18]de Haan G., “IC for motion-compensated de-interlacing, noise reduction, and picture-rate conversion” IEEE Transactions on Consumer Electronics, Volume 45, Issue 3, pp.617 - 624, Aug. 1999.
[19]de Haan, G.; Biezen, P.W.A.C., “An efficient true-motion estimator using candidate vectors from a parametric motion model”, IEEE Transactions on Circuits and Systems for Video Technology, Volume 8, Issue 1, pp.85 - 91, Feb. 1998.
[20]Al-Mualla M.E., “Motion field interpolation for frame rate conversion”, 2003. ISCAS '03. Proceedings of the 2003 International Symposium on Circuits and Systems, Volume 2, 25-28, pp.652 655, May 2003.
[21]Pelagotti A., de Haan G. ,“A new algorithm for high quality video format conversion” 2001 International Conference on Image Processing, 2001. Proceedings.Volume 2, 7-10, pp.375 - 378, Oct. 2001.
[22]Yu-Lin Chang, Shyh-Feng Lin, Ching-Yeh Chen, Liang-Gee Chen, “Video De-Interlacing by Adaptive 4-Field Global/Local Motion Compensated Approach” IEEE Transactions on Circuits and Systems for Video Technology, Volume 15, Issue 12, pp.1569 - 1582, Dec. 2005.
[23]Demin Wang; Daniel Lauzon, “Hybrid algorithm for estimating true motion fields” Optical Engineering, Volume 39, No. 11, pp. 2876-2881, Nov. 2000.