臺灣博碩士論文加值系統

H.264/AVC是最新一代的視訊壓縮標準。藉由使用許多有效的方法，相較於之前的視訊標準，H.264提供了更高的壓縮效能，在相同的壓縮比率下提供更好的影像品質。其中一個方法就是採用了去區塊瀘波器，使得壓縮效率得以提升並有效率地移除區塊雜訊進而提升畫面品質。在本論文中，我們實作了一個資料重覆使用的高速去區塊瀘波器，期望能達到高解析度的數位電視、無線通訊上的影像解碼需求。
針對能支援多種視訊編碼標準的解碼器，我們成功地整合了應用在不同視訊標準的去區塊瀘波器，比起各別去用硬體實現所花費的硬體成本總合，我們所提出來的雙模去區塊瀘波器能省下約30%的硬體成本。
另外，針對即時影像通訊的應用，我們採用錯誤補償的方式以降低影像品質在傳輸過程中遇到錯誤所造成的影響。在本論文中，我們提出了以去區塊瀘波器為基礎的錯誤補償演算法，並實作了一個具錯誤補償功能的去區塊瀘波器。相較於一般的錯誤補償演算法，我們所提出來演算法藉由共用硬體的方法省下了約30%的硬體成本。
最後，我們將本論文所提的具錯誤補償功能之去區塊瀘器整合到H.264解碼器上。從模擬上可以得知，我們所提出的去區塊瀘器在硬體成本及功率消耗上只佔了整個解碼器的13%跟16%。

Contents

CHAPTER 1 INTRODUCTION 1
1.1 VIDEO CODING STANDARDS 1
1.2 H.264/AVC STANDARD OVERVIEW 2
1.2.1 Profiles and Levels 3
1.2.2 Encoder/Decoder Block Diagram 6
1.2.3 Deblocking Filter 7
1.3 ERROR CONCEALMENT 9
1.4 THESIS ORGANIZATION 10
CHAPTER 2 ALGORITHMS FOR DEBLOCKING FILTER AND ERROR CONCEALMENT 12
2.1 DEBLOCKING FILTER FOR H.264/AVC 12
2.1.1 Adaptivity of Deblocking Filter in H.264/AVC 13
2.1.1.1 Block-edge Level Adaptivity 13
2.1.1.2 Sample Level Adaptivity 14
2.1.1.3 Slice Level Adaptivity 16
2.1.2 Filtering Process of Deblocking Filter in H.264/AVC 16
2.1.2.1 Normal Mode of Deblocking Filter with BS Less than 4 16
2.1.2.2 Strong Mode of Deblocking Filter with BS Equals 4 18
2.2 ERROR CONCEALMENT 20
2.2.1 Spatial Error Concealment Algorithms 21
2.2.1.1 Bilinear interpolation 21
2.2.1.2 Directional Interpolation 22
2.2.1.3 Interpolation with Mode Decision 23
2.2.2 Temporal Error Concealment Algorithms 23
2.2.2.1 Temporal Replacement 24
2.2.2.2 Boundary Matching Algorithm 24
2.2.2.3 Motion Vectors Recovery Based on Polynomial Model 25
2.2.3 Summary 26
CHAPTER 3 DESIGN OF HIGH THROUGHPUT DEBLOCKING FILTER 27
3.1 DESIGN FOR HIGH THROUGHPUT AND HIGH RESOLUTION APPLICATIONS 27
3.1.1 Memory Organization between Prediction and Loop-filter 28
3.1.1.1 Memory Organization 28
3.1.1.2 Slice and Content Memory 30
3.1.1.3 Hybrid Scheduling 31
3.1.1.4 Proposed Architecture of Deblocking Filter 32
3.1.2 Simulation Results 35
3.1.3 Summary 37
3.2 DESIGN FOR MULTI-STANDARD APPLICATIONS 37
3.2.1 Motivation 37
3.2.2 Loop/Post Deblocking Filter 38
3.2.2.1 Mode Decision 39
3.2.2.2 Filtering Mode 40
3.2.3 Simulation Result 41
3.2.4 Summary 42
CHAPTER 4 JOINT ARCHITECTURE OF ERROR-CONCEALED DEBLOCKING FILTER FOR H.264 DECODER 43
4.1 DESIGN FOR LOW-COST AND REAL-TIME APPLICATION FOR VIDEO TRANSMISSION 43
4.1.1 Problem Formulation 43
4.1.2 Error-Concealed Deblocking Filter 44
4.1.2.1 Edge Detection 46
4.1.2.2 Replacement 47
4.1.2.3 Smoothing 48
4.1.2.4 Reconstructing flow 49
4.1.3 Simulation Results 49
4.1.4 Implementation results 51
4.1.5 Summary 52
4.2 PERFORMANCE ANALYSIS OF ECDF 52
4.2.1 Motivation 52
4.2.2 Ideal Functions 53
4.2.2.1 Edge Detection 53
4.2.2.2 Replacing 54
4.2.3 Simulation Result 56
4.2.4 Summary 57
CHAPTER 5 CHIP IMPLEMENTATION FOR MOBILE APPLICATIONS 58
5.1 SYSTEM SPECIFICATION 58
5.2 DESIGN FLOW 58
5.3 IMPLEMENTATION RESULT 59
5.4 MEASUREMENT RESULTS AND COMPARISON 62
CHAPTER 6 CONCLUSION AND FUTURE WORK 65
6.1 CONCLUSIONS 65
6.1.1 High-throughput Design 65
6.1.2 In/Post-loop filter 66
6.1.3 Error-concealed Deblocking Filter 66
6.1.4 Chip Implementation 67
6.2 FUTURE WORKS 67
6.2.1 Error Detection 67
6.2.2 Temporal Error Concealment 68
6.2.3 Multi-standard solution 69
BIBLIOGRAPHY 70

[1] P. List, A. Joch, J. Lainema, G. Bjøntegaard and M. Karczewicz, “ Adaptive Deblocking Filter”, IEEE Trans. Circuit Systems for Video Technology, vol. 13, pp. 614-619, July 2003.
[2] Y. Wang and Q. F. Zhu, “ Error control and concealment for video communication: a review,” Proceedings of the IEEE, vol. 86, no.5, pp 974-997, May 1998.
[3] Thomas Wiegand, Gray J. Sullivan, G. Bjøntegaard and Ajay Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Trans. Circuits System for Video Technology, Vol. 13, no. 7, pp. 560-576, July 2003.
[4] J.W. Suh, Y.S. Ho, “Error Concealment based on Directional Interpolation,” IEEE Trans. on consumer Electronics, vol. 43, no. 3, pp. 295-302, Aug. 1997.
[5] Dimitris Agrafiotis, David R. Bull and C. Nishan Canagarajah, “Enhanced Error Concealment with Mode Selection,” IEEE trans. on Circuits and Systems, vol. 16, issue 8, pp 960-973, Aug. 2006.
[6] Pei-Jun Lee, H.H. Chen and Liang-Gee Chen, “A new error concealment algorithm for H.264 video transmission,” in Proc. 2004 Int. Symp. Multimedia video and Speech Processing, pp. 619~622, Oct. 2004.
[7] Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264/ISO/IEC 14496-10 AVC), Mar. 2003.
[8] ITU-T Recommendation H.263: “Video Coding for Low Bitrate Communication”, March 1996.
[9] Miao Sima, Yuanhua Zhou and Wei Zhang, “an Efficient Architecture for Adaptive Deblocking Filter of H.264/AVC Video Coding” IEEE Transactions on Consumer Electronics, Vol. 50, Issue 1, pp. 292-296, Feb. 2004.
[10] Yu-Wen Huang, To-Wei Chen, Bing-Yu Hsieh , Tu-Chih Wang, Te-Hao Chang and Liang-Gee Chen, “Architecture Design for Deblocking Filter in H.264/JVT/AVC” International Conference on Multimedia and Expo(ICME’03), Vol. 1, pp. I-693-6, July 2003.
[11] ISO/IEC 14496-2:2001, “Information Technology – Generic Coding of Audio-Visual Object Part 2: Visual”, 3rd Ed. Annex F.3 – Post processing for coding noise reduction, Mar. 2003
[12] Tsu-Ming Liu, Wen-Ping Lee, Ting-An lin and Chen-Yi Lee, “A Memory-Efficient Deblocking Filter for H.264/AVC Video Coding,” IEEE International Symposium on Circuit and System (ISCAS’05), pp. 2140-2143, Kobe, Japan, May 2005.
[13] Wen-Ping Lee, Tsu-Ming Liu and Chen-Yi Lee, “A Joint Architecture of Error-Concealed Deblocking Filter for H.264/AVC Video Transmission,” IEEE International Symposium on VLSI Design, Automation and Test (VLSI-DAT’07), Apr. 2007.
[14] Tsu-Ming Liu, Ting-An Lin, Sheng-Zen Wang, Wen-Ping Lee, Kang-Zheng Hou, Jiun-Yan Yang and Chen-Yi Lee, “An 865-μW H.264/AVC Video Decoder for Mobile Applications”, IEEE Asian Solid-state Circuit Conference (A-SSCC’05), pp. 301-304, HsinChu, Nov. 2005.
[15] ETSI TS 102 005, Digital Video Broadcasting (DVB); Specification for the use of Video and Audio Coding in DVB services delivered directly over IP.
[16] B. Sheng, W. Gao and D. Wu, “An Implemented Architecture of Deblocking Filter for H.264/AVC”, IEEE International Conference on Image Processing, Vol. 1, pp. 665-668, Oct. 2004.
[17] Shen-Yu Shih, Cheng-Ru Chang and Youn-Long Lin, “ A near optimal deblocking filter for H.264 advanced video coding.” In Proc. IEEE ASP-DAC, pp. 170-175, Jan. 2006.
[18] http://ftp3.itu.int/av-arch/jvt-site/draft_conformance/
[19] Yen-Lin Tung, Hsiu-Chen Shu and Jin-Jang Leou, “an Error Detection and Concealment Scheme for H.264 Video Transmission,” IEEE International Conference on Multimedia and Expo. (ICME’04), pp. 1735-1738, 2004.
[20] Tsu-Ming Liu and Chen-Yi Lee, “An Improved Soft-Input CAVLC Decoder for Mobile Communication Applications.” IEEE Asia-Pacific Conference on Circuits and Systems (APCCAS’06), pp583-586, Singapore, Dec. 2006.
[21] Donghyung Kim, Siyoung Yang and Jechang Jeong, “A New Temporal Error Concealment Method for H.264 using Adaptive Block Sizes,” IEEE International Conference on Image Processing, vol. 3, pp. 928 – 931, Sept. 2005.