臺灣博碩士論文加值系統

在無線視訊傳輸研究中，如何使位元率、計算量與抗誤力之間能有一個最佳的解決方案，一直是所有研究人員的難題，為了找到了一個較佳的解決方案，本論文分析了H.264錯誤恢復工具的優缺點，並根據普遍存在的大量增加位元率缺點，發展出以平均三點次取樣技術應用於多重描述編碼。文中提出改善直接次取樣的平均三點次取樣技術，以保留像素間的相關性以提昇壓縮效能，並導出平均三點次取樣的近似還原公式，並進一步利用平均三點次取樣的特性實現有別於方塊層次錯誤隱藏(Block-wise error concealment)的像素層次錯誤隱藏技術(Pixel-wise error concealment)，可使錯誤隱藏技術更為細緻，畫面更平順；而考量到計算量的問題，我們提出只傳送二個描述就可達到相同的品質以降低計算量的方式。
根據實驗結果：本論文所提出的H.264 SS MDC比直接次取樣應用於MDC的位元率降低了約50%。而H.264的計算量也降低了1/2。當封包遺失時，pixel-wise error concealment的實現可使人眼感覺更加平順。

How to get a balance among the bit-rate, the power-consumption, and the error robustness is a very difficult problem in the wireless video transmission field.
After analyzing many H.264 error resilience tools, we find a common defect which the bit-rate will drastically increase with the robustness of error resistance and proposed an Average 3-point sub-sample(A3_45) based multiple description coding(MDC) technique to improve the compression capability by saving the inter-pixel redundancy rather than reduce it in the ordinary spatial sub-sample method.
Besides that, the characteristic of the Average 3-point sub-sample(A3_45) based multiple description coding(MDC) technique is suitable for Pixel-wise error concealment which can have more exquisite video than Block-wise error concealment.
In addition, we find that even with only two compression descriptions, we can efficiently decrease the power-consumption without sacrificing the visual quality.
As experiment results show, we can verify that H.264 SS MDC proposed in this thesis have almost 50% lower bit-rate than direct sub-sample method and efficiently decrease up to half the power-consumption. Especially when packets are lost, pixel-wise error concealment can cause much better visual quality.

摘 要 i
ABSTRACT ii
誌謝 iii
圖目錄 vi
表目錄 viii
第一章 緒論 1
1.1 研究動機 1
1.2 研究背景與回顧相關研究 1
1.3 研究目標 3
1.4 論文主要的貢獻 3
1.5 各章提要 3
第二章 背景 4
2.1 視訊通訊網路 4
2.2 無線視訊IP網路協定 4
2.2.1 實體層與鏈結層 5
2.2.2 網路層 (Network layer) 5
2.2.3 傳輸層 (Transport Layer) 5
2.2.4 應用層 (Application Layer) 6
2.3 H.264視訊壓縮標準 8
2.3.1 H.264 視訊編碼層(Video Coding Layer, VCL) 9
2.3.2 H.264 網路適應層(Network Abstraction Layer, NAL) 19
2.4 行動通道特性 20
第三章 網路錯誤控制與H.264錯誤控制機制 21
之實現與評估 21
3.1 傳輸服務平台錯誤控制 21
3.2應用層服務平台錯誤控制 22
3.3 H.264 錯誤恢復工具 22
3.3.1 畫面分割(Picture Segmentation) 23
3.3.2 插入Intra-方塊或畫面(Placement of Intra macroblock、Intra slice or Intra frame) 24
3.3.3 參考畫面選擇(Reference Picture Selection, RPS) 25
3.3.4 資料分割(Data Partition, DP) 26
3.3.5 參數集(Parameter Sets) 27
3.3.6有彈性的巨方塊次序(Flexible Macroblock Ordering , FMO) 27
3.3.7冗餘切片(Redundant slices, RS) 28
3.4 H.264 錯誤恢復工具實現與分析 29
3.4.1 評估準則 29
3.4.2 位元率與計算量比較 30
3.4.3 視覺品質比較 32
第四章 H.264次取樣雙重描述編碼 36
4.1 H.264次取樣多重描述編碼 36
4.1.1 H.264 SS MDC次取樣器(Sub-sampler)與超解析度重建器(Super-Resolution Reconstructor) 37
4.1.2 H.264編解碼器 49
4.1.3封包獨立傳輸通道 49
4.2 H.264 SS/MDC整體性能評估與討論 49
4.2.1 評估標準 50
4.2.2 固定QP下位元率與計算量之比較與討論 50
4.2.3 H.264 SS/MDC視覺品質實驗結果與討論 53
第五章 結論與未來研究 61
附錄 A 投搞內容 62

[1] Ghys, Freddy, and Artech House, “3G multimedia network services, accounting, and user profiles,” Artech House, 2003.
[2] Wenjun Zeng and Jiangtao Wen, “3G Wireless Multimedia: Technologies and Practical Issues,” IEEE ICIP 2002.
[3] 3GPP Technical Specification 3GPP TR 26.140: “Multimedia Messaging Service (MMS); Media formats and codecs”
[4] 劉醇豐，”在異質IP 網路中利用壅塞遺失比提升TCP效能之研究”，碩士論文，國立交通大學資訊工程學系，July 2000
[5] Yao Wang, Ya-Qin Zhang, ”Video Processing and Communications,” Prentice Hall, 2002
[6] Y. Wang, G. Wen, S. Wender, and A. K. Katsaggelos, “Review of error resilient techniques for video communications,” IEEE Signal Processing Mag., vol. 17, pp. 61-82 July 2000
[7] T. Stockhammer, M. Hannuksela, and T. Wiegand, “H.264/AVC in wireless environments,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp 657-673, July 2003.
[8] Video Coding for Low Bitrate Communication, Version 2, ITU-T Recommendation H.263, 1998.
[9] G. Côté and F. Kossentini, “Optimal intra coding of blocks for robust video communication over the internet,” EUROSIP J. Image Commun.—Special Issue on Real-time Video Over the Internet, pp. 25–34, Sept. 1999.
[10] Yao Wang, Amy R. Reibman, and Shunan Lin, “Multiple Description Coding for Video Delivery,” Proceedings of IEEE, Vol. 93, NO. 1, January 2005.
[11] M.Orchard, Y. Wang, V. Vaishampayan, and A. Reibman, “Redundancy rate distortion analysis os multiple description image coding using pair wise correlating transforms” in Proc. ICIP 97, vol. 1, Santa Barbara, CA, Oct. 1997, pp. 608-611.
[12] W. Jiang and A. Ortega, “Multiple description coding via polyphase transform and selective quantization,” in Proc. VCIP 99, vol. 3653, Feb. 1999, pp. 998-1008.
[13] N. Franchi, M. Fumagalli, and R. Lancini, “Flexible redundancy insertion in a polyphase down-sampling multiple description image coding,” in Proc. ICME 2002, Lausanne, Switzerland, Aug. 2002, pp. 605-608.
[14] S. Shirani, M. Gallant, and F. Kossentini, “Multiple decription image coding using pre- and post-processing,” in Proc. Int. TCC, Las Vegas, NV, Apr. 2001, pp. 35-39.
[15] V. A. Vaishampayan, “Design of multiple description scalar quantizer,” IEEE Trans. Inform. Theory, vol. 39, pp. 821–834, May1993.
[16] Y. Wang, M. Orchard, V. Vaishampayan, and A. Reibman, “Multiple description coding using pairwise correlating transforms,” IEEE Trans. Image Processing, vol. 10, pp. 351–366, Mar. 2001.
[17] X. Yang and K. Ramchandran, “Optimal multiple description subband coding,” in Proc. ICIP 98, vol. 1, Chicago, IL, Oct. 1998, pp. 654-658.
[18] M. Srinivasan and R. Chellappa, “Multiple description subband coding,” in Proc. ICIP 98, vol. 1, Chicago, IL, Oct. 1998, pp.684-688.
[19] X. Tang and A. Zakhor, “Matching pursuits multiple description coding for wireless video,” IEEE Trans. Circuit Syst. Video Technol., vol. 12, no 6, pp.566-575, Jun. 2002.
[20] S. Wenger,”H.264/AVC over IP,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, NO. 7, July 2003.
[21] Video Coding for Low Bitrate Communication, Version 2, ITU-T Recommendation H.263, 1998.
[22] G. Côté and F. Kossentini, “Optimal intra coding of blocks for robust video communication over the internet,” EUROSIP J. Image Commun.—Special Issue on Real-time Video Over the Internet, pp. 25–34, Sept. 1999.
[23] S. Fukunaga, T. Nakai, and H. Inoue, “Error resilient video coding by dynamic replacing of reference pictures,” in IEEE Global Telecommunications Conf., vol. 3, New York, Nov. 1996, pp. 1503–1508.
[24] ISO/IEC 14496-2:1999, "Information technology - Coding of audiovisual objects - Part2: Visual", December 1999.
[25] T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the H.264/AVC Video Coding Standard,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 560-576, July 2003.
[26] T. Stockhammer,M. Hannuksela, and T.Wiegand, “H.264/AVC in wireless environments,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 657–673, July 2003.
[27] H.264/AVC Codec Software. [Online]. Available： http://iphome.hhi.de/suehring/tml/download/old_jm/jm96.zip
[28] VCEG. (1999) Internet Error Patterns VCEG-O38r1.doc. [Online]. Available：http://ftp3.itu.int/av-arch/video-site/9910_Red/q15i16r1.zip
[29] CIF Video Sequences, [Online]. Available：http://www.tkn.tu-berlin.de/research/evalvid/cif.html
[30] D.Nquyen, E.Dubois,“Spatio-Temporal Adaptive Interlaced To Progressive Conversion”, International Workshop on HDTV’ 92 Proceeding Vol. 2 , Nov.18-20 , 1992.
[31] H. Rabtanen,“Color Video Signal Processing With Median Filters”, IEEE Trans , On Consumed Electrons , Vol. 38 , No. 3 , pp.157-161 , Aug. 1992.
[32] Hee-Chul kim1, Byone-Heon Kwon2 , Myung-Ryul Choi,“An image Interpolation With Image Improvement For LCD Controller”, 1ASIC Lab. ,Dept. of EECI , Hanyang University 17 Hangdang-Dong, Seongdong-Ku, Seoul , 133-791, Korea.
[33] 沈岱範、邱垂汶，“使用視覺高頻增強濾波器之高品質超解析度影像與視訊研究”，國立雲林科技大學電機工程系，碩士論文，民國九十三年。
[34] R. Bernardini , M. Durigon , R. Rinaldo; L. Celerro , A. Vitali * , “POLYPHASE SPATIAL SUBSAMPLING MULTIPLE DESCRIPTION CODING OF VIDEO STREAMS WITH H264”, Image Processing, 2004. ICIP ''04. 2004 International Conference on Publication Date: 24-27 Oct. 2004 , Page(s)：3213-3216