臺灣博碩士論文加值系統

隨著多媒體編碼技術的蓬勃發展，結合無線網路來提供各種多媒體應用為目前重要的趨勢。由於以無線網路傳送H.264/AVC視訊封包時，會發生封包遺失的現象，導致後續的視訊資訊產生錯誤蔓延(error propagation)情形及觀看品質的下降。為了解決封包遺失的問題，本篇論文提出一個估算方法根據H.264/AVC之編解碼最小單位巨方塊為依據，以畫面群(group of picture, GOP)做不平等保護(unequal loss protection, ULP)及前向錯誤更正(foreard error correction, FEC)封包分配。此估算方法為Frame Macroblock Error Propagation Index (FMEPI)來決定每張畫面發生錯誤時，影響整體視訊品質的一個重要程度索引值，並且根據FMEPI值來分配不同數量的FEC封包。最後，模擬實驗結果顯示本論文所提出的方法與其它方法有較佳的視訊觀看品質(video quality)。

With the rapid advances in multimedia coding and networking technique, provide a variety of multimedia applications on wireless network. However, packet loss of transiting H.264/AVC videos on wireless network is normally inevitable, it lead to the information of the subsequent frame error propagation and the decline of watch quality. In order to solve the problem of packet
loss, this paper proposes an estimation method based on the H.264/AVC codec smallest unit of encoding and decoding. Provide to unequal loss protection on basic of the group of picture and allocate forward error correction. For this reason, we propses the estimation method which is Frame Macroblock Error Propagation Index to determine the importance of frame. Moreover, the impact of the overall video quality of an importance index that is according to FMEPI to allocate a different number of FEC packets. Finally, it was found from the simulation results that FMEPI method has better video quality than other methods.

論文摘要. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . i
ABSTRACT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ii
誌謝. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii
目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv
圖目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi
表目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
一、導論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.1 研究動機與目的. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 論文貢獻. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 論文架構. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
二、相關背景與知識. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.1 H.264/AVC視訊標準基本概述. . . . . . . . . . . . . . . . . . . . . . . . . 3
2.1.1 H.264/AVC發展歷史. . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.1.2 H.264/AVC訊框內作預測編碼. . . . . . . . . . . . . . . . . . . . . 6
2.1.3 H.264/AVC訊框間作預測編碼. . . . . . . . . . . . . . . . . . . . . 8
2.1.4 H.264/AVC多張參考訊框. . . . . . . . . . . . . . . . . . . . . . . . 10
2.1.5 視訊壓縮之訊框種類. . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.1.6 視訊訊框遺失的影響. . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.2 H.264/AVC錯誤隱藏回復機制. . . . . . . . . . . . . . . . . . . . . . . . . 12
2.3 網路傳輸封包回復機制. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
三、文獻回顧. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.1 文獻回顧總結. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
四、研究方法. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
4.1 方法架構. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
4.2 H.264/AVC視訊之訊框重要性估算. . . . . . . . . . . . . . . . . . . . . . . 20
4.2.1 回復訊框資訊所造成的視訊失真影響. . . . . . . . . . . . . . . . . 22
4.2.2 發生錯誤蔓延所造成的視訊失真影響. . . . . . . . . . . . . . . . . 24
4.3 訊框之前向錯誤更正封包分配. . . . . . . . . . . . . . . . . . . . . . . . . 25
4.3.1 前向錯誤更正封包演算法. . . . . . . . . . . . . . . . . . . . . . . 26
4.3.2 前向錯誤更正封包分配步驟. . . . . . . . . . . . . . . . . . . . . . 27
五、模擬實驗結果與分析. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
5.1 模擬環境. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
5.1.1 NS2模擬軟體. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
5.1.2 無線網路之封包傳輸遺失模型. . . . . . . . . . . . . . . . . . . . . 30
5.1.3 視訊影像品質. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
5.2 實驗參數設定. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
5.3 模擬結果. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
5.3.1 模擬步驟. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
5.3.2 Suzie視訊序列之品質評估. . . . . . . . . . . . . . . . . . . . . . . 43
5.3.3 Mother-daughter視訊序列之品質評估. . . . . . . . . . . . . . . . . 49
5.3.4 Foreman視訊序列之品質評估. . . . . . . . . . . . . . . . . . . . . 55
5.3.5 實驗結果總結. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
六、結論與未來研究. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
6.1 結論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
6.2 未來研究. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
參考文獻. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

[1] Gang Sun,Wei Xing, and Dongming Lu, “An novel loss protection scheme for h.264 video
stream based on frame error propagation index,” in Communications and Networking,
2008, pp. 820–824.
[2] Gang Sun, Wei Xing, and Dongming Lu, “Low-complexity frame importance modelling
and resource allocation scheme for error-resilience h.264 video streaming,” in Multimedia
Signal Processing, 2008, pp. 809–814.
[3] T. Imai, J. Shiokawa, and I.and Kitade T. Chiba, H.and Esaki, “Mpeg-1 audio real-time
encoding system,” IEEE Transactions on Consumer Electronics, vol. 44, no. 3, pp. 888–
894, 1998.
[4] Tsung-Han Tsai, Liang-Gee Chen, and Yuan-Chen Liu, “A novel mpeg-2 audio decoder
with efficient data arrangement and memory configuration,” IEEE Transactions
on Consumer Electronics, vol. 43, no. 3, pp. 598–604, 1997.
[5] Dapeng Wu, Y.T. Hou, Wenwu Zhu, Hung-Ju Lee, Tihao Chiang, Ya-Qin Zhang, and H.J.
Chao, “On end-to-end architecture for transporting mpeg-4 video over the internet,” IEEE
Transactions on Circuits and Systems for Video Technology, vol. 10, no. 6, pp. 923–941,
2000.
[6] Steinbach E., Farber N., and Girod B, “Standard compatible extension of h.263 for robust
video transmission in mobile environments,” IEEE Transactions on Circuits and Systems
for Video Technology, vol. 7, no. 6, pp. 872–881, 1997.
63
[7] K.-H. Ho and D. P. K. Lun, “Content-based scalable h.263 video coding scheme for road
traffic monitoring,” in Workshop on Multimedia Data Storage, Retrieval, Integration and
Applications, 2000, pp. 163–170.
[8] T.Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the h.264/avc video
coding standard,” IEEE Trans. On CAS for video Technology, vol. 13, no. 7, pp. 560–576,
2003.
[9] E. G. Richardson, “H.264 and mpeg-4 video compression: Video coding for nextgeneration
multimedia,” in Chichester, West Sussex. England: John Wiley & Sons, 2003.
[10] Yao Wang and F. Zhu, “Error control and concealment for video communication: A
review,” Proceedings of the IEEE, vol. 89, pp. 974–997, May. 1998.
[11] Zhenyuan Chen, Chao Zhang, Jun Zhang, and GuoWei, “Arq protocols for two-way relay
systems,” in 2010 6th International Conference onWireless Communications Networking
and Mobile Computing. WiCOM2010, 2010.
[12] A. Chockalingam and M. Zorzi, “Wireless tcp performance with linklayer fec/arq,” in
IEEE Conference on Computer and Communications. ICC1999, Jun. 1999, pp. 1212–
1216.
[13] P. K. McKinley, C. Tang, and A. P. Mani, “A study of adaptive forward error correction for
wireless collaborative computing,” IEEE Transactions Parallel and Distributed Systems,
vol. 13, no. 9, pp. 936–947, Sep. 2002.
[14] C. H. Lin, C. H. Ke, C. K. Shieh, and N. K. Chilamkurti, “An enhanced adaptive fec
mechanism for video delivery over wireless networks,” in Proceedings of International
Conference on Networking and Services. ICNS’06, Jul. 2006, pp. 106–112.
[15] K. Park andW.Wang, “Afec: an adaptive forward error correction protocol for end-to-end
transport of real-time traffic,” in International Conference on Computer Communications
and Networks. ICCCN1998, Oct. 1998, pp. 196–205.
[16] P. C. Huang, K. C. Chu, H. F. Lo, W. T. Lee, and T. Y. Wu, “A novel adaptive
fec and interleaving architecture for h.264/svc wireless video transmission,” in
International Conference on Intelligent Information Hiding and Multimedia Signal
Processing. IIHMSP2009, 2009, pp. 989–992.
[17] P. Frossard and O. Verscheure, “Joint source/fec rate selection for quality-optimal mpeg2
video delivery,” IEEE Transaction on Image Processing, vol. 10, no. 12, pp. 1815–1825,
2001.
[18] X. K. Yang, C. Zhu, Z. G. Li, X. Lin, and N. Ling, “An unequal packet loss resilience
scheme for video over the internet,” IEEE Transactionon Multimedia, vol. 7, no. 4, pp.
753–765, Aug 2005.
[19] X. K. Yang, Ce Zhu, Z. G. Li, X. Lin, and N. Ling, “Unequal loss protection for robust
transmission of motion compensated video over the internet,” SignalProcessing: Image
Communication, vol. 18, pp. 157–167, March 2003.
[20] T. Fang and L.-P Chau, “A novel unequal error protection approach for error resilient
video transmission,” in Proceedings of IEEE International Symposium on Circuits and
Systems, 2005, pp. 4022–4025.
[21] X. Zhang and X. Peng, “An unequal packet loss protection scheme for h.264/avc video
transmission,” in International Conference on Information Networking. ICOIN 2009, Jan.
2009, pp. 1–5.
[22] X. Wang, K. Tang, and H. Cui, “A novel unequal error protection scheme for roi based
video coding in h.264/avc,” in International Conference on Computer Modeling and
Simulation. ICCMS2010, Jan. 2010, vol. 3, pp. 175–178.
[23] J. Goshi, A. Mohr, R. Ladner, E. Riskin, , and A. Lippman, “Unequal loss protection for
h.263 compressed video,” IEEE Trans. on Circuits Syst. Video Technol, vol. 15, no. 3, pp.
412–419, Mar. 2005.
[24] C. Huang and S. Liang, “Unequal error protection for mpeg-2 video transmission over
wireless channels,” IEEE Trans. On Signal Processing Image Communication, vol. 19,
pp. 67–79, 2004.
[25] M. Schaar and H. Radha, “Unequal packet loss resilience for fine-granular-scalability
video,” IEEE Trans. Multimedia, vol. 3, no. 4, pp. 381–393, Dec. 2001.
[26] K. Stuhlmueller, N. Faerber, and B. Girod, “Adaptive optimal intra update for lossy video
transmission,” Proc. SPIE, vol. 4067, no. 1, pp. 286–295, 2000.
[27] Y. Wang, Z. Wu, and J.M. Boyce, “Modeling of transmission-lossinduced distortion in
decoded video,” IEEE Transactions on Circuits and Systems for Video Technology, vol.
16, no. 6, pp. 716–732, 2006.
[28] X. K. Yang, C. Zhu, Z. G. Li, X. Lina nd, and N. Ling, “An unequal packet loss resilience
scheme for video over the internet,” IEEE Transaction on Multimedia, vol. 7, no. 4, pp.
753–765, August 2005.
[29] Ching-Lung Chang and Huan-Yao Kang, “Qos-based unequal frame protection for video
streaming,” in International Conference on Information Technology and Applications.
ICITA2010, 2010, pp. 95–99.
[30] Huan-Yao Kang and Ching-Lung Chang, “The decision scheme of frame importance
factor for video streaming system,” in International Conference on Broadband, Wireless
Computing, Communication and Applications. BWCCA, 2010.
[31] C. H. Lin, C. H. Ke, C. K. Shieh, and N. Chilamkurti, “An enhanced adaptive fec
mechanism for video delivery over wireless networks,” in International Conference on
Networking and Services. ICNS2006, 2006.
[32] C. H. Ke, N. Chilamkurti, G. Dudeja, and C. K. Shieh, “A new adaptive fec algorithm
for wireless lan networks,” in International Conference on Networks and Communication
Systems. IASTED2006, Mar. 2006, pp. 425–428.
[33] “Thenetworksimulator-ns-2,”[Online]http://www.isi.edu/nsnam/ns/
[34] Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, “Joint video (jm) - h.264/avc
referencesoftware,”ver18.0.[Online]http://iphome.hhi.de/suehring/tml/