臺灣博碩士論文加值系統

本論文利用FFmpeg來解析網路攝影機之H.264/AVC視訊串流結構，以檢測不同廠牌的網路攝影機所傳輸的視訊結構內容。我們將FFmpeg解碼過程中所呼叫執行之解碼函式，依H.264/AVC標準解碼器的功能模組進行分類，並記錄所需檢測的項目資訊，詳細的檢視串流結構之完整內容，並量測個別模組所需解碼時間。以所提方法檢視兩款不同廠牌之網路攝影機時，得知其所傳輸的視訊串流結構內容因經濟成本及硬體效能而有所差異，導致支援技術上的程度有限，如所使用的熵解碼方式、DCT反轉換區塊大小、宏塊大小、預測模式的使用選擇不同。在各功能模組所耗費的解碼效能上，經量測得知解碼的效能會因為支援程度及解析度的差異而影響。在非高畫質解析度的情況下，熵解碼與畫面間預測所佔時間最多；當解析度達高畫質時，則去區塊效應濾波器所耗時間上升，與熵解碼及畫面間預測成為三大耗時功能模組。透過以上檢測及時間量測數據之資訊，可利於開發商及研究者進行驗證及確認，使其達到研究前的可行性，及開發後的確認性。

In this research, we use the FFmpeg which is a commonly used media player to parse the structure of H.264 Video Streaming. Because of the Network camera manufactured by different chipsets, the structures of video streaming encoded by the chipsets are different. The execution flow of the FFmpeg decoding process is analyzed, and the corresponding information of detection is recorded. We examine the complete content of video streaming, and measure the decoding time for each function module. Two different network cameras are prepared and tested by the proposed method, and the results are tabulated for the convenience of comparison. The performance of various functional models of H.264 are also analyzed, and the results are represented by charts.

摘要................................................................................................................................i
ABSTRACT...................................................................................................................ii
目錄..............................................................................................................................iii
圖目錄............................................................................................................................v
表目錄...........................................................................................................................vi
第一章前言..................................................................................................................1
1.1 研究背景與動機........................................................................................1
1.2 相關文獻探討............................................................................................3
1.3 論文目標....................................................................................................3
1.4 論文架構....................................................................................................4
第二章 H.264基本概念...............................................................................................5
2.1 H.264簡介.................................................................................................5
2.2 基準配置文件............................................................................................6
2.3 高級配置文件..........................................................................................10
2.4 串流傳輸結構..........................................................................................13
2.4.1 網路提取層概述................................................................................13
2.4.2 序列參數集與圖像參數集................................................................14
2.4.3 條帶資訊............................................................................................16
第三章研究方法........................................................................................................18
3.1 FFmpeg結構分析....................................................................................18
3.2 FFmpeg之H.264功能模組.....................................................................21
3.2.1 熵解碼................................................................................................21
3.2.2 DCT反轉換.........................................................................................24
3.2.3 畫面內預測與畫面間預測................................................................26
3.2.4 去區塊效應濾波器............................................................................28
3.3 檢測項目..................................................................................................29
第四章實驗結果........................................................................................................31
4.1 實驗環境..................................................................................................31
4.2 實驗結果與討論......................................................................................31
第五章結論與未來研究............................................................................................38
5.1 結論..........................................................................................................38
5.2 未來研究方向..........................................................................................39
參考文獻......................................................................................................................40
附件A H.264解碼語法...............................................................................................42
A.1 NAL-unit解碼語法..................................................................................42
A.2 序列參數集解碼語法..............................................................................42
A.3 圖像參數及解碼語法..............................................................................43
A.4 條帶標頭解碼語法..................................................................................44
A.5 條帶資料解碼語法..................................................................................46
A.6 巨宏塊層解碼語法..................................................................................47
A.7 巨宏塊預測解碼語法..............................................................................48
A.8 冗餘區塊解碼語法..................................................................................49
A.9 CAVLC冗餘區塊解碼語法....................................................................50
A.10 CABAC冗餘區塊解碼語法....................................................................51
附件B H.264巨宏塊類型表.......................................................................................53
B.1 I條帶的巨宏塊類型................................................................................53
B.2 P條帶的巨宏塊類型...............................................................................54
附件C FFmpeg完整解碼函式呼叫圖.........................................................................55

[1]
T. Wiegand, G.J. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Transactions on Circuits Systems for Video Technology, vol. 13, no. 7, pp. 560-576, July 2003.
[2]
“Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264/ISO/IEC 14496-10 AVC version 1,” in Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVTG050, 2003.
[3]
Iain E. G. Richardson, H.264 and MPEG-4 Video Compression, John Wiley &; Sons, 2003.
[4]
G.J. Sullivan, T. Wiegand, D. Marpe, and A. Luthra, “Text of ISO/IEC 14496 10 Advanced Video Coding 3rd Edition,” Joint Video Team (JVT) of ISO/IEC MPEG &; ITU-T VCEG, July 2004.
[5]
(2012, July 18). FFmpeg team Reference Software FFmpeg [online]. Available: http://www.ffmpeg.org/
[6]
A. Luthra, G.J. Sullivan, and T. Wiegand, “Introduction to the special issue on the H.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for video Technology, vol. 13, pp. 557-559, July 2003.
[7]
J. Ostermann, J. Bormans, P. List, D. Marpe, M. Narroschke, F. Pereira, T. Stockhammer, and T. Wedi, “Video coding with H.264/AVC: tools, performance, and complexity,” IEEE Circuits and Systems Magazine, vol. 4, pp. 7-28, First Quarter 2004.
[8]
A. Tamhankar, and K.R. Rao, “An overview of H.264/MPEG-4 part 10,” in Proceedings of 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications, 2003, vol. 1, pp. 1-51.
[9]
G.J. Sullivan, P.N. Topiwala, and A. Luthra, “The H.264/AVC advanced video coding standard: overview and introduction to the fidelity range extensions,” in Proceedings of SPIE conference on Applications of Digital Image Processing XXVII, 2004, vol. 5558, pp. 454-474.
[10]
D. Marpe, T. Wiegand, and S. Gordon, “H.264/MPEG4-AVC fidelity range extensions: tools, profiles, performance, and application areas,” in Proceedings of IEEE International Conference on Image Processing, 2005, vol. 1, pp. I-593-6.
[11]
Michelle M. Brown, “Hardware Study on the H.264/AVC Video Stream Parser,” M.S. thesis, Department of Computer Engineering, University of Rochester, New York, U.S.A, 2008.
[12]
佚名. (2010, February 8). H.264視頻編碼器的研究與分析 [online]. Available: http://www.cnsjba.cn/mianfei/yingyong/201002/746.html
[13]
Codecian Inc., (2012, July 18). CodecVisa [online]. Available: http://www.codecian.com/index.html
[14]
PELCO INC. (2009, September 29). 淺談H.264的編碼格式 [online]. Available: http://forum.netcontrol.tw/viewtopic.php?f=49&;t=877
[15]
李世平. (2006, May 5). H.264開源解碼器評測 [online]. Available: http://blog.csdn.net/sunshine1314/article/details/712401