臺灣博碩士論文加值系統

隨著多媒體技術的發展，人們享受視訊影像服務的需求品質越來越高，一場球賽或是一部電影的拍攝不是一台攝影機一鏡到底可以完成，而是同時有多部攝影機同時拍攝，使觀賞者能從多個視角來觀看。而這攝影所產生之資料量若以傳統壓縮概念來做編碼，則資料量是呈倍數成長，因此ITU-T制定Multi-view Video Coding (MVC) Standard，採用多個視角視訊間之資料相依性來進行資料壓縮。而本論文提出一可彈性擴充視角之多視角視訊解碼器系統，除了讓觀賞者在觀看影片時能夠即時且同步解壓縮多個視角畫面來觀看之外，此系統之最大設計特色是在於可支援彈性視角擴充技術，IC設計者可以依照多視角視訊系統所支援之視角數目，彈性增減多視角視訊解碼器核心所需個數，此設計特性非常適合未來3D IC之堆疊製造，除了利用3D IC所提供之高記憶體存取頻寬特性以滿足多視角視訊解碼需求外，也可以利用3D IC堆疊彈性，依視角數需求進行不同數目之多視角視訊解碼器核心之堆疊製造，僅需要進行搭配之韌體設定即可。
本論文所提出之多視角視訊解碼器核心可支援雙視角HD即時視訊解碼，藉由本作品所提出之設計技術，可以同時使用四個多視角視訊解碼器核心來完成八個視角視訊解碼。依此設計概念，可達到本論文所訴求之可彈性擴充視角之多視角視訊解碼器系統功能，同時也善用3D IC所提供之高記憶體存取頻寬特性與3D IC堆疊彈性，為未來多視角視訊解碼系統提出一個可行之系統設計方法。

Nowadays, people require high quality video/image service in a more eager way. One movie or one ball game could not be filmed by only one camera. Multi cameras would be used simultaneously to get different view angles. As a result, there are much more video data needed to compress. If we adopt the past video coding standards, we need to process a laige amount of video data. The ITU-T formulates the Multi-view Video Coding (MVC) Standard which takes advantage of video data dependency from different views to reduce the quantity of data to be processed. The proposed thesis named “A View-Scalable Multi-view Decoder Architecture Design” is able to decode the video which contents different views of multi-view video and supports the view-scalable flexibility. With this feature, SoC designers could not only adjust the number of MVC decoder cores and set the firmware parameters according to system requirements. This feature also benefits to adopting 3D IC packaging or implementation by exploiting high bandwidth SDRAM access.
In thsis proposed system, we are able to achieve two-view HD video decoding in real-time, so, we are able to use four decoder cores together for eight-view MVC video decoding. According to proposed design, we can achieve the demands of view-scalable multi-view decoder systems and make use of both the flexible stacking and high bandwidth access in 3D IC implementation. The proposed work is one feasible solution to approach flexible multi-view video decoder systems.

Chapter 1 Introduction ................................................................................................ 1
1.1 Background ........................................................................................................ 1
1.2 Motivation ........................................................................................................ 3
1.3 Organization ...................................................................................................... 4
Chapter 2 Previous Works............................................................................................... 5
2.1 H.264 Video Decoder Design ........................................................................................ 5
2.2 MVC Video Decoder Design .......................................................................................... 9
2.3 The Multi-view Video Coding Extension of the H.264/AVC Standard .................................................. 12
2.4 Summary .......................................................................................................... 18
Chapter 3 Proposed Multi-Core Decoder System ......................................................................... 19
3.1 Original Design – H.264/AVC High Profile Decoder ................................................................. 19
3.2 Proposed View-Scalable Multi-view Decoder System ................................................................. 21
3.3 Parallel partitioning on Software ................................................................................ 25
3.3.1 Two View Bit-stream Partition................................................................................... 25
3.3.2 Four View Bit-stream Partition ................................................................................. 29
3.3.3 POC and DPB Reference List Setting ............................................................................. 30
3.4 Hardware Design For Multiple Decoder ............................................................................. 33
3.4.1 Arbitration Design ............................................................................................. 33
3.4.2 Memory Planning................................................................................................. 36
Chapter 4 Performance Evaluation and Demonstration ................................................................... 38
4.1 Design Methodology ............................................................................................... 38
4.2 Performance Evaluation of MVC .................................................................................... 39
Chapter 5 Applications and Conclusion ................................................................................ 52
5.1 Application ...................................................................................................... 52
5.2 Conclusion ....................................................................................................... 53
Reference ............................................................................................................ 54

[1] A. Vetro, P. Pandit, H. Kimata, A. Smolic, and Y. Wang, “Joint Draft 8.0 on Multiview Video Coding,” Doc. JVT-AB204, Hannover, Germany, July 2008.
[2] Joint Video Team (JVT) reference software JMVC 3.0.
[3] Joint Video Team , “ITU-T Recommendation H.264,” Rec. ITU-T H.264, March 2009.
[4] Joint Video Team , ”Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification,” ITU-T Rec. H.264 and ISO/IEC 14496-10 AVC, May 2003.
[5] Joint Video Team (JVT) of ISO/IEC MPEG&ITU-T VCEG , “ISO/UEC 14496-10,” 2003.
[6] ISO/IEC JTC1/SC29/WG11, Proposal on standardization of free viewpoint TV (FTV), Doc. M13612, July 2006.
[7] A. Smolic, K. Müller, P. Merkle, C. Fehn, P. Kauff, P. Eisert, and T.Wiegand,“3D video and free viewpoint video – technologies , applications and MPEG standards,” in Proc. IEEE International Conference on Multimedia and Expo,July 2006, pp. 2161–2164.
[8] Y. Hu, A. Simpson, K. McAdoo, and J. Cush, “A high definition H.264/AVC hardware video decoder core for multimedia SoC’s,” Proc. IEEE ISCE, pp.385-389, Sept. 2004.
[9] T. M. Liu, T. A. Lin, S. Z. Wang, W. P. Lee, K. C. Hou, J. Y. Yang and C. Y. Lee, “An 865-μW H.264/AVC Video Decoder for Mobile Applications,” Proc.IEEE ASSCC, pp. 301-304, Nov. 2005.
[10] T. W. Chen, Y. W. Huang, T. C. Chen, Y. H. Chen, C. Y. Tsai, and L. G. Chen,“Architecture Design of H.264/AVC Decoder with Hybrid Task Pipelining for High Definition Videos,” Proc. IEEE ISCAS, pp. 2931-2934, vol. 3, May 2005.
[11] T. A. Lin, S. Z. Wang, T. M. Liu, and C. Y. Lee, “An H.264/AVC decoder with 4x4 block-level pipeline,” Proc. IEEE ISCAS, pp. 1810-1813, vol. 2, May 2005.
[12] Tung-Chien Chen, Yu-Wen Huang, and Liang-Gee Chen, “Analysis and design of macroblock pipelining for H.264/AVC VLSI architecture,” Proc. IEEE ISCAS, pp. 273-276, vol. 2, May 2004.
[13] Tzu-Der Chuang, Pei-Kuei Tsung, Pin-Chih Lin, Lo-Mei Chang,Tsung-Chuan Ma, Yi-Hau Chen, Liang-Gee Chen,” A 59.5mW Scalable/Multi-View Video Decoder Chip for Quad/3D Full HDTV and Video Streaming Applications,”ISSCC Dig. Tech. Papers, pp. 330-331, 2010.
[14] Pei-Kuei Tsung, Ping-Chih Lin, Kuan-Yu Chen, Tzu-Der Chuang,Hsin-Jung Yang, Shao-Yi Chien, Li-Fu Ding, Wei-Yin Chen,Chih-Chi Cheng, Tung-Chien Chen, Liang-Gee Chen,” A 216fps 4096×2160p 3DTV Set-Top Box SoC for Free-Viewpoint 3DTV Applications,” ISSCC Dig. Tech. Papers, pp.123-125,2011.
[15] Anthony Vetro, Thomas Wiegand, and Gary J. Sullivan, “Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard,” in Proc. IEEE, pp.626-642, April 2011.
[16] Li-Fu Ding, Pei-Kuei Tsung, Shao-Yi Chien,Wei-Yin Chen, and Liang-Gee Chen, “Content-Aware Prediction AlgorithmWith Inter-View Mode Decision for Multiview Video Coding,” IEEE Transactions on Multimedia, December 2008.
[17] Cheng-An Chien, Hsiu-Cheng Chang,and Jiun-In Guo,” A High Throughput In-Loop De-blocking Filter Supporting H.264/AVC BP/MP/HP Video Coding,” Proc. IEEE ISCAS, pp. 312-315, Nov. 2008.
[18] Yao-Chang Yang, and Jiun-In Guo,” High-Throughput H.264/AVC High-Profile CABAC Decoder for HDTV Applications,” IEEE Transactions on CSVT, vol. 19, Sep. 2009.
[19] Pei-Kuei Tsung, Pin-Chih Lin, Kuan-Yu Chen and Liang-Gee Chen,”Six-Dimensional Free-viewpoint Synthesis Flow for QFHD Free-viewpoint/Multiview 3DTV Applications,” IEEE International Conference
on Multimedia and Expo, pp. 1-4, July 2011.
[20] Shiping Zhu, and Liyun Li.” Research on Multiview Video Coding,” International Conference on Computer Science and Electronics Engineering, pp. 514-518, March 2012.