跳到主要內容

臺灣博碩士論文加值系統

(18.97.9.172) 您好!臺灣時間:2025/02/18 05:35
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:林仲毅
研究生(外文):Tom C.-I. Lin
論文名稱:利用附加資訊之視訊抗誤編碼與傳輸
論文名稱(外文):Error Resilient Video Coding and Transmission by Using Side-information
指導教授:賴文能賴文能引用關係
指導教授(外文):Wen-Nung Lie
學位類別:博士
校院名稱:國立中正大學
系所名稱:電機工程所
學門:工程學門
學類:電資工程學類
論文種類:學術論文
論文出版年:2006
畢業學年度:94
語文別:英文
論文頁數:117
中文關鍵詞:抗誤編碼錯誤隱藏資料隱藏
外文關鍵詞:Error resilienceError concealmentData embedding
相關次數:
  • 被引用被引用:0
  • 點閱點閱:203
  • 評分評分:
  • 下載下載:13
  • 收藏至我的研究室書目清單書目收藏:0
近年來,隨著電腦網路的迅速普及與視訊壓縮技術的快速進步,視訊傳輸已成為人們在日常生活上隨處可見的聯絡方式,如3G手機與MSN的視訊通話機制。然而,為了減少傳輸所需的通道頻寬,視訊資料必須經過高壓縮比的視訊壓縮。但是視訊資料在高度壓縮的狀況下,將導致傳輸資料容易受到通道雜訊的影響而發生錯誤。因此,為了減少通道雜訊的影響並進而提升接收端的視訊品質,抗誤 (error resilience) 與錯誤遮掩(error concealment) 成為視訊傳輸中不可或缺的一環。雖然在現行的視訊壓縮標準中,已經存在了多種抗誤編碼的機制,但是這些機制依然有所不足。特別在高通道錯誤率的狀況下,接收端往往無法取得擁有可被接受品質的視訊資料。為此,我們提出利用附加資訊加強視訊傳輸系統的抗誤能力,而所使用的附加資訊將有助於提高「錯誤偵測」、「快速同步」與「錯誤遮掩」等的能力。
依據不同的錯誤型態、通道協定與編碼格式,有助於視訊傳輸抗誤能力的附加資訊的選擇也勢必有所不同。例如,在 circuit-switched 網路上,如何使解碼器可以快速恢復同步 (resynchronization) 以迅速減少錯誤對視訊的影響,也就是如何令解碼器可以在較小單位下快速恢復同步。在第三章中,我們提出利用附加資訊使解碼器可以在 macroblock layer恢復同步,而不再如同視訊編碼標準中的slice layer才能利用特殊碼進行同步的回復。對於 packet-switch 網路,每一個封包中包含了可獨立解碼的視訊資料,因此回復同步的附加資料將不再有助於提高抗誤能力。然而,改將附加資料利用於引導錯誤遮掩機制,以此提供更好的修復效果,這將是另一個較好的選擇。在第四章與第五章中,我們選定兩種附加資料用以提高錯誤遮掩的效能,進而取得較佳的解碼品質。對於獨立編碼影像 (I-frames) 而言,經過小波轉換的遮掩誤差影像 (concealment error image) 的低頻部分將被選定為附加資料,而對預估編碼影像 (P-frames) 而言,每個macroblock的最佳錯誤遮掩方法,將經過編碼後成為我們所選定的附加資料。
在本論文中,如何傳輸附加資料是另一個重要的研究課題。首先,附加資料可以透過另一個可靠的通道進行傳輸,例如:在第四章中,我們利用TCP/IP網路協定的通道傳輸資料。或者如同第三章與第五章中所使用的方法,利用資料嵌入技術將附加資料隱藏於視訊中進行傳輸。然而這兩種方式在使用上各有各自的問題。對資料嵌入而言,視訊將因為資料隱藏的影響導致品質降低。但對於利用另一個可靠通道傳輸而言,我們則必須面對如何使附加資料與視訊資料取得同步的問題。
透過我們的研究結果可以發現,在大部分的錯誤環境中,附加資料可以有效且顯著的提升視訊傳輸的解碼品質。另外,對於未來的研究我們提出了四個討論方向:
(1) 何種附加資料可以有效的提高視訊編碼的抗誤能力?
(2) 如何有效的傳輸附加資料?
(3) 附加資料應在何時傳輸最為適合?
(4) 何處是附加資料嵌入的最有效位置?
As the networking and compression technologies grow rapidly, video transmission becomes an obtainable component in our daily lives. As the video data is highly compressed, it will be much more prone to channel errors. Therefore, error resilience and error concealment techniques are required to improve video quality in presence of channel errors. Error resilience tools in video coding standards are still insufficient to provide videos with acceptable visual quality in high error rate condition. This motivates us to enhance the codec’s capability by exploiting side-information which is useful for error detection, error correction, resynchronization, error concealment, and so on.
Which kind of side-information is useful depends on the error type, network protocol, or the coding style. For example, in circuit-switched network, resynchronization with a smaller unit is better to reduce the error effects. Therefore, in chapter 3, we provide information for resynchronization at each MB, instead of at GOB or slice in coding standards. For packet-switched networks, where each packet contains an independent unit of video bitstream, the resynchronization information becomes useless, but the information for error concealment becomes a better choice to enhance the resulting quality of the corrupted video. In chapters 4 and 5, the index of best error concealment scheme for each MB in P-frames and the low frequency wavelets coefficients of concealment error image of I-frames are provided as the side-information to enhance the result of error concealment.
How to transmit the side-information is another issue in this research. It can be done by exploiting another reliable channel (such as TCP/IP) (in chapter 4) or using data embedding techniques (in chapters 3 & 5). However, they face different problems. For data embedding, the resulting quality degradation (or increase of bit rate) is the major concern. On the other side, the synchronization between side information and video main stream becomes a challenge if the side-information is transmitted through another reliable channel.
Our research results show that the side-information can provide significant improvement for recovering video quality in most cases of error conditions. By the way, our research raises a “4-W” direction for the future research:
1) What kind of the side-information should be effectively used?
2) How is the side-information effectively transmitted?
3) When is the side-information properly transmitted? and
4) Where is the side-information efficiently embedded?
1 Introduction 1
1.1 Effects of channel errors……………………………………………………. 2
1.2 Issues of error resilience and error concealment……………………………. 4
1.3 Side-information to improve visual quality………………………………… 4
1.4 Organization of dissertation………………………………………………… 5

2 Overview of error resilience tools 8

3 Enhancing video error resilience by using lossy data embedding techniques 14
3.1 Overview……………………………………………………………………. 14
3.2 Basic data embedding schemes……………………………………………... 17
3.3 Proposed error resilient video coding algorithm……………………………. 26
3.4 Simulations………………………………………………………………….. 31
3.5 Summary……………………………………………………………………. 42

4 Prescription-based error concealment technique 45
4.1 Overview……………………………………………………………………. 45
4.2 Prescription-based error concealment………………………………………. 49
4.3 Prescription-map compression……………………………………………… 54
4.4 Requirements on memory and processing power…………………………... 57
4.5 Experimental results………………………………………………………… 58
4.6 Remarks and summary……………………………………………………… 65

5 Error resilient coding based on reversible data embedding technique for H.264/AVC video 67
5.1 Overview …………………………………………………………………… 67
5.2 Previous works……………………………………………………………… 70
5.3 Architecture of prescription- based error concealment (PEC)……………… 72
5.4 Reversible data embedding…………………………………………………. 75
5.5 Self-healing spatial error concealment 81
5.6 Detailed three-stage processing of PEC 93
5.7 Experimental results………………………………………………………… 100
5.8 Summary……………………………………………………………………. 107

6 Conclusions and future works 109
6.1 Contribution of this research……………………………………………….. 109
6.2 Future works……………………………………………………………….. 111


Bibliography 113
List of publications 116
[1]ITU-T/SG15. Video coding for low bitrate communication. ITU-T Recommendation H.263, Version 1, ITU-T Geneva, 1996.
[2]J.L. Mitchell,W.B. Pennebaker, C.E. Fogg, and D.J. LeGall, MPEG video compression standard, Chapman & Hall, New York,1997.
[3]ITU-T/SG16/Q15. Video coding for low bitrate communication. ITU-T Recommendation H.263, Version 2 (H.263+), ITU-T Geneva, 1998.
[4]ISO/IEC JTC1/SC29/WG11/M2382, “Report of results on core experiment on error resilience for motion data with structured RVLC - E8,” July 1997
[5]A. H. Li, M. Fong, J. Wen, and J. D. Villasenor, “Test results of error resilience with modified error resilient syntax with data partitioning and RVLC,” ITU-T Documentation Q15-E-20, July 1998
[6]I.E.G. Richardson, H.264 and MPEG-4 Video Compression video coding for next generation multimedia, John Wiley & Sons Inc., NJ USA, 2003
[7]M.E. Al-Mualla, C.N. Canagarajah, and D.R. Bull, Video Coding for Mobile Communications Efficiency, Complexity, and Resilience, Elsevier Science, USA, 2002
[8]M.-T. Sun and A. R. Reibman, Compressed Video over Network, Marcel Dekker, Inc. New York, Basel, 2001.
[9]Y. Wang, S. Wenger, J. Wen, and A. K. Katsaggelos, “Error resilient video coding techniques,” IEEE Signal Processing Mag., vol. 17, no. 4, pp. 61–82, July 2000.
[10]Y. Wang and Q.-F. Zhu, “Error control and concealment for video communication,” Proc. IEEE, vol. 86, no. 5, pp. 974–997, May 1998.
[11]J. Wen and J. D. Villasenor, “Reversible variable length codes for efficient and robust image and video coding,” in Proc. of Data Compression Conference, pp. 471-480, 1998.
[12]D. W. Redmill and N. G. Kingsbury, “The EREC: an error-resilient technique for coding variable-length block of data,” IEEE Trans. Image Processing, vol. 5, no. 4, pp. 565-574, Apr. 1996.
[13]J. Song and K.J.R. Liu, “A data embedded video coding scheme for error-prone channels,” IEEE Trans. Multimedia, vol. 3, no. 4, pp. 415-423, Dec. 2001.
[14]ISO/IEC JTC1/SC29/WG11 MPEG99/N6340, “An Error Detection Scheme using Data Embedding for H.263 Compatible Video Coding,” July 2000.
[15]P. Yin, B. Liu, and H. H. Yu, “Error concealment using data hiding,” in Proc. of IEEE Int. Conf. Acoustic, Speech and Signal processing, pp. 1453-1456, 2001.
[16]L.W. Kang and J. J. Leou, “A new error resilient coding scheme for JPEG image transmission based on data embedding and vector quantization,” in Proc. of IEEE Int. Conf. Circuits and Systems, 2003
[17]H. Okada, A.E. Shiitev, H.S. Song, G. Fujita, T. Onoye, and I. Shirakawa, “Error detection by digital watermarking for MPEG-4 video coding,” IEICE Trans. Fundamentals, vol. E85-A, no. 6, pp. 1281-1288, June 2002.
[18]K.-Y. Yoo, “Adaptive resynchronization marker positioning method for error resilient video transmission,” Electronic Letters, vol. 34, no. 22, pp. 2084-2085, 1998.
[19]F. A. P. Petitcolas, R. J. Anderson, and M. G. Kuhn, “Information hiding – a survey,” Proc. IEEE, vol. 87, no. 7, pp. 1062-1078, July 1999.
[20]J. Huang, Y. Q. Shi, and Y. Shi, “Embedding Image Watermarks in DC Components,” IEEE Trans. Circuits and Syst. Video Technol., vol. 10, no. 6, pp. 974-979, Sept. 2000.
[21]H. C. Shyu and J. J. Leou, “Detection and concealment of transmission errors in MPEG images-a genetic algorithm approach,” IEEE Trans. Circuits and Syst. Video Technol., vol. 9, no. 6, pp. 937-948, 1999.
[22]W. Kwok and H. Sun, “Multi-directional interpolation for spatial error concealment,” IEEE Trans. Consumer Electronics, vol. 39, no. 3, pp. 455-460, Aug. 2003.
[23]H. Sun and W. Kwok, “Concealment of damaged block transform coded image using projections onto convex sets,” IEEE Trans. Image Process., vol. 14, no. 4, pp. 470-477, April 1995.
[24]S.-C. Pei and Y.-Z. Chou, “Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes,” IEEE Trans. Multimedia, vol. 6, no. 1, pp. 158-173, Feb. 2004.
[25]L. Tang and S. Yu, “Error concealment with error level tracking and backward frame update,” Electronic Letters, vol. 40, no. 17, pp. 1049-1050, Aug. 2004.
[26]W.-M. Lam, A. R. Reibman, and B. Liu, “Recovery of lost or erroneously received motion vectors,” Proc. of 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’93), vol. 5, pp. 417-420, Apr. 1993.
[27]M.-J. Chen, L.-G. Chen, and R.-M. Weng, “Error concealment of lost motion vectors with overlapped motion compensation,” IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 3, pp. 560-563, June 1997.
[28]J. Zhang, J.F. Arnold, M.R. Frater, and M.R. Pickering, “Video error concealment using decoder motion vector estimation,” Proc. of IEEE Region 10 Annual Conference on Speech and Image Technologies for Computing and Telecommunications, vol.2, pp. 777-780, Dec. 1997.
[29]J.-W. Suh and Y.-S. Ho, “Error concealment technique based on optical flow,” Electronic Letters, vol.38, no. 18, pp. 1020-1021, Aug. 2002.
[30]D. S. Turaga and T. Chen, “Model-based error concealment for wireless video,” IEEE Trans. Circuits and Syst. Video Technol., vol. 12, no. 6, pp. 483-495, June 2002.
[31]S. Cen and P. C. Cosman, “Decision trees for error concealment in video decoding,” IEEE Trans. Multimedia, vol. 5, no. 1, pp. 1-7, Mar. 2003.
[32]W. N. Lie, T. Lin, C. W. Lin, “Enhancing video error resilience by using data embedding techniques,” IEEE Trans. Circuits and Syst. Video Technol.,vol.16, no.2, pp.300-308, Feb. 2006.
[33]R. Zhang, S. L. Regunathan, and K. Rose, “Video coding with optimal inter/intra-mode switching for packet loss resilience,” IEEE Journal on Selected Areas in Communications, vol. 18, no. 6, pp. 966-976, June 2000.
[34]T. Stockhammer, M. M. Hannuksela, and T. Wiegand, “H.264/AVC in Wireless Environments,” IEEE Trans. Circuits and Syst. Video Technol., vol. 13, no.7, pp.657-673, July, 2003.
[35]T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H.264/AVC Video Coding Standard,” IEEE Trans. Circuits and Syst. Video Technol., vol. 13, no.7, pp.560-576, July, 2003.
[36]D. Robie and R. Mersereau, “Video error correction using steganography,” EURASIP Journal on Applied Signal Processing, pp. 164-173, Feb. 2002.
[37]W. Zeng “spatial-temporal error concealment with side information for standard video codecs”, in Proc. of IEEE Int. Conf. Multimedia and Expo, vol. 2, 6-9 July 2003.
[38]A. Yilmaz, A.A. Alatan, “error concealment of video sequences by data hiding,” in Proc. of IEEE Int. Conf. Image Processing, vol.12, 14-17 Sept. 2003.
[39]H. Wang; A.K. Katsaggelos; “a hybrid source-channel coding scheme for object-based wireless video communications,” in Proc. of IEEE Int. Conf. Computer Communications and Networks, pp.235-240, 2004.
[40]A. Piva, R. Caldelli; F. Filippini, “data hiding for error concealment in H.264/AVC,” in Proc. Of IEEE 6th Workshop on Multimedia Signal Processing, pp. 199-202, Oct. 2004.
[41]C. D. Vleeschouwer, J.-F. Delaigle, and B. Macq, “Circular Interpretation of Bijective Transformations in Lossless Watermarking for Media Asset Management,” IEEE Trans. Multimedia, vol. 5, no. 1, pp.97-105, 2003.
[42]J. Tian, “Reversible Data Embedding Using a Difference Expansion,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 8, pp.890-896, 2003.
[43]T. Wiegand, G. Sullivan, and A. Luthra, “Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification,” ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top
1. 31.侯英泠,探討醫療無過失責任的適宜性,月旦法學雜誌,第49期,1999年6月。
2. 15.沈冠伶,證據保全制度─從擴大制度機能之觀點談起,月旦法學雜誌,第76期,2001年9月。
3. 09.吳光明,法院在仲裁中角色之探討─兼論最高法院八十四年度台上字第一一一號裁定,仲裁,第55期,1999年11月30日。
4. 03.王梅英,專家在法庭上的角色──鑑定或參審?,律師雜誌,第253期,2000年10月。
5. 謝靜蕙(2001):危機到轉機-由溝通理論談親師溝通衝突的化解方法與具體策略。學生輔導,72,64-77
6. 馮士軒、陳宇杉(2003):家庭與學校合作模式初探。特教園丁,19(2),16-23。
7. 黃志雄(2003):特殊兒童家庭支持與家長參與。特教園丁,19(2),8-15頁。
8. 曹常仁(1994):親師關係之經營。國教之聲,27(3),8-17。
9. 姚志文(1995): 從「教師法」談「以學校為中心」的教育開放改革。北縣教育,10,35-38。
10. 吳明隆(1999):新時代有效親師合作的內涵與具體作法。公教資訊季刊,3(1),56-74。
11. 林建平(1996):親師關係及溝通。國教月刊,43(1.2),1-6。
12. 林明地﹙1996﹚:學校與社區關係:從家長參與學校活動的理念談起。教育研究,51,30-40。
13. 李重毅(2003):由團隊合作理念談特殊教育教師角色。特教園丁,19(2),47-59。
14. 何東墀(2003):特殊教育發展中家長參與的催化功能。特教園丁,19(2),1-7。
15. 吳永裕(1995):家長參與的捷徑-班級家長義工。師友月刊,84(7),78-81。