GAO Pan, PENG Qiang, WANG Qionghua. Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization[J]. Chinese Journal of Electronics, 2016, 25(2): 277-283. doi: 10.1049/cje.2016.03.013
Citation: GAO Pan, PENG Qiang, WANG Qionghua. Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization[J]. Chinese Journal of Electronics, 2016, 25(2): 277-283. doi: 10.1049/cje.2016.03.013

Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization

doi: 10.1049/cje.2016.03.013
Funds:  This work is supported by the National Natural Science Foundation of China (No.61036008) and the Doctoral Innovation Funds of Southwest Jiaotong University.
  • Received Date: 2014-03-11
  • Rev Recd Date: 2014-10-16
  • Publish Date: 2016-03-10
  • Video transmission over packet-switched networks usually suffers from packet losses. The use of the prediction loop in video coding will cause these errors to propagate to subsequent frames, and thus significantly impacts on the received video quality. With the increasing number of cameras to capture the scene, robustly delivering multi-view video over error-prone channels becomes a rather challenging task. A rate-distortion optimization algorithm is proposed to improve error resilience for multi-view video transmission. A recursive model to estimate the end-to-end distortion is developed for multiview video coding, in which the distortion model explicitly takes into consideration the inherent error resilience property of the hierarchical bi-prediction structure. Based on the proposed distortion model, end-to-end rate-distortion optimization criterion is employed to perform coding mode switching. Extensive experimental results demonstrate significant performance gains can be achieved for multi-view video communication against transmission errors.
  • loading
  • A. Vetro, T.Wiegand and G.J. Sullivan, "Overview of the stereo and multiview video coding extension of the H.264/MPEG-4 AVC standard", Proceedings of IEEE, Vol.99, No.4, pp.626-642, 2011.
    P. Merkle, K. Muller and T. Wiegand, "3-D video: Acquisition, coding, and display", IEEE Transactions on Consumer Electronics, Vol.56, No.2, pp.946-950, 2010.
    R. Zhang, S.L. Regunathan and K. Rose, "Video coding with optimal inter/intra-mode switching for packet loss resilience", IEEE Journal on Selected Areas in Communications, Vol.18, No.6, pp.966-976, 2000.
    Z. Chen, P.V. Pahalawatta, A. Michael Tourapis, et al., "Improved estimation of transmission distortion for error-resilient video coding", IEEE Transactions on Circuits and Systems for Video Technology, Vol.22, No.4, pp.636-647, 2012.
    Y. Zhang, W. Gao, Y. Lu, et al., "Joint source-channel ratedistortion optimization for H.264 video coding over error-prone networks", IEEE Transactions on Multimedia, Vol.9, No.3, pp.445-454, 2007.
    P. Gao, Q. Peng and Q. Wang, "An error resilient coding algorithm in multiview video coding", Acta Electronica Sinica, Vol.40, No.12, pp.2544-2548, 2012. (in Chinese)
    K. Song, T. Chung, Y. Oh, et al., "Error concealment of multiview video sequences using inter-view and intra-view correlations", Journal of Visual Communication and Image Representation, Vol.20, No.4, pp.281-292, 2009.
    M.B. Dissanayake, D. Silva, S.T. Worrall, et al., "Error resilient technique for MVC using redundant disparity vectors", Proc. of IEEE International Conference on Multimedia and Expo, Suntec City, Singapore, pp.1712-1717, 2010.
    Y. Zhou, C. Hou, W. Xiang, et al., "Channel distortion modeling for multiview video transmission over packet-switched networks", IEEE Transactions on Circuits and Systems for Video Technology, Vol.21, No.11, pp.1679-1692, 2011.
    Y.-C. Tsai and C.-W. Lin, "H.264 error resilience coding based on multihypothesis motion-compensated prediction", Proc. of IEEE International Conference on Multimedia and Expo, Amsterdam, Netherlands, pp.952-955, 2005.
    P. Gao and W. Xiang, "Rate-distortion optimized mode switching for error-resilient multi-view video plus depth based 3-D video coding", IEEE Transactions on Multimedia, Vol.16, No.7, pp.1797-1808, 2014.
    P. Merkle, A. Smolic, K. Muller, et al., "Efficient prediction structures for multiview video coding", IEEE Transactions on Circuits and Systems for Video Technology, Vol.17, No.11, pp.1461-1473, 2007.
    H. Zeng, K.-K. Ma and C. Cai, "Fast mode decision for multiview video coding using mode correlation", IEEE Transactions on Circuits and Systems for Video Technology, Vol.21, No.11, pp.1659-1666, 2011.
    G. J. Sulivan and T.Wiegand, "Rate-distortion optimization for video compression", IEEE Signal Processing Magazine, Vol.15, No.6, pp.74-90, 1998.
    S. Wan and E. Izquierdo, "Rate-distortion optimized motion compensated prediction for packet loss resilient video coding", IEEE Transactions on Image Processing, Vol.16, No.5, pp.1327-1338, 2007.
    ISO/IECJTC1/SC29/WG11 and ITU-T SG16 Q.6 JVTAA212: 2008, WD1 Reference Software for MVC.
    Standard ISO/IEC JTC 1:2012, Advanced Video Coding for Generic Audiovisual Services.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (227) PDF downloads(525) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return