Skip to main content

A Motion-Compensated Overcomplete Temporal Decomposition for Multiple Description Scalable Video Coding

Abstract

We present a new multiple-description coding (MDC) method for scalable video, designed for transmission over error-prone networks. We employ a redundant motion-compensated scheme derived from the Haar multiresolution analysis, in order to build temporally correlated descriptions in a t+2D video coder. Our scheme presents a redundancy which decreases with the resolution level. This is achieved by additionally subsampling some of the wavelet temporal subbanbds. We present an equivalent four-band lifting implementation leading to simple central and side decoders as well as a packet-based reconstruction strategy in order to cope with random packet losses.

[12345678910111213141516171819202122232425262728]

References

  1. 1.

    Goyal VK: Multiple description coding: compression meets the network. IEEE Signal Processing Magazine 2001,18(5):74-93. 10.1109/79.952806

    Article  Google Scholar 

  2. 2.

    Apostolopoulos JG: Reliable video communication over lossy packet networks using multiple state encoding and path diversity. Visual Communications and Image Processing, January 2001, San Jose, Calif, USA, Proceedings of SPIE 4310: 392-409.

    Google Scholar 

  3. 3.

    Ozarow L: On a source-coding problem with two channels and three receivers. The Bell System Technical Journal 1980,59(10):1909-1921.

    MathSciNet  Article  MATH  Google Scholar 

  4. 4.

    Gamal AE, Cover T: Achievable rates for multiple descriptions. IEEE Transactions on Information Theory 1982,28(6):851-857. 10.1109/TIT.1982.1056588

    Article  MATH  Google Scholar 

  5. 5.

    Venkataramani R, Kramer G, Goyal VK: Multiple description coding with many channels. IEEE Transactions on Information Theory 2003,49(9):2106-2114. 10.1109/TIT.2003.815767

    MathSciNet  Article  MATH  Google Scholar 

  6. 6.

    Vaishampayan V: Design of multiple description scalar quantizers. IEEE Transactions on Information Theory 1993,39(3):821-834. 10.1109/18.256491

    Article  MATH  Google Scholar 

  7. 7.

    Wang Y, Orchard MT, Vaishampayan V, Reibman AR: Multiple description coding using pairwise correlating transforms. IEEE Transactions on Image Processing 2001,10(3):351-366. 10.1109/83.908500

    Article  MATH  Google Scholar 

  8. 8.

    Kovačević J, Dragotti PL, Goyal VK: Filter bank frame expansions with erasures. IEEE Transactions on Information Theory 2002,48(6):1439-1450. 10.1109/TIT.2002.1003832

    Article  MATH  Google Scholar 

  9. 9.

    Petrişor T, Tillier C, Pesquet-Popescu B, Pesquet J-C: Comparison of redundant wavelet schemes for multiple description coding of video sequences. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '05), March 2005, Philadelphia, Pa, USA 5: 913-916.

    Google Scholar 

  10. 10.

    Lee WS, Pickering MR, Frater MR, Arnold JF: A robust codec for transmission of very low bit-rate video over channels with bursty errors. IEEE Transactions on Circuits and Systems for Video Technology 2000,10(8):1403-1412. 10.1109/76.889033

    Article  Google Scholar 

  11. 11.

    Reibman AR, Jafarkhani H, Wang Y, Orchard MT, Puri R: Multiple-description video coding using motion-compensated temporal prediction. IEEE Transactions on Circuits and Systems for Video Technology 2002,12(3):193-204. 10.1109/76.993440

    Article  Google Scholar 

  12. 12.

    Bajic IV, Woods JW: Domain-based multiple description coding of images and video. IEEE Transactions on Image Processing 2003,12(10):1211-1225. 10.1109/TIP.2003.817248

    Article  Google Scholar 

  13. 13.

    Franchi N, Fumagalli M, Lancini R, Tubaro S: Multiple description video coding for scalable and robust transmission over IP. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(3):321-334.

    Article  Google Scholar 

  14. 14.

    Wang Y, Reibman AR, Lin S: Multiple description coding for video delivery. Proceedings of the IEEE 2005,93(1):57-70.

    Article  Google Scholar 

  15. 15.

    Vaishampayan VA, John S: Balanced interframe multiple description video compression. Proceedings of IEEE International Conference on Image Processing (ICIP '99), October 1999, Kobe, Japan 3: 812-816.

    Article  Google Scholar 

  16. 16.

    Wang Y, Lin S: Error-resilient video coding using multiple description motion compensation. IEEE Transactions on Circuits and Systems for Video Technology 2002,12(6):438-452. 10.1109/TCSVT.2002.800320

    Article  Google Scholar 

  17. 17.

    van der Schaar M, Turaga DS: Multiple description scalable coding using wavelet-based motion compensated temporal filtering. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 3: 489-492.

    Google Scholar 

  18. 18.

    Tillier C, Pesquet-Popescu B, van der Schaar M: Multiple descriptions scalable video coding. Proceedings of 12th European Signal Processing Conference (EUSIPCO '04), September 2004, Vienna, Austria

    Google Scholar 

  19. 19.

    Kim J, Mersereau RM, Altunbasak Y: Network-adaptive video streaming using multiple description coding and path diversity. Proceedings of International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 2: 653-656.

    Google Scholar 

  20. 20.

    Cho S, Pearlman WA: Error resilient compression and transmission of scalable video. Applications of Digital Image Procedding XXIII, July-August 2000, San Diego, Calif, USA, Proceedings of SPIE 4115: 396-405.

    Article  Google Scholar 

  21. 21.

    Franchi N, Fumagalli M, Gatti G, Lancini R: A novel error-resilience scheme for a 3-D multiple description video coder. Proceedings of Picture Coding Symposium (PSC '04), December 2004, San Francisco, Calif, USA 373-376.

    Google Scholar 

  22. 22.

    Petrişor T, Tillier C, Pesquet-Popescu B, Pesquet J-C: Redundant multiresolution analysis for multiple description video coding. Proceedings of IEEE 6th Workshop on Multimedia Signal Processing, September-October 2004, Siena, Italy 95-98.

    Google Scholar 

  23. 23.

    Pesquet-Popescu B, Bottreau V: Three-dimensional lifting schemes for motion compensated video compression. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '01), May 2001, Salt Lake, Utah, USA 3: 1793-1796.

    Google Scholar 

  24. 24.

    Tillier C, Pesquet-Popescu B: 3D, 3-band, 3-tap temporal lifting for scalable video coding. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 779-782.

    Google Scholar 

  25. 25.

    Pau G, Tillier C, Pesquet-Popescu B, Heijmans H: Motion compensation and scalability in lifting-based video coding. Signal Processing: Image Communication 2004,19(7):577-600. 10.1016/j.image.2004.05.003

    Google Scholar 

  26. 26.

    Choi S-J, Woods JW: Motion-compensated 3-D subband coding of video. IEEE Transactions on Image Processing 1999,8(2):155-167. 10.1109/83.743851

    Article  Google Scholar 

  27. 27.

    Tillier C, Pesquet-Popescu B, van der Schaar M: Improved update operators for lifting-based motion-compensated temporal filtering. IEEE Signal Processing Letters 2005,12(2):146-149.

    Article  Google Scholar 

  28. 28.

    3D MC-EZBC Software package http://www.cipr.rpi.edu/ftp_pub/personal/chen/MC_EZBC.zip

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Christophe Tillier.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Tillier, C., Petrişor, T. & Pesquet-Popescu, B. A Motion-Compensated Overcomplete Temporal Decomposition for Multiple Description Scalable Video Coding. J Image Video Proc 2007, 031319 (2007). https://doi.org/10.1155/2007/31319

Download citation

Keywords

  • Image Processing
  • Pattern Recognition
  • Computer Vision
  • Packet Loss
  • Temporal Decomposition