Open Access

Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks

EURASIP Journal on Image and Video Processing20072007:045201

https://doi.org/10.1155/2007/45201

Received: 22 August 2006

Accepted: 5 January 2007

Published: 8 March 2007

Abstract

This paper presents a framework of content-adaptive packetization scheme for streaming of 3D wavelet-based video content over lossy IP networks. The tradeoff between rate and distortion is controlled by jointly adapting scalable source coding rate and level of forward error correction (FEC) protection. A content dependent packetization mechanism with data-interleaving and Reed-Solomon protection for wavelet-based video codecs is proposed to provide unequal error protection. This paper also tries to answer an important question for scalable video streaming systems: given extra bandwidth, should one increase the level of channel protection for the most important packets, or transmit more scalable source data? Experimental results show that the proposed framework achieves good balance between quality of the received video and level of error protection under bandwidth-varying lossy IP networks.

[1234567891011121314151617181920212223242526272829303132333435363738]

Authors’ Affiliations

(1)
Department of Computer Science, National Chiao Tung University

References

  1. Choi S-J, Woods JW: Motion-compensated 3-D subband coding of video. IEEE Transactions on Image Processing 1999,8(2):155-167. 10.1109/83.743851View ArticleGoogle Scholar
  2. ISO/IEC MPEG Test Group : Subjective test results for the CfP on scalable video coding technology. MPEG Documents N6383, March 2004Google Scholar
  3. Brangoulo S, Leonardi R, Mrak M, Pesquet Popescu B, Xu J: Draft status report on wavelet video coding exploration. MPEG Documents N7571, October 2005Google Scholar
  4. Chou PA, Miao Z: Rate-distortion optimized streaming of packetized media. IEEE Transactions on Multimedia 2006,8(2):390-404.View ArticleGoogle Scholar
  5. Katsaggelos AK, Eisenberg Y, Zhai F, Berry R, Pappas TN: Advances in efficient resource allocation for packet-based real-time video transmission. Proceedings of the IEEE 2005,93(1):135-146.View ArticleGoogle Scholar
  6. Zhu X, Setton E, Girod B: Congestion-distortion optimized video transmission over ad hoc networks. Signal Processing: Image Communication 2005,20(8):773-783.Google Scholar
  7. Zhai F, Luna CE, Eisenberg Y, Pappas TN, Berry R, Katsaggelos AK: Joint source coding and packet classification for real-time video transmission over differentiated services networks. IEEE Transactions on Multimedia 2005,7(4):716-725.View ArticleGoogle Scholar
  8. Berger T: Rate Distortion Theory: A Mathematical Basis for Data Compression. Prentice-Hall, Englewood Cliffs, NJ, USA; 1971.MATHGoogle Scholar
  9. Chu T, Xiong Z: Combined wavelet video coding and error control for internet streaming and multicast. EURASIP Journal on Applied Signal Processing 2003,2003(1):66-80. 10.1155/S1110865703210106View ArticleGoogle Scholar
  10. Dong J, Zheng YF: Content-based retransmission for 3-D wavelet video streaming on the internet. Proceedings of IEEE International Conference on Information Technology: Coding and Computing (ITCC '02), April 2002, Las Vegas, Nev, USA 452-457.View ArticleGoogle Scholar
  11. Zhao Y, Ahalt SC, Dong J: Content-based retransmission for a video streaming system with error concealment. Visual Information Processing XIII, April 2004, Orlando, Fla, USA, Proceedings of SPIE 5438: 63-70.View ArticleGoogle Scholar
  12. Tan W-T, Zakhor A: Real-time internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Transactions on Multimedia 1999,1(2):172-186. 10.1109/6046.766738View ArticleGoogle Scholar
  13. Bolot J-C, Turletti T: Experience with control mechanisms for packet video in the internet. Computer Communication Review 1998,28(1):4-15. 10.1145/280549.280551View ArticleGoogle Scholar
  14. Kalman M, Girod B: Techniques for improved rate-distortion optimized video streaming. ST Journal of Research 2005,2(1):45-54.Google Scholar
  15. Wang H, Zhai F, Eisenberg Y, Katsaggelos AK: Cost-distortion optimized unequal error protection for object-based video communications. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(12):1505-1516.View ArticleGoogle Scholar
  16. Chang C-L, Han S, Girod B: Sender-based rate-distortion optimized streaming of 3-D wavelet video with low latency. Proceedings of 6th IEEE Workshop on Multimedia Signal Processing (MMSP '04), September-October 2004, Siena, Italy 510-513.Google Scholar
  17. Chang C-L, Han S, Girod B: Rate-distortion optimized streaming for 3-D wavelet video. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapore 5: 3141-3144.Google Scholar
  18. Zhai F, Eisenberg Y, Luna CE, Pappas TN, Berry R, Katsaggelos AK: Packetization schemes for forward error correction in internet video streaming. Proceedings of the 41st Allerton Conference Communication, Control and Computing, October 2003, Monticello, Ill, USAGoogle Scholar
  19. Martinian E, Sundberg C-EW: Decreasing distortion using low delay codes for bursty packet loss channels. IEEE Transactions on Multimedia 2003,5(3):285-292. 10.1109/TMM.2003.814794View ArticleGoogle Scholar
  20. Shimizu K, Togawa N, Ikenaga T, Goto S: Reconfigurable adaptive FEC system based on Reed-Solomon code with interleaving. IEICE Transactions on Information and Systems 2005,E88-D(7):1526-1537. 10.1093/ietisy/e88-d.7.1526View ArticleGoogle Scholar
  21. Stanković V, Hamzaoui R, Xiong Z: Efficient channel code rate selection algorithms for forward error correction of packetized multimedia bitstreams in varying channels. IEEE Transactions on Multimedia 2004,6(2):240-248. 10.1109/TMM.2003.822789View ArticleGoogle Scholar
  22. Gallant M, Kossentini F: Rate-distortion optimized layered coding with unequal error protection for robust internet video. IEEE Transactions on Circuits and Systems for Video Technology 2001,11(3):357-372. 10.1109/76.911161View ArticleGoogle Scholar
  23. Goshi J, Mohr AE, Ladner RE, Riskin EA, Lippman A: Unequal loss protection for H.263 compressed video. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(3):412-419.View ArticleGoogle Scholar
  24. Dumitrescu S, Wu X, Wang Z: Globally optimal uneven error-protected packetization of scalable code streams. IEEE Transactions on Multimedia 2004,6(2):230-239. 10.1109/TMM.2003.822793View ArticleGoogle Scholar
  25. Zink M, Schmitt J, Steinmetz R: Layer-encoded video in scalable adaptive streaming. IEEE Transactions on Multimedia 2005,7(1):75-84.View ArticleGoogle Scholar
  26. ISO/IEC MPEG Video Group : Wavelet codec reference document and software manual v1.0. MPEG Document N7573, July 2005Google Scholar
  27. Xu J, Xiong Z, Li S, Zhang Y-Q: Three-dimensional embedded subband coding with optimized truncation (3-D ESCOT). Applied and Computational Harmonic Analysis 2001,10(3):290-315. 10.1006/acha.2000.0345MathSciNetView ArticleMATHGoogle Scholar
  28. Kim B-J, Xiong Z, Pearlman WA: Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT). IEEE Transactions on Circuits and Systems for Video Technology 2000,10(8):1374-1387. 10.1109/76.889025View ArticleGoogle Scholar
  29. Fang R, Schonfeld D, Ansari R, Leigh J: Forward error correction for multimedia and teleimmersion data streams. Electronic Visualization Laboratory, University of Illinois at Chicago, Chicago, Ill, USA; 2000.Google Scholar
  30. Biersack EW: Performance evaluation of forward error correction in an ATM environment. IEEE Journal on Selected Areas in Communications 1993,11(4):631-640. 10.1109/49.221209View ArticleGoogle Scholar
  31. Lee JY, Park SK: Optimum UDP packet sizes in ad hoc networks. IEICE Transactions on Communications 2005,E88-B(2):815-820. 10.1093/ietcom/E88-B.2.815View ArticleGoogle Scholar
  32. Birney B: Reducing broadcast delay. Microsoft Technical Report, Microsoft Corporation, June 2006, http://www.microsoft.com/windows/windowsmedia/howto/articles/BroadcastDelay.aspx#MinimizingDelay
  33. ISO/IEC JTC 1/SC 29/WG11 ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005, http://clabprj.ee.nctu.edu.tw/~mpeg21tb/ ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005,
  34. Carson M, Santay D: NIST net: a linux-based network emulation tool. Computer Communication Review 2003,33(3):111-126. 10.1145/956993.957007View ArticleGoogle Scholar
  35. Xiong R, Ji X, Xu J, Wu F: MSRA scheme for SVC CE1. MPEG Input Document M11320, Palma de Mallorca, ES, October 2004Google Scholar
  36. Boyce JM, Gaglianello RD: Packet loss effects on MPEG video sent over the public internet. Proceedings of the 6th ACM International Conference on Multimedia (ACM Multimedia '98), September 1998, Bristol, UK 181-190.View ArticleGoogle Scholar
  37. Lai K, Roussopoulos M, Tang D, Zhao X, Baker M: Experiences with a mobile testbed. Proceedings of the 2nd International Conference on Worldwide Computing and Its Applications (WWCA '98), March 1998, Tsukuba, Japan, Lecture Notes in Computer Science 1368: 222-237.View ArticleGoogle Scholar
  38. Risueño R, Cuenca P, Delicado F, Orozco-Barbosa L, Garrido A: On the traffic disruption time and packet lost rate during the handover mechanisms in wireless networks. Proceedings of the 18th International Conference on Advanced Information Networking and Application (AINA '04), March 2004, Fukuoka, Japan 2: 351-354.View ArticleGoogle Scholar

Copyright

© C.-P. Ho and C.-J. Tsai. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.