Skip to main content
EURASIP Journal on Image and Video Processing
Download PDF

Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks

EURASIP Journal on Image and Video Processing volume 2007, Article number: 045201 (2007) Cite this article

Abstract

This paper presents a framework of content-adaptive packetization scheme for streaming of 3D wavelet-based video content over lossy IP networks. The tradeoff between rate and distortion is controlled by jointly adapting scalable source coding rate and level of forward error correction (FEC) protection. A content dependent packetization mechanism with data-interleaving and Reed-Solomon protection for wavelet-based video codecs is proposed to provide unequal error protection. This paper also tries to answer an important question for scalable video streaming systems: given extra bandwidth, should one increase the level of channel protection for the most important packets, or transmit more scalable source data? Experimental results show that the proposed framework achieves good balance between quality of the received video and level of error protection under bandwidth-varying lossy IP networks.

[1234567891011121314151617181920212223242526272829303132333435363738]

References

  1. Choi S-J, Woods JW: Motion-compensated 3-D subband coding of video. IEEE Transactions on Image Processing 1999,8(2):155-167. 10.1109/83.743851

    Article  Google Scholar 

  2. ISO/IEC MPEG Test Group : Subjective test results for the CfP on scalable video coding technology. MPEG Documents N6383, March 2004

    Google Scholar 

  3. Brangoulo S, Leonardi R, Mrak M, Pesquet Popescu B, Xu J: Draft status report on wavelet video coding exploration. MPEG Documents N7571, October 2005

    Google Scholar 

  4. Chou PA, Miao Z: Rate-distortion optimized streaming of packetized media. IEEE Transactions on Multimedia 2006,8(2):390-404.

    Article  Google Scholar 

  5. Katsaggelos AK, Eisenberg Y, Zhai F, Berry R, Pappas TN: Advances in efficient resource allocation for packet-based real-time video transmission. Proceedings of the IEEE 2005,93(1):135-146.

    Article  Google Scholar 

  6. Zhu X, Setton E, Girod B: Congestion-distortion optimized video transmission over ad hoc networks. Signal Processing: Image Communication 2005,20(8):773-783.

    Google Scholar 

  7. Zhai F, Luna CE, Eisenberg Y, Pappas TN, Berry R, Katsaggelos AK: Joint source coding and packet classification for real-time video transmission over differentiated services networks. IEEE Transactions on Multimedia 2005,7(4):716-725.

    Article  Google Scholar 

  8. Berger T: Rate Distortion Theory: A Mathematical Basis for Data Compression. Prentice-Hall, Englewood Cliffs, NJ, USA; 1971.

    MATH  Google Scholar 

  9. Chu T, Xiong Z: Combined wavelet video coding and error control for internet streaming and multicast. EURASIP Journal on Applied Signal Processing 2003,2003(1):66-80. 10.1155/S1110865703210106

    Article  Google Scholar 

  10. Dong J, Zheng YF: Content-based retransmission for 3-D wavelet video streaming on the internet. Proceedings of IEEE International Conference on Information Technology: Coding and Computing (ITCC '02), April 2002, Las Vegas, Nev, USA 452-457.

    Chapter  Google Scholar 

  11. Zhao Y, Ahalt SC, Dong J: Content-based retransmission for a video streaming system with error concealment. Visual Information Processing XIII, April 2004, Orlando, Fla, USA, Proceedings of SPIE 5438: 63-70.

    Article  Google Scholar 

  12. Tan W-T, Zakhor A: Real-time internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Transactions on Multimedia 1999,1(2):172-186. 10.1109/6046.766738

    Article  Google Scholar 

  13. Bolot J-C, Turletti T: Experience with control mechanisms for packet video in the internet. Computer Communication Review 1998,28(1):4-15. 10.1145/280549.280551

    Article  Google Scholar 

  14. Kalman M, Girod B: Techniques for improved rate-distortion optimized video streaming. ST Journal of Research 2005,2(1):45-54.

    Google Scholar 

  15. Wang H, Zhai F, Eisenberg Y, Katsaggelos AK: Cost-distortion optimized unequal error protection for object-based video communications. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(12):1505-1516.

    Article  Google Scholar 

  16. Chang C-L, Han S, Girod B: Sender-based rate-distortion optimized streaming of 3-D wavelet video with low latency. Proceedings of 6th IEEE Workshop on Multimedia Signal Processing (MMSP '04), September-October 2004, Siena, Italy 510-513.

    Google Scholar 

  17. Chang C-L, Han S, Girod B: Rate-distortion optimized streaming for 3-D wavelet video. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapore 5: 3141-3144.

    Google Scholar 

  18. Zhai F, Eisenberg Y, Luna CE, Pappas TN, Berry R, Katsaggelos AK: Packetization schemes for forward error correction in internet video streaming. Proceedings of the 41st Allerton Conference Communication, Control and Computing, October 2003, Monticello, Ill, USA

    Google Scholar 

  19. Martinian E, Sundberg C-EW: Decreasing distortion using low delay codes for bursty packet loss channels. IEEE Transactions on Multimedia 2003,5(3):285-292. 10.1109/TMM.2003.814794

    Article  Google Scholar 

  20. Shimizu K, Togawa N, Ikenaga T, Goto S: Reconfigurable adaptive FEC system based on Reed-Solomon code with interleaving. IEICE Transactions on Information and Systems 2005,E88-D(7):1526-1537. 10.1093/ietisy/e88-d.7.1526

    Article  Google Scholar 

  21. Stanković V, Hamzaoui R, Xiong Z: Efficient channel code rate selection algorithms for forward error correction of packetized multimedia bitstreams in varying channels. IEEE Transactions on Multimedia 2004,6(2):240-248. 10.1109/TMM.2003.822789

    Article  Google Scholar 

  22. Gallant M, Kossentini F: Rate-distortion optimized layered coding with unequal error protection for robust internet video. IEEE Transactions on Circuits and Systems for Video Technology 2001,11(3):357-372. 10.1109/76.911161

    Article  Google Scholar 

  23. Goshi J, Mohr AE, Ladner RE, Riskin EA, Lippman A: Unequal loss protection for H.263 compressed video. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(3):412-419.

    Article  Google Scholar 

  24. Dumitrescu S, Wu X, Wang Z: Globally optimal uneven error-protected packetization of scalable code streams. IEEE Transactions on Multimedia 2004,6(2):230-239. 10.1109/TMM.2003.822793

    Article  Google Scholar 

  25. Zink M, Schmitt J, Steinmetz R: Layer-encoded video in scalable adaptive streaming. IEEE Transactions on Multimedia 2005,7(1):75-84.

    Article  Google Scholar 

  26. ISO/IEC MPEG Video Group : Wavelet codec reference document and software manual v1.0. MPEG Document N7573, July 2005

    Google Scholar 

  27. Xu J, Xiong Z, Li S, Zhang Y-Q: Three-dimensional embedded subband coding with optimized truncation (3-D ESCOT). Applied and Computational Harmonic Analysis 2001,10(3):290-315. 10.1006/acha.2000.0345

    Article  MathSciNet  MATH  Google Scholar 

  28. Kim B-J, Xiong Z, Pearlman WA: Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT). IEEE Transactions on Circuits and Systems for Video Technology 2000,10(8):1374-1387. 10.1109/76.889025

    Article  Google Scholar 

  29. Fang R, Schonfeld D, Ansari R, Leigh J: Forward error correction for multimedia and teleimmersion data streams. Electronic Visualization Laboratory, University of Illinois at Chicago, Chicago, Ill, USA; 2000.

    Google Scholar 

  30. Biersack EW: Performance evaluation of forward error correction in an ATM environment. IEEE Journal on Selected Areas in Communications 1993,11(4):631-640. 10.1109/49.221209

    Article  Google Scholar 

  31. Lee JY, Park SK: Optimum UDP packet sizes in ad hoc networks. IEICE Transactions on Communications 2005,E88-B(2):815-820. 10.1093/ietcom/E88-B.2.815

    Article  Google Scholar 

  32. Birney B: Reducing broadcast delay. Microsoft Technical Report, Microsoft Corporation, June 2006, http://www.microsoft.com/windows/windowsmedia/howto/articles/BroadcastDelay.aspx#MinimizingDelay

  33. ISO/IEC JTC 1/SC 29/WG11 ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005, http://clabprj.ee.nctu.edu.tw/~mpeg21tb/ ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005,

  34. Carson M, Santay D: NIST net: a linux-based network emulation tool. Computer Communication Review 2003,33(3):111-126. 10.1145/956993.957007

    Article  Google Scholar 

  35. Xiong R, Ji X, Xu J, Wu F: MSRA scheme for SVC CE1. MPEG Input Document M11320, Palma de Mallorca, ES, October 2004

    Google Scholar 

  36. Boyce JM, Gaglianello RD: Packet loss effects on MPEG video sent over the public internet. Proceedings of the 6th ACM International Conference on Multimedia (ACM Multimedia '98), September 1998, Bristol, UK 181-190.

    Chapter  Google Scholar 

  37. Lai K, Roussopoulos M, Tang D, Zhao X, Baker M: Experiences with a mobile testbed. Proceedings of the 2nd International Conference on Worldwide Computing and Its Applications (WWCA '98), March 1998, Tsukuba, Japan, Lecture Notes in Computer Science 1368: 222-237.

    Article  Google Scholar 

  38. Risueño R, Cuenca P, Delicado F, Orozco-Barbosa L, Garrido A: On the traffic disruption time and packet lost rate during the handover mechanisms in wireless networks. Proceedings of the 18th International Conference on Advanced Information Networking and Application (AINA '04), March 2004, Fukuoka, Japan 2: 351-354.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, National Chiao Tung University, Hsinchu, 30010, Taiwan

    Chien-Peng Ho & Chun-Jen Tsai

Authors
  1. Chien-Peng Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun-Jen Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chien-Peng Ho.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Ho, CP., Tsai, CJ. Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks. J Image Video Proc 2007, 045201 (2007). https://doi.org/10.1155/2007/45201

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/45201

Keywords

  • Code Rate
  • Forward Error Correction
  • Scalable Video
  • Video Codec
  • Unequal Error Protection