- Research Article
- Open Access
Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks
EURASIP Journal on Image and Video Processing volume 2007, Article number: 045201 (2007)
This paper presents a framework of content-adaptive packetization scheme for streaming of 3D wavelet-based video content over lossy IP networks. The tradeoff between rate and distortion is controlled by jointly adapting scalable source coding rate and level of forward error correction (FEC) protection. A content dependent packetization mechanism with data-interleaving and Reed-Solomon protection for wavelet-based video codecs is proposed to provide unequal error protection. This paper also tries to answer an important question for scalable video streaming systems: given extra bandwidth, should one increase the level of channel protection for the most important packets, or transmit more scalable source data? Experimental results show that the proposed framework achieves good balance between quality of the received video and level of error protection under bandwidth-varying lossy IP networks.
Choi S-J, Woods JW: Motion-compensated 3-D subband coding of video. IEEE Transactions on Image Processing 1999,8(2):155-167. 10.1109/83.743851
ISO/IEC MPEG Test Group : Subjective test results for the CfP on scalable video coding technology. MPEG Documents N6383, March 2004
Brangoulo S, Leonardi R, Mrak M, Pesquet Popescu B, Xu J: Draft status report on wavelet video coding exploration. MPEG Documents N7571, October 2005
Chou PA, Miao Z: Rate-distortion optimized streaming of packetized media. IEEE Transactions on Multimedia 2006,8(2):390-404.
Katsaggelos AK, Eisenberg Y, Zhai F, Berry R, Pappas TN: Advances in efficient resource allocation for packet-based real-time video transmission. Proceedings of the IEEE 2005,93(1):135-146.
Zhu X, Setton E, Girod B: Congestion-distortion optimized video transmission over ad hoc networks. Signal Processing: Image Communication 2005,20(8):773-783.
Zhai F, Luna CE, Eisenberg Y, Pappas TN, Berry R, Katsaggelos AK: Joint source coding and packet classification for real-time video transmission over differentiated services networks. IEEE Transactions on Multimedia 2005,7(4):716-725.
Berger T: Rate Distortion Theory: A Mathematical Basis for Data Compression. Prentice-Hall, Englewood Cliffs, NJ, USA; 1971.
Chu T, Xiong Z: Combined wavelet video coding and error control for internet streaming and multicast. EURASIP Journal on Applied Signal Processing 2003,2003(1):66-80. 10.1155/S1110865703210106
Dong J, Zheng YF: Content-based retransmission for 3-D wavelet video streaming on the internet. Proceedings of IEEE International Conference on Information Technology: Coding and Computing (ITCC '02), April 2002, Las Vegas, Nev, USA 452-457.
Zhao Y, Ahalt SC, Dong J: Content-based retransmission for a video streaming system with error concealment. Visual Information Processing XIII, April 2004, Orlando, Fla, USA, Proceedings of SPIE 5438: 63-70.
Tan W-T, Zakhor A: Real-time internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Transactions on Multimedia 1999,1(2):172-186. 10.1109/6046.766738
Bolot J-C, Turletti T: Experience with control mechanisms for packet video in the internet. Computer Communication Review 1998,28(1):4-15. 10.1145/280549.280551
Kalman M, Girod B: Techniques for improved rate-distortion optimized video streaming. ST Journal of Research 2005,2(1):45-54.
Wang H, Zhai F, Eisenberg Y, Katsaggelos AK: Cost-distortion optimized unequal error protection for object-based video communications. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(12):1505-1516.
Chang C-L, Han S, Girod B: Sender-based rate-distortion optimized streaming of 3-D wavelet video with low latency. Proceedings of 6th IEEE Workshop on Multimedia Signal Processing (MMSP '04), September-October 2004, Siena, Italy 510-513.
Chang C-L, Han S, Girod B: Rate-distortion optimized streaming for 3-D wavelet video. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapore 5: 3141-3144.
Zhai F, Eisenberg Y, Luna CE, Pappas TN, Berry R, Katsaggelos AK: Packetization schemes for forward error correction in internet video streaming. Proceedings of the 41st Allerton Conference Communication, Control and Computing, October 2003, Monticello, Ill, USA
Martinian E, Sundberg C-EW: Decreasing distortion using low delay codes for bursty packet loss channels. IEEE Transactions on Multimedia 2003,5(3):285-292. 10.1109/TMM.2003.814794
Shimizu K, Togawa N, Ikenaga T, Goto S: Reconfigurable adaptive FEC system based on Reed-Solomon code with interleaving. IEICE Transactions on Information and Systems 2005,E88-D(7):1526-1537. 10.1093/ietisy/e88-d.7.1526
Stanković V, Hamzaoui R, Xiong Z: Efficient channel code rate selection algorithms for forward error correction of packetized multimedia bitstreams in varying channels. IEEE Transactions on Multimedia 2004,6(2):240-248. 10.1109/TMM.2003.822789
Gallant M, Kossentini F: Rate-distortion optimized layered coding with unequal error protection for robust internet video. IEEE Transactions on Circuits and Systems for Video Technology 2001,11(3):357-372. 10.1109/76.911161
Goshi J, Mohr AE, Ladner RE, Riskin EA, Lippman A: Unequal loss protection for H.263 compressed video. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(3):412-419.
Dumitrescu S, Wu X, Wang Z: Globally optimal uneven error-protected packetization of scalable code streams. IEEE Transactions on Multimedia 2004,6(2):230-239. 10.1109/TMM.2003.822793
Zink M, Schmitt J, Steinmetz R: Layer-encoded video in scalable adaptive streaming. IEEE Transactions on Multimedia 2005,7(1):75-84.
ISO/IEC MPEG Video Group : Wavelet codec reference document and software manual v1.0. MPEG Document N7573, July 2005
Xu J, Xiong Z, Li S, Zhang Y-Q: Three-dimensional embedded subband coding with optimized truncation (3-D ESCOT). Applied and Computational Harmonic Analysis 2001,10(3):290-315. 10.1006/acha.2000.0345
Kim B-J, Xiong Z, Pearlman WA: Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT). IEEE Transactions on Circuits and Systems for Video Technology 2000,10(8):1374-1387. 10.1109/76.889025
Fang R, Schonfeld D, Ansari R, Leigh J: Forward error correction for multimedia and teleimmersion data streams. Electronic Visualization Laboratory, University of Illinois at Chicago, Chicago, Ill, USA; 2000.
Biersack EW: Performance evaluation of forward error correction in an ATM environment. IEEE Journal on Selected Areas in Communications 1993,11(4):631-640. 10.1109/49.221209
Lee JY, Park SK: Optimum UDP packet sizes in ad hoc networks. IEICE Transactions on Communications 2005,E88-B(2):815-820. 10.1093/ietcom/E88-B.2.815
Birney B: Reducing broadcast delay. Microsoft Technical Report, Microsoft Corporation, June 2006, http://www.microsoft.com/windows/windowsmedia/howto/articles/BroadcastDelay.aspx#MinimizingDelay
ISO/IEC JTC 1/SC 29/WG11 ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005, http://clabprj.ee.nctu.edu.tw/~mpeg21tb/ ISO/IEC TR21000-12: MPEG-21 Test Bed for Resource Delivery, ISO, January 2005,
Carson M, Santay D: NIST net: a linux-based network emulation tool. Computer Communication Review 2003,33(3):111-126. 10.1145/956993.957007
Xiong R, Ji X, Xu J, Wu F: MSRA scheme for SVC CE1. MPEG Input Document M11320, Palma de Mallorca, ES, October 2004
Boyce JM, Gaglianello RD: Packet loss effects on MPEG video sent over the public internet. Proceedings of the 6th ACM International Conference on Multimedia (ACM Multimedia '98), September 1998, Bristol, UK 181-190.
Lai K, Roussopoulos M, Tang D, Zhao X, Baker M: Experiences with a mobile testbed. Proceedings of the 2nd International Conference on Worldwide Computing and Its Applications (WWCA '98), March 1998, Tsukuba, Japan, Lecture Notes in Computer Science 1368: 222-237.
Risueño R, Cuenca P, Delicado F, Orozco-Barbosa L, Garrido A: On the traffic disruption time and packet lost rate during the handover mechanisms in wireless networks. Proceedings of the 18th International Conference on Advanced Information Networking and Application (AINA '04), March 2004, Fukuoka, Japan 2: 351-354.
About this article
Cite this article
Ho, CP., Tsai, CJ. Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks. J Image Video Proc 2007, 045201 (2007). https://doi.org/10.1155/2007/45201
- Code Rate
- Forward Error Correction
- Scalable Video
- Video Codec
- Unequal Error Protection