EURASIP Journal on Applied Signal Processing 
Volume 2004 (2004), Issue 2, Pages 290-303
doi:10.1155/S1110865704310176

Error Resilient Video Compression Using Behavior Models

Jacco R. Taal,1 Zhibo Chen,2 Yun He,3 and R. (Inald) L. Lagendijk1

 1Information and Communication Theory Group, Department of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Mekelweg 4, Delft 2628 CD, The Netherlands
2Imaging Technology Group, IMNC, Sony Corporation, 6-7-35 Kitashinagawa, Shinagawa-Ku, Tokyo 141-0001, Japan
3Video Communication Research Group, Electronic Engineering Department, Tsinghua University, 11-425 East Main Building, Beijing 100084, China
Received 1 December 2002; Revised 26 September 2003

Abstract

Wireless and Internet video applications are inherently subjected to bit errors and packet errors, respectively. This is especially so if constraints on the end-to-end compression and transmission latencies are imposed. Therefore, it is necessary to develop methods to optimize the video compression parameters and the rate allocation of these applications that take into account residual channel bit errors. In this paper, we study the behavior of a predictive (interframe) video encoder and model the encoders behavior using only the statistics of the original input data and of the underlying channel prone to bit errors. The resulting data-driven behavior models are then used to carry out group-of-pictures partitioning and to control the rate of the video encoder in such a way that the overall quality of the decoded video with compression and channel errors is optimized.