Cross-Layer Optimization for Energy-efficient QoS Support of Multimedia Streams

Introduction

Wireless video communication with portable devices has become the driving technology of many important applications such as personal communication, gaming and security. In this respect, both mobile communication protocols and video coding technologies have experienced rapid advances.

On the one hand, in the context of video coding technologies, several video compression standards have been developed within the past years such as MPEG-4 Part 10, H.264/Advanced Video Codec (AVC) or the most recent Scalable Video Codec (SVC). The purpose of the H.264/AVC project was to create a standard capable of providing good video quality at substantially lower bit rates than previous standards (e.g. half or less the bit rate of MPEG-2, H.263, or MPEG-4 Part 2), without increasing the complexity of design so much that it would be impractical or excessively expensive to implement. In a similar way, the Scalable Video Codec (SVC) has been developed as an extension of the H.264/AVC providing scalability aspects in the encoded video bitstream relying on a wide range of spatio-temporal and quality scalability. This higher flexibility comes also at the cost of an increased complexity or energy consumption.

In general, we can see that the trend in the evolution of video codecs aims at achieving higher compression degree and higher flexibility in terms of scalability and adaptability. Both features are highly valuable in mobile communications. First, bandwidth is a scarce resource and a high compression degree lowers the required bandwidth. Secondly, the variability of the available bandwidth together with the heterogeneity of devices and processing capabilities makes the bitstream scalability and adaptability a desired feature.

One obvious way to compress the video information is to reduce the target video quality. By allowing a coarser quantization the output rate is reduced at the cost of an increased video distortion. This exploits the inherent Rate – Distortion tradeoffs of video codecs. However, for a fixed target video quality, obtaining a higher compression degree generally requires the use of more complex coding tools, which increases the complexity of the coding process and with it its coding energy. This extends the Rate – Distortion tradeoff to a three-dimensional Rate – Distortion – Energy tradeoff, as shown in Figure 1.

Figure 1.

Tradeoffs at communication and codec sides

On top of this, to avoid severe degradation of the end video quality when transmission errors occur, the video codec should provide a certain degree of error resilience or robustness. This is achieved at the cost of an increased redundancy, or in other words, increased output rate, which is translated again in terms of Rate-Distortion tradeoff.