Two-Dimensional Channel Coding Scheme for MCTF-Based Scalable Video Coding
TL;DR: Experimental results are presented to show the advantage of the proposed 2D UEP scheme over the traditional one-dimensional unequal error protection (1DUEP) scheme, and up to 0.81-dB improvement for some video sequences.
Abstract: The motion-compensated temporal filtering (MCTF)-based scalable video coding (SVC) provides a full scalability including spatial, temporal and signal-to-noise ratio (SNR) scalability with fine granularity, each of which may result in different visual effect. This paper addresses a novel approach of two-dimensional unequal error protection (2D UEP) for the scalable video with a combined temporal and quality (SNR) scalability over packet-erasure channel. The bit-stream is divided into scalable subbitstreams based on the structure of MCTF. Each subbitstream is further divided into several quality layers. Unequal quantities of bits are allocated to protect different layers to obtain acceptable quality video with smooth degradation under different transmission error conditions. Experimental results are presented to show the advantage of the proposed 2D UEP scheme over the traditional one-dimensional unequal error protection (1D UEP) scheme. Comparing the proposed method with the 1D UEP scheme on SNR layers, our method gives up to 0.81-dB improvement for some video sequences
Citations
More filters
TL;DR: The proposed unequal error protection (UEP) scheme for scalable video bitstream over packet-lossy networks using forward error correction (FEC) demonstrates strong robustness and adaptation for variable channel status.
Abstract: The scalable video coding extension of H.264/AVC is a current standardization project. This paper deals with unequal error protection (UEP) scheme for scalable video bitstream over packet-lossy networks using forward error correction (FEC). The proposed UEP scheme is developed by exploiting jointly the unequal importance existing both in temporal layers and quality layers of hierarchial scalable video bitstream. For efficient assignment of FEC codes, the proposed UEP scheme uses a simple and efficient performance metric, namely layer-weighted expected zone of error propagation (LW-EZEP). The LW-EZEP is adopted for quantifying the error propagation effect on video quality degradation from packet loss in temporal layers and in quality layers. Compared to other UEP schemes, the proposed UEP scheme demonstrates strong robustness and adaptation for variable channel status.
86Â citations
29 Nov 2012
TL;DR: Simulation results show that compared with the conventional UXP scheme, the average peak signal to noise ratio (PSNR) of the reconstructed video can be improved significantly in a wide range of packet loss rate.
Abstract: In this paper, we analyze the conventional unequal erasure protection (UXP) scheme for scalable video transmission, and propose a dynamic hybrid UXP/ARQ transmission framework to improve the performance of the conventional UXP method for bandwidth-constrained scalable video transmission. This framework applies automatic retransmission request (ARQ) to the conventional UXP scheme for scalable video transmission, and dynamically adjusts the transmission time budget of each group of picture (GOP) according to the feedback about the transmission results of the current and previous GOPs from the receiver. Besides, target video quality is introduced and optimized to adapt to the channel condition in pursuit of more efficient dynamic time allocation. Simulation results show that compared with the conventional UXP scheme, the average peak signal to noise ratio (PSNR) of the reconstructed video can be improved significantly in a wide range of packet loss rate.
8Â citations
Cites background from "Two-Dimensional Channel Coding Sche..."
...Another kind of UEP scheme is to assign different number of forward error correction (FEC) bits to the packets of different importance, such as unequal erasure protection (UXP) scheme [4-7] and layered hybrid automatic retransmission request (ARQ) [8]....
[...]
30 Nov 2009
TL;DR: A joint power control and forward error correction (FEC) unequal error protection (UEP) scheme is proposed to transmit the video streams over orthogonal frequency division multiplexing (OFDM) systems efficiently and robustly and a new iterative algorithm is given to solve the joint optimization problem.
Abstract: H.264/AVC scalable video coding (SVC) is an up-to-date video compression standard. This paper deals with the issue of transmitting H.264 scalable video bitstreams over wireless fading channels. The contribution is twofold: Firstly, to exploit the importance of prioritized video packets in different temporal layer, quality layer and group of pictures (GOP), a simple and accurate performance metric, namely, layer-GOP-weighted expected zone of error propagation (LGW-EZEP) model is proposed. Secondly, a joint power control and forward error correction (FEC) unequal error protection (UEP) scheme is proposed to transmit the video streams over orthogonal frequency division multiplexing (OFDM) systems efficiently and robustly. Meanwhile, a new iterative algorithm is given to solve the joint optimization problem. Compared to other independent power control or FEC UEP schemes, the combined protecting scheme demonstrates stronger robustness and flexibility via various fading channels.
7Â citations
Cites methods from "Two-Dimensional Channel Coding Sche..."
...Many works adopt the UXP scheme as FEC to enhance the protection [2], [8], [12], [13] etc....
[...]
09 Mar 2015
TL;DR: A new two-dimensional triangular network coding that performs network coding between the temporal and spatio layers of a video is proposed that shows the effectiveness of the two- dimensional coding schemes compared to the previous one-dimensional network coding schemes.
Abstract: As the popularity of wireless devices (e.g. smart-phones and tablets) and watching videos over the Internet is increasing rapidly, delivering high quality videos to users over wireless links is becoming an important application. One of the main challenges of multicasting in wireless networks to multiple receivers is the diversity of the receivers. In a wireless network, the users have different wireless channel conditions, and as a result, they experience different packet delivery rates. In order to handle these heterogeneous channels, multi-resolution videos are used to deliver videos at multiple quality levels. The recent research on multi-resolution codes show that triangular network coding can increase the quality of the received videos by the users. In this paper, considering the dependencies among different temporal and spatio (resolution) layers of a video, we propose a new two-dimensional triangular network coding that performs network coding between the temporal and spatio layers. Our simulation results show the effectiveness of our two-dimensional coding schemes compared to the previous one-dimensional network coding schemes.
6Â citations
Cites background from "Two-Dimensional Channel Coding Sche..."
...The authors in [6] proposed a UEP scheme by exploiting the unequal importance of the temporal and quality layers....
[...]
TL;DR: Experimental results demonstrate the proposed UEP scheme provides significant error resilience and a simple heuristic algorithm is proposed to quickly derive the protection pattern.
Abstract: We address the problem of unequal error protection (UEP) for SNR enhancement layer network abstraction layer (NAL) units of scalable video coding extension of H.264/AVC standard over wireless packet-erasure channel. We develop a UEP scheme by jointly selecting SNR NAL units and allocating unequal amounts of protection to selected NAL units for every group of pictures in the sequence. A simple heuristic algorithm is proposed to quickly derive the protection pattern. Experimental results demonstrate the proposed UEP scheme provides significant error resilience.
6Â citations
References
More filters
Book•
01 Sep 1988
TL;DR: In this article, the authors present the computer techniques, mathematical tools, and research results that will enable both students and practitioners to apply genetic algorithms to problems in many fields, including computer programming and mathematics.
Abstract: From the Publisher:
This book brings together - in an informal and tutorial fashion - the computer techniques, mathematical tools, and research results that will enable both students and practitioners to apply genetic algorithms to problems in many fields
Major concepts are illustrated with running examples, and major algorithms are illustrated by Pascal computer programs No prior knowledge of GAs or genetics is assumed, and only a minimum of computer programming and mathematics background is required
52,797Â citations
TL;DR: A video coding system based on motion-compensated three-dimensional subband/wavelet coding (MC-3DSBC), which can overcome the limits of both 3-D SBC and MC prediction-based coding.
Abstract: This paper describes a video coding system based on motion-compensated three-dimensional (3-D) subband/wavelet coding (MC-3DSBC), which can overcome the limits of both 3-D SBC and MC prediction-based coding. In this new system, spatio-temporal subbands are generated by MC temporal analysis and a spatial wavelet transform, and then encoded by 3-D subband-finite state scalar quantization (3DSB-FSSQ). The rate allocation from the GOP level to each class of subbands is optimized by utilizing the structural property of MC-3DSBC that additive superposition approximately holds for both rate and distortion. The proposed video coding system is applied to several test video clips. Its performance exceeds that of both a known MPEG-1 implementation and a similar subband MC predictive coder while maintaining modest computational complexity and memory size.
527Â citations
"Two-Dimensional Channel Coding Sche..." refers background in this paper
...D UEP scheme is proposed for this new technology, which can properly allocate the channel protection bits to the combined temporal and SNR scalable units according to the MCTF structure in the temporal direction and the inter-layer dependency between the SNR layers in the quality direction....
[...]
...It can properly allocate protection bits to the temporal layers based on the motion-compensated temporal filtering (MCTF) structure, and in each temporal layer, unequal amounts of protection are allocated to the different SNR layers....
[...]
...In the experiment, we tested six QCIF sequences: Football with 128 frames, Crew with 144 frames, Bus with 72 frames, Ice with 120 frames, Mobile with 144 frames, and Harbour with 144 frames, which have the same frame frequency of 15 Hz and were coded by MCTF based scalable video codec [14]....
[...]
...After MCTF, for each subband, texture is encoded to produce a base layer, which provides a minimum quality at a given quan- tization level....
[...]
...The MCTF-based SVC can provide flexibly combined temporal, spatial, SNR and complexity scalability....
[...]
TL;DR: An analytic solution for adaptive intra mode selection and joint source-channel rate control under time-varying wireless channel conditions is derived and significantly improves the end-to-end video quality in wireless video coding and transmission.
Abstract: We first develop a rate-distortion (R-D) model for DCT-based video coding incorporating the macroblock (MB) intra refreshing rate. For any given bit rate and intra refreshing rate, this model is capable of estimating the corresponding coding distortion even before a video frame is coded. We then present a theoretical analysis of the picture distortion caused by channel errors and the subsequent inter-frame propagation. Based on this analysis, we develop a statistical model to estimate such channel errors induced distortion for different channel conditions and encoder settings. The proposed analytic model mathematically describes the complex behavior of channel errors in a video coding and transmission system. Unlike other experimental approaches for distortion estimation reported in the literature, this analytic model has very low computational complexity and implementation cost, which are highly desirable in wireless video applications. Simulation results show that this model is able to accurately estimate the channel errors induced distortion with a minimum delay in processing. Based on the proposed source coding R-D model and the analytic channel-distortion estimation, we derive an analytic solution for adaptive intra mode selection and joint source-channel rate control under time-varying wireless channel conditions. Extensive experimental results demonstrate that this scheme significantly improves the end-to-end video quality in wireless video coding and transmission.
390Â citations
"Two-Dimensional Channel Coding Sche..." refers background in this paper
...The channel-coding rate defined as the ratio of the source bit rate over the target bit rate [13]....
[...]
27 Jun 2005
TL;DR: A general framework is presented that defines the fundamental entities, important concepts, and formulation of video adaptation as constrained optimization problems and a taxonomy is used to classify different types of adaptation techniques.
Abstract: Video adaptation is an emerging field that offers a rich body of techniques for answering challenging questions in pervasive media applications. It transforms the input video(s) to an output in video or augmented multimedia form by utilizing manipulations at multiple levels (signal, structural, or semantic) in order to meet diverse resource constraints and user preferences while optimizing the overall utility of the video. There has been a vast amount of activity in research and standard development in this area. This paper first presents a general framework that defines the fundamental entities, important concepts (i.e., adaptation, resource, and utility), and formulation of video adaptation as constrained optimization problems. A taxonomy is used to classify different types of adaptation techniques. The state of the art in several active research areas is reviewed with open challenging issues identified. Finally, support of video adaptation from related international standards is discussed.
212Â citations
TL;DR: An effective framework for increasing the error-resilience of low bit-rate video communications over an error-prone packet-switched network is presented and a rate-distortion optimized mode-selection algorithm is introduced for this prioritized layered framework.
Abstract: We present an effective framework for increasing the error-resilience of low bit-rate video communications over an error-prone packet-switched network. Our framework is based on the principle of layered coding with transport prioritization. We introduce a rate-distortion optimized mode-selection algorithm for our prioritized layered framework. This algorithm is based on a joint source/channel-coding approach and trades off source coding efficiency for increased bitstream error-resilience to optimize the video coding mode selection within and across layers. The algorithm considers the channel conditions, as well as the error recovery and concealment capabilities, of the channel codec and source decoder, respectively. Important framework parameters including the packetization scheme, decoder error concealment method, and channel codec error-protection strength are considered. The effects of mismatch between the parameters employed by the encoder and the actual channel conditions are considered. Results are presented for a wide range of packet loss rates in order to illustrate the benefits of the proposed framework.
154Â citations