Intelligent congestion control is vital for encoded video streaming of a clip or film, as network traffic volatility and the associated uncertainties require constant adjustment of the bit rate. Existing solutions, including the standard transmission control protocol (TCP) friendly rate control equation-based congestion controller, are prone to fluctuations in their sending rate and may respond only when packet loss has already occurred. This is a major problem, because both fluctuations and packet loss affect the end-user's perception of the delivered video. A type-1 (T1) fuzzy logic congestion controller (FLC) can operate at video display rates and can reduce packet loss and rate fluctuations, despite uncertainties in measurements of delay arising from congestion and network traffic volatility. However, a T1 FLC employing precise T1 fuzzy sets cannot fully cope with the uncertainties associated with such dynamic network environments. A type-2 FLC using type-2 fuzzy sets can handle such uncertainties to produce improved performance. This paper proposes an interval type-2 FLC that achieves a superior delivered video quality compared with existing traditional controllers and a T1 FLC. To show the response in different network scenarios, tests demonstrate the response both in the presence of typical Internet cross-traffic as well as when other video streams occupy a bottleneck on an All-Internet protocol (IP) network. As All-IP networks are intended for multimedia traffic, it is important to develop a form of congestion control that can transfer to them from the mixed traffic environment of the Internet. It was found that the proposed type-2 FLC, although it is specifically designed for Internet conditions, can also successfully react to the network conditions of an All-IP network. When the control inputs were subject to noise, the type-2 FLC resulted in an order of magnitude performance improvement in comparison with the T1 FLC. The type-2 FLC also showed reduced packet loss when compared with the other controllers, again resulting in superior delivered video quality. When judged by established criteria, such as TCP-friendliness and delayed feedback, fuzzy logic congestion control offers a flexible solution to network bottlenecks. These findings offer the type-2 FLC as a way forward for congestion control of video streaming across packet-switched IP networks.

Interval Type-2 Fuzzy Logic Congestion Control for Video Streaming Across IP Networks

A method and apparatus is disclosed herein for video encoding and/or decoding using adaptive interpolation is described. In one embodiment, the decoding method comprises decoding a reference index; decoding a motion vector; selecting a reference frame according to the reference index; selecting a filter according to the reference index; and filtering a set of samples of the reference frame using the filter to obtain the predicted block, wherein the set of samples of the reference frame is determined by the motion vector.

Method and apparatus for video encoding and decoding using adaptive interpolation

Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.

System and method for scalable and low-delay videoconferencing using scalable video coding

The present invention relates to image processing apparatus and method which make it possible to prevent a decrease in compression efficiency without increasing computational complexity An intra-TP motion prediction/compensation unit 75 performs motion prediction within a predetermined search range by taking predicted motion vector information generated by an intra-predicted motion vector generating unit 76 as the center of search, on the basis of an image to be intra-predicted from a screen rearrangement buffer 62, and reference images from a frame memory 72 An inter-TP motion prediction/compensation unit 78 performs motion prediction within a predetermined search range by taking predicted motion vector information generated by an inter-predicted motion vector generating unit 79 as the center of search, on the basis of an image to be inter-encoded from the screen rearrangement buffer 62, and reference images from the frame memory 72 The present invention can be applied to, for example, an image encoding apparatus that performs encoding in H264/AVC format

Image Processing Apparatus and Method

Provided is a video coding method and a video decoding method increasing the resolution and quality of images while suppressing an amount of data required for increasing the resolution. A video coding apparatus includes a first orthogonal transformation unit performing discrete cosine transform on an input picture signal, a low-pass filter performing low-pass filtering on the input picture signal, a downsampling unit downsampling the resolution of a low-frequency image signal, a coding unit compressing and coding a reduced image signal, a local decoding unit decoding a coded bit stream, a second orthogonal transformation unit performing discrete cosine transform on a decoded image signal, and a modification information generation unit generating, based on input image DCT coefficients and decoded image DCT coefficients, coefficient modification information used for modifying orthogonal transformation coefficients obtained by performing orthogonal transformation on a decoded video signal obtained from a coded bit stream.

Video encoding method and video decoding method

In the context of prediction with fractional-pel motion vector resolution it was shown, that aliasing components contained in an image signal are limiting the prediction accuracy obtained by motion compensation. In order to consider aliasing, quantisation and motion estimation errors, camera noise, etc., we analytically developed a two-dimensional (2D) non-separable interpolation filter, which is calculated for each frame independently by minimising the prediction error energy. For every fractional-pel position to be interpolated, an individual set of 2D filter coefficients is determined. As a result, a coding gain of up to 1,2 dB for HDTV-sequences and up to 0,5 dB for CIF-sequences compared to the standard H.264/AVC is obtained.

Motion-and aliasing-compensated prediction using a two-dimensional non-separable adaptive Wiener interpolation filter

Standard video compression techniques apply motion-compensated prediction combined with transform coding of the prediction error In the context of prediction with fractional-pel motion vector resolution it was shown, that aliasing components contained in an image signal are limiting the prediction efficiency obtained by motion compensation In order to consider aliasing, quantization and motion estimation errors, camera noise, etc, we analytically developed a twodimensional (2D) non-separable interpolation filter, which is independently calculated for each frame by minimizing the prediction error energy For every fractional-pel position to be interpolated, an individual set of 2D filter coefficients is determined Since transmitting filter coefficients as side information results in an additional bit rate, which is almost constant for different image resolutions and total bit rates, the loss in coding gain increases when total bit rates sink Therefore, we developed an algorithm, which regards the non-separable two-dimensional filter as a polyphase filter For each frame, predicting the interpolation filter impulse response through evaluation of the polyphase filter, we only have to encode the prediction error of the filter coefficients

Method and apparatus for enhanced video coding

This paper presents a streaming system using the scalability extension of H.264/AVC. The system provides a congestion control algorithm, which is supported by a channel bandwidth estimation running on the client. It uses retransmission only for packets from the base layer to limit the burden on the congested network. The bandwidth estimation allows the transmission rate to be quickly adjusted to the currently available bandwidth of the network. Compared to binomial congestion control, the proposed system allows for shorter start-up times and faster data rate adaptation. The paper describes the components of this streaming system and the results of experiments with competing UDP and TCP applications showing that the proposed approach reaches a throughput at least 50% higher than existing congestion control algorithms for streaming video without using more than the fair share of the bandwidth of the bottleneck link.

Congestion Control for Scalable Video Streaming Using the Scalability Extension of H.264/AVC

Standard video compression techniques apply motion-compensated prediction combined with transform coding of the prediction error. In the context of prediction with fractional-pel motion vector resolution it was shown, that aliasing components contained in an image signal are limiting the prediction accuracy obtained by motion compensation. In order to consider aliasing, quantisation and motion estimation errors, camera noise, etc., we analytically developed a two-dimensional (2D) non-separable interpolation filter, which is calculated for each frame independently by minimising the prediction error energy. For every fractional-pel position to be interpolated, an individual set of 2D filter coe±cients is determined. Since transmitting filter coefficients as side information results in an additional bit rate, which is almost independent for different total bit rates and image resolutions, the overall gain decreases when total bit rates decrease. In this paper we present an algorithm, which regards the non-separable two-dimensional filter as a polyphase filter. For each frame, predicting the interpolation filter impulse response through evaluation of the polyphase filter, we only have to encode the filter coefficients prediction error. This enables bit rate savings, needed for transmitting filter coe±cients of up to 75% compared to PCM coding. A coding gain of up to 1,2 dB Y-PSNR at same bit rate or up to 30% reduction of bit rate is obtained for HDTV-sequences compared to the standard H.264/AVC. Up to 0,5 dB (up to 10% bit rate reduction) are achieved for CIF-sequences.

Coding of coefficients of two-dimensional non-separable adaptive Wiener interpolation filter

A method of concealing a packet loss during video decoding is provided. An input stream having a plurality of network abstraction layer units NAL is received. A loss of a network abstraction layer unit in a group of pictures in the input stream is detected. A valid network abstraction layer unit order from the available network abstraction layer units is outputted. The network abstraction layer unit order is received by a video coding layer (VCL) and data is outputted.

Dieu Thanh Nguyen

Papers

Motion-and aliasing-compensated prediction using a two-dimensional non-separable adaptive Wiener interpolation filter

Method and apparatus for enhanced video coding

Congestion Control for Scalable Video Streaming Using the Scalability Extension of H.264/AVC

Coding of coefficients of two-dimensional non-separable adaptive Wiener interpolation filter

Method for concealing a packet loss