Inter frame

About: Inter frame is a research topic. Over the lifetime, 4154 publications have been published within this topic receiving 63549 citations.

Method and apparatus for bit rate control in a digital video system

Abstract: In a video image compression and transmission system, quantization parameters for a block transform based video compression algorithm can be controlled by a quantizer selector so as to control compressed video frame size. The selection of the appropriate quantization parameter for the nth macroblock of a current frame is based on the cumulative number of compressed bits appearing in the first n-1 macroblocks of a current frame and a previous frame. By controlling the quantization parameter is such a manner, the overall system reacts more quickly to changes in complexity in the video sequence and allocates bits more accurately to different parts of the video frame according to a past history of bit allocation. To efficiently utilize the bandwidth of a transmission medium (such as POTS), a bit count of the contents of the transmit buffer is sent to a buffer regulator in a video controller where it is compared to a low water mark threshold. If the bit count falls below the threshold, an uncompressed video frame is scheduled for compression by a video compressor. By using the low water mark threshold, latency in the overall system is reduced and an efficient use of transmission medium bandwidth is achieved.

2D to 3D video conversion

Abstract: A method for real-time 2D to 3D video conversion includes receiving a decoded 2D video frame having an original resolution, downscaling the decoded 2D video frame into an associated 2D video frame having a lower resolution, and segmenting objects present in the downscaled 2D video frame into background objects and foreground objects. The method also includes generating a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects, and deriving a frame depth map in the original resolution based on the background depth map and the foreground depth map. The method further includes providing a 3D video frame for display at a real-time playback rate. The 3D video frame is generated in the original resolution based on the frame depth map.

Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction

Abstract: Frame rate up-conversion is a postprocessing tool to convert the frame rate from a lower number to a higher one. It is a useful technique for a lot of practical applications, such as display format conversion, low bit rate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique is more efficient since it takes block motion into account. In this paper, by considering the deficiencies of previous works, new criteria and coding schemes for improving motion derivation and interpolation processes are proposed. Next, for video coding applications, adaptive frame skip is executed at the encoder side to maximize the power of MCFI so that the quality of interpolated frames is guaranteed. Experimental results show that our proposal effectively enhances the overall quality of the frame rate up-converted video sequence, both subjectively and objectively.

Multilayer universal video coder

Abstract: A video coder is disclosed which codes the digital pel values of a video signal in such a manner that different levels of picture quality, i.e. resolution, are available to users. The coder uses a two-dimensional quadrature-mirror filter (103) to decomposes the input into plural subbands. The baseband lowest horizontal-lowest vertical frequency subband is coded using a hybrid DCT/DPCM coder (104) that is compatible with a proposed CCITT standardized codec. The output of this coder is a layer 1 signal which is available to subscribers who desire only low-quality video service. The other subbands are coded using an interframe DPCM coder (108, 109, 110, 111) for those subbands in which the filtered samples in the subband represent horizontal or vertical edge variations in the video frame, or an intraframe PCM coder (116, 117) for those subbands in which the filtered samples in the subband represent diagonal variations. Other layer signals are formed by combining the outputs of selected of the interframe and intraframe codes. A user subscribing to increasing number of signal layers is able to reconstruct a signal of increasing quality.

Motion-Compensated Frame Interpolation Based on Multihypothesis Motion Estimation and Texture Optimization

Abstract: A novel motion-compensated frame interpolation (MCFI) algorithm to increase video temporal resolutions based on multihypothesis motion estimation and texture optimization is proposed in this paper. Initially, we form multiple motion hypotheses for each pixel by employing different motion estimation parameters, i.e., different block sizes and directions. Then, we determine the best motion hypothesis for each pixel by solving a labeling problem and optimizing the parameters. In the labeling problem, the cost function is composed of color, shape, and smoothness terms. Finally, we refine the motion hypothesis field based on the texture optimization technique and blend multiple source pixels to interpolate each pixel in the intermediate frame. Simulation results demonstrate that the proposed algorithm provides significantly better MCFI performance than conventional algorithms.