Residual frame

About: Residual frame is a research topic. Over the lifetime, 4443 publications have been published within this topic receiving 68784 citations.

Motion filtering for video stabilization

Abstract: For applying a motion filter of a video stabilization system to a sequence of video frames, an estimate of a motion in the current video frame compared to a first video frame of the sequence of video frames is received. Based on the received motion estimate and on at least one state variable of the motion filter, a correction value for the motion in the current video frame is computed. The at least one state variable is updated in the computation. In case the computed correction value exceeds a system constraint of the video stabilization system, the at least one state variable is adjusted in accordance with an extent by which the system constraint is exceeded. The correction value is then recomputed based on the motion estimate and on the adjusted state variable .

Method and apparatus for trick play of bitstream data

Abstract: An apparatus for a trick play video player and methods of operating the same result in a video player that provides a compressed data stream of output image data for later playback. The trick play video player comprises a frame creator which receives output image data and creates a reference frame from the output image data. A data stream storage is coupled to the frame creator configured to store the compressed data stream which follows the reference frame. The reference frame and the compressed data stream is decoded to replay the output image data.

Method for speech analysis and speech recognition

Abstract: A method of speech analysis calculates one or more difference parameters for each of a sequence of acoustic frames, where each difference parameter is a function of the difference between an acoustic parameter in one frame and an acoustic parameter in a nearby frame. The method is used in speech recognition which compares the difference parameters of each frame against acoustic models representing speech units, where each speech-unit model has a model of the difference parameters associated with the frames of its speech unit. The difference parameters can be slope parameters or energy difference parameters. Slope parameters are derived by finding the difference between the energy of a given spectral parameter of a given frame and the energy, in a nearby frame, of a spectral parameter associated with a different frequency band. The resulting parameter indicates the extent to which the frequency of energy in the part of the spectrum represented by the given parameter is going up or going down. Energy difference parameters are calculated as a function of the difference between a given spectral parameter in one frame and a spectral parameter in a nearby frame representing the same frequency band. In one embodiment of the invention, dynamic programming compares the difference parameters of a sequence of frames to be recognized against a sequence of dynamic programming elements associated with each of a plurality of speech-unit models. In another embodiment of the invention, each speech-unit model represents one phoneme, and the speech-unit models for a plurality of phonemes are compared against individual frames, to associate with each such frame the one or more phonemes whose models compare most closely with it.

Moving image display device and method for moving image display

Abstract: In the moving image display device of the invention, a synthesis circuit inputs signals representing specified values of pixel rate factors R2 and R3 from a pixel rate factor specification circuit, while inputting overscanned frame image data D1 in the units of pixels from a 1st latch circuit. The synthesis circuit extracts a preset number of pixels corresponding to the specified value of the pixel rate factor R2 from a prior frame image, while extracting a preset number of pixels corresponding to the specified value of the pixel rate factor R3 from a latter frame image. The positions of pixels to be extracted from the latter frame image are complementary to the positions of pixels to be extracted from the prior frame image. The synthesis circuit combines the extracted pixels of the prior frame image with the extracted pixels of the latter frame image by a logical OR operation to generate intermediate frame image data D2. This technique of the invention is significantly simpler than the prior art technique but still effectively prevents flicker in a moving image to ensure smooth display of the moving image.

Temporal decomposition and inverse temporal decomposition methods for video encoding and decoding and video encoder and decoder

Abstract: Temporal decomposition and inverse temporal decomposition methods using smoothed predicted frames for video encoding and decoding and video encoder and decoder are provided. The temporal decomposition method for video encoding includes estimating the motion of a current frame using at least one frame as a reference and generating a predicted frame, smoothing the predicted frame and generating a smoothed predicted frame, and generating a residual frame by comparing the smoothed predicted frame with the current frame.