Inter frame

About: Inter frame is a research topic. Over the lifetime, 4154 publications have been published within this topic receiving 63549 citations.

Motion and audio detection based webcamming and bandwidth control

Abstract: The disclosure includes a video (including audio) processing system for transmission of a video frame across a network. The system includes a video input mechanism, a motion detection mechanism, and a web cam mechanism. The video input mechanism is configured to receive a first video frame and a second video frame. The motion detection mechanism is configured to compare the first video frame with the second video frame. It is also configured to generate a motion-detected signal if the comparison of the frames deviates from a threshold value. The web cam mechanism is configured to transmit the second video frame if it received the motion detection signal from the motion detection mechanism. The disclosure also includes a method for processing a selected video frame for transmission across a network. The method includes receiving a video frame, comparing it with a reference frame to determine if it deviates from a threshold value, and transmitting the video frame if it does deviate from the threshold value or discarding it if does not.

Distributed compressed video sensing

Abstract: This paper proposes a novel framework called Distributed Compressed Video Sensing (DISCOS) - a solution for Distributed Video Coding (DVC) based on the recently emerging Compressed Sensing theory. The DISCOS framework compressively samples each video frame independently at the encoder. However, it recovers video frames jointly at the decoder by exploiting an interframe sparsity model and by performing sparse recovery with side information. In particular, along with global frame-based measurements, the DISCOS encoder also acquires local block-based measurements for block prediction at the decoder. Our interframe sparsity model mimics state-of-the-art video codecs: the sparsest representation of a block is a linear combination of a few temporal neighboring blocks that are in previously reconstructed frames or in nearby key frames. This model enables a block to be optimally predicted from its local measurements by l1-minimization. The DISCOS decoder also employs a sparse recovery with side information to jointly reconstruct a frame from its global measurements and its local block-based prediction. Simulation results show that the proposed framework outperforms the baseline compressed sensing-based scheme of intraframe-coding and intraframe-decoding by 8 – 10dB. Finally, unlike conventional DVC schemes, our DISCOS framework can perform most encoding operations in the analog domain with very low-complexity, making it be a promising candidate for real-time, practical applications where the analog to digital conversion is expensive, e.g., in Terahertz imaging.

Multiple display synchronization apparatus and method

Abstract: A method of synchronizing, at a system frame display rate, a first set of frames displayed by a first monitor with a second set of frames by a second monitor, utilizes frame production rates of the two sets of frames to set the system frame display rate. More particularly, the first set of frames are produced at a first frame production rate by a first graphics engine, and the second set of frames are produced at a second frame production rate by a second graphics engine. The first frame production rate and second frame production rate first are compared to determine which frame production rate is slower. The system frame display rate then is set to be no greater than the slower of the two frame production rates.

Storage and retrieval methods to support fully interactive playout in a disk-array-based video server

Abstract: One of the most important challenges in a videoon-demand (VOD) system is to support interactive browsing functions such as “fast forward” and “fast backward.” Typically, these functions impose additional resource requirements on the VOD system in terms of storage space, retrieval throughput, network bandwidth, etc. Moreover, prevalent video compression techniques such as MPEG impose additional constraints on the process since they introduce interframe dependencies. In this paper, we devise methods to support variable rate browsing for MPEG-like video streams and minimize the additional resources required. Specifically, we consider the storage and retrieval for video data in a diskarray-based video server and address the issue of distributing the retrieval requests across the disks evenly. The overall approach proposed in this paper for interactive browsing is composed of (1) a storage method, (2) sampling and placement methods, and (3) a playout method, in which the sampling and placement methods are two alternatives for video-segment selection. The segment-sampling scheme supports browsing at any desired speed while balancing the load on the disk array, as well as minimizing the variation on the number of video segments skipped between samplings. In contrast, the segment-placement scheme supports completely uniform segment sampling across the disk array for some specific speed-up rates. Several theoretical properties for the problem studied are derived. Finally, we describe experimental results on the visual effect of the proposed frame-skipping approach.