Global/local motion-compensated frame interpolation for low-bit-rate video

TLDR: In this paper, a motion compensated frame interpolation scheme for low bitrate video based on the ITU-T H.263/H.263+ standard is investigated, which works solely on the decoded bitstream with a block-based approach to achieve interpolation results.

Abstract: A new motion-compensated frame interpolation scheme for low bitrate video based on the ITU-T H.263/H.263+ standard is investigated in this research. The proposed scheme works solely on the decoded bitstream with a block-based approach to achieve interpolation results. It is composed of two main modules: the background/foreground segmentation module and the hybrid motion compensated frame interpolation module. The background/foreground segmentation module uses a global motion model to estimate the background motion and an iterative background update to refine the segmentation. The hybrid motion compensated frame interpolation module is employed to reconstruct background and foreground, respectively. Global motion compensation and frame interpolation is applied to background blocks where either the 6-parameter affine or the 8-parameter perspective model is used to reduce the computational complexity and implement perspective correction, while local motion compensation and frame interpolation with localized triangular patch mapping is applied to the foreground area. Experiments show that the proposed scheme can achieve higher overall visual quality compared to conventional block-based frame interpolation schemes.