Texture mapping based video compression scheme
03 Dec 2010-pp 4001-4004
TL;DR: This work presents a video coding technique based on texture synthesis via stitching small patches of previous images as done in texture transfer that can act as a pre-processor to any video codec e.g. H.264 and add to the compression obtained.
Abstract: We present a video coding technique based on texture synthesis via stitching small patches of previous images as done in texture transfer. Each macroblock is identified as a texture or non texture block by means of an edge based criterion. The texture blocks are reconstructed using the luminance values as the control block information to guide the texture transfer algorithm. By modifying the texture transfer algorithm we ensure both spatial as well as temporal consistency. The non texture blocks and the luminance values for texture blocks can be coded by any encoder and thus our method can act as a pre-processor to any video codec e.g. H.264 and add to the compression obtained.
Citations
More filters
15 Dec 2011
TL;DR: The proposed scheme shows promising results for low bit rate side information case because of the reduction in the level of blurring due to the introduction of high frequency information derived from the epitome.
Abstract: We present a video compression scheme using epitome based texture coding that uses a low quality video as side information and improves it by using the epitome. The side information is sent at different levels of quantization and resolution to optimize the quality against the bit rate. The concept of motion threading is used for propagation of epitome information from one frame to another. The proposed scheme shows promising results for low bit rate side information case because of the reduction in the level of blurring due to the introduction of high frequency information derived from the epitome.
1 citations
References
More filters
01 Aug 2001
TL;DR: This work uses quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures and extends the algorithm to perform texture transfer — rendering an object with a texture taken from a different object.
Abstract: We present a simple image-based method of generating novel visual appearance in which a new image is synthesized by stitching together small patches of existing images. We call this process image quilting. First, we use quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures. Second, we extend the algorithm to perform texture transfer — rendering an object with a texture taken from a different object. More generally, we demonstrate how an image can be re-rendered in the style of a different image. The method works directly on the images and does not require 3D information.
2,649 citations
"Texture mapping based video compres..." refers methods in this paper
...The idea behind the proposed scheme is that given a control map (in this case luma values corresponding to the color image) and some example texture, a technique similar to texture transfer [5] can be applied for synthesis i....
[...]
24 Nov 2003
TL;DR: This work assumes that the textures in a video scene is classified into two categories: textures with unimportant subjective details and the remainder, and utilizes this assumption for improved video coding using a texture analyzer and a texture synthesizer.
Abstract: We assume that the textures in a video scene is classified into two categories: textures with unimportant subjective details and the remainder We utilize this assumption for improved video coding using a texture analyzer and a texture synthesizer The texture analyzer identifies the texture regions with unimportant subjective details and generates coarse masks as well as side information for the texture synthesizer at the decoder side The texture synthesizer replaces the identified textures by inserting synthetic textures for the identified regions The texture analyzer is based on MPEG-7 descriptors Our approach is integrated into an H264/AVC codec Bit-rate savings up to 194% are shown for a semi-automatic texture analyzer given similar subjective quality as the H264/AVC codec without the presented approach
74 citations
TL;DR: The experimental results confirm the main advantages of the proposed texture replacement method: significant bit rate reduction of the compressed movie sequences with the texture removed, and higher visual quality of the textured background regions in the decodedmovie sequences with synthesized texture than that of the areas in the sequences simply encoded and decoded.
Abstract: In this paper, we exploit the stylistic characteristics of high-quality entertainment movie sequences in terms of their textured background for coding purposes. More specifically, we propose a content-based coding method by texture replacement. At the encoder, texture is removed from selected regions of the original frames. The resulting frames with the texture removed and the parameters of the removed texture are then encoded. At the decoder, the boundaries of the regions without texture are identified and new texture, which is synthesized using the decoded texture parameters, is mapped onto these regions. Our experimental results confirm the main advantages of the proposed texture replacement method: significant bit rate reduction of the compressed movie sequences with the texture removed, and higher visual quality of the textured background regions in the decoded movie sequences with synthesized texture than that of the regions in the sequences simply encoded and decoded. Even more, our method can be applied as an overlay onto any standards-compliant coding system.
61 citations
"Texture mapping based video compres..." refers background in this paper
...[4] Adriana Dumitras, Barry G. Haskell, “An Encoder–Decoder Texture Replacement Method With Application to Content-Based Movie Coding”, IEEE Transactions on Circuits and systems for Video Technology, Vol. 14, No. 6, June 2004 [5] Alexei A. Efros, William T. Freeman, “Image Quilting for Texture Synthesis and Transfer”, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001, pp: 341 – 346....
[...]
...Similarly, Dumitras [4] propose a video coding framework in which texture is removed from selected regions....
[...]
26 Jun 2007
TL;DR: A video coding scheme in which some texture regions are selectively removed at the encoder and recovered by synthesis at the decoder, integrated into H.264/AVC and achieves up to 38.8% bitrate saving at similar visual quality levels compared with H.265.
Abstract: This paper presents a video coding scheme in which some texture regions are selectively removed at the encoder and recovered by synthesis at the decoder. We present region removal utilizing conventional block-based motion information rather than global motion field. Removed regions including their motion information are not coded at the encoder. We propose spatio-temporal patch-searching in texture synthesis at the decoder to recover the removed regions. Our approach is not content based and is flexible and generic to be implemented. The scheme has been integrated into H.264/AVC and achieves up to 38.8% bitrate saving at similar visual quality levels compared with H.264/AVC.
46 citations
"Texture mapping based video compres..." refers methods in this paper
...al [1][2], we have been able to obtain higher compression at lower QP values while maintaining similar visual quality....
[...]
...In the context of previous work, Zhu et al [1][2] propose a video coding scheme, in which textural and structural regions are selectively removed in the encoder, and restored in the decoder by spatio-temporal texture synthesis and edge-based in-painting....
[...]
26 Aug 2008
TL;DR: A video coding scheme, in which textural and structural regions are selectively removed in the encoder, and restored in the decoder by spatio-temporal texture synthesis and edge-based inpainting, which achieves up to 35% bitrate saving at similar visual quality levels compared with H.264/AVC without this approach.
Abstract: This paper proposes a video coding scheme, in which textural and structural regions are selectively removed in the encoder, and restored in the decoder by spatio-temporal texture synthesis and edge-based inpainting. In the proposed scheme, two types of regions are classified based on two motion models: local motion and global motion. In local motion regions, conventional block-based motion estimation is employed for region removal and spatio-temporal texture synthesis is applied for recovery of the removed regions. In global motion regions, edge-based image inpainting is utilized to recover removed regions, and sprite generation is used as an auxiliary tool to keep temporal consistency. In the proposed scheme, both structures and textures are handled and some kinds of assistant information which can guide restoration are extracted and coded. This approach is blockbased and thus is flexible and generic to be implemented into standard-compliant video coding schemes. It has been implemented into H.264/AVC and achieves up to 35% bitrate saving at similar visual quality levels compared with H.264/AVC without our approach.
46 citations
"Texture mapping based video compres..." refers methods in this paper
...al [1][2], we have been able to obtain higher compression at lower QP values while maintaining similar visual quality....
[...]
...In the context of previous work, Zhu et al [1][2] propose a video coding scheme, in which textural and structural regions are selectively removed in the encoder, and restored in the decoder by spatio-temporal texture synthesis and edge-based in-painting....
[...]