Restricted affine motion compensation in video coding using particle filtering
12 Dec 2010-pp 479-484
TL;DR: This work proposes a novel particle filter-based motion compensation strategy for video coding that uses a higher order linear model in place of the traditional translational model used in standards such as H.264.
Abstract: We propose a novel particle filter-based motion compensation strategy for video coding. We use a higher order linear model in place of the traditional translational model used in standards such as H.264. The measurement/observation process in the particle filter is a computationally efficient mechanism as opposed to traditional search methods. We use a multi-resolution framework for efficient parameter estimation. Results of our experimentation show reduced residual energy and better PSNR as compared to traditional video coding methods, especially in regions of complex motion such as zooming and rotation.
Citations
More filters
DOI•
04 Jun 2012TL;DR: An automatic approach, SAMBA, that computes a pleasing choreography by using a novel combination of a distance weighted, least-squares registration between a previous and a subsequent frame and of a modified SAM interpolation.
Abstract: Given the start positions of a group of dancers, a choreographer specifies their end positions and says: "Run!" Each dancer has the choice of his/her motion. These choices influence the perceived beauty (or grace) of the overall choreography. We report experiments with an automatic approach, SAMBA, that computes a pleasing choreography. Rossignac and Vinacua focused on affine motions, which, in the plane, correspond to choreographies for three independent dancers. They proposed the inverse of the Average Relative Acceleration (ARA) as a measure of grace and their Steady Affine Morph (SAM) as the most graceful interpolating motion. Here, we extend their approach to larger groups. We start with a discretized (uniformly time-sampled) choreography, where each dancer moves with constant speed. Each SAMBA iteration steadies the choreography by tweaking the positions of dancers at all intermediate frames towards corresponding predicted positions. The prediction for the position of dancer at a given frame is computed by using a novel combination of a distance weighted, least-squares registration between a previous and a subsequent frame and of a modified SAM interpolation. SAMBA is fully automatic, converges in a fraction of a second, and produces pleasing and interesting motions.
3 citations
TL;DR: Results of extensive experimentation show reduced residual energy and better Peak Signal-to-Noise Ratio (PSNR) as compared to H.264/HEVC for instance, especially in regions of complex motion such as zooming and rotation.
Abstract: In this paper, we propose a multi-resolution affine block-based tracker for motion estimation and compensation, compatible with existing video coding standards such as H.264 and HEVC. We propose three modifications to traditional motion compensation techniques in video coding standards such as H.264 and HEVC. First, we replace traditional search methods with an efficient particle filtering-based method, which incorporates information from both spatial and temporal continuity. Second, we use a higher order linear model in place of the traditional translation motion model in these standards to efficiently represent complex motions such as rotation and zoom. Third, we propose a multi-resolution framework that enables efficient parameter estimation. Results of extensive experimentation show reduced residual energy and better Peak Signal-to-Noise Ratio (PSNR, hereafter) as compared to H.264/HEVC for instance, especially in regions of complex motion such as zooming and rotation.
2 citations
Cites methods from "Restricted affine motion compensati..."
...Our previous work [28] was presented more as a proof of concept which we have extended extensively in this submission by: a) integration of the proposed framework into the H....
[...]
...This work builds on some very preliminary ideas of the authors in [28]....
[...]
References
More filters
15 Oct 2003
TL;DR: A scheme for estimating affine motion of object suitable for MPEG-4 video coding thereby achieving high quality and the efficiency of the proposed scheme in comparison to conventional object-based motion estimation techniques is demonstrated.
Abstract: Motion estimation and compensation form a major part in any video coding scheme. The video coding standard adopted for multimedia applications is the MPEG-4 wherein object-based motion estimation comes into play. However, MPEG-4 uses conventional motion estimation technique that can detect only pure translational motion along the image plane and fails to consider any complex motion that arises due to rotation, zooming, etc. An efficient way of detecting complex motion is by using the affine motion model. In this paper, we develop a scheme for estimating affine motion of object suitable for MPEG-4 video coding thereby achieving high quality. Simulation results demonstrate the efficiency of the proposed scheme in comparison to conventional object-based motion estimation techniques.
8 citations