Video quality assessment using temporal quality variations and machine learning
11 Jul 2011-pp 1-6
TL;DR: Experiments conducted using two publicly available video databases show the effectiveness of the proposed full-reference metric in comparison to the relevant existing VQA metrics.
Abstract: Objective video quality assessment (VQA) is the use of computational models to predict the video quality in line with the perception of the human visual system (HVS). It is challenging due to the underlying complexity, and the relatively limited understanding of the HVS and its intricate mechanisms. There are two important issues regarding VQA: (a) the temporal factors apart from the spatial ones also need to be considered, (b) the contribution of each factor and their interaction to the overall video quality needs to be determined. In this paper, we attempt to tackle the first issue by utilizing the variation of spatial quality along the temporal axis. The second issue is addressed by the use of machine learning; we believe this to be more convincing since the relationship between the factors and the overall quality is derived via training with substantial ground truth (i.e. subjective scores). Experiments conducted using two publicly available video databases show the effectiveness of the proposed full-reference metric in comparison to the relevant existing VQA metrics.
Citations
More filters
TL;DR: The experimental results have demonstrated that the proposed JNTPA measure is in line with human perception, and compared with JVT-P014, the proposed TRA-JNTPA achieves significant reduction of the TPA with superior subjective video quality at a given bit-rate.
Abstract: At low bit-rates, video coding under the hierarchical prediction structure induces a temporal distortion known as temporal pumping artifact (TPA) when the quantization parameter cascading strategy is used. TPA manifests itself as a pumping effect visually, due to severe quality fluctuations among adjacent pictures, which seriously affects the perceptual quality of a video. In this work, the causes and perception of the TPA is first analyzed. Then a metric of just-noticeable temporal pumping artifact (JNTPA) is formulated based on characteristics of the human visual system. Based on JNTPA, an efficient algorithm has been devised for TPA reduction (denoted as TRA-JNTPA for short). The experimental results have demonstrated that the proposed JNTPA measure is in line with human perception, and compared with JVT-P014, the proposed TRA-JNTPA achieves significant reduction of the TPA with superior subjective video quality at a given bit-rate. A metric of just-noticeable temporal pumping artifact (JNTPA) is formulated.The proposed metric predicts JNTPA values in correspondence with human perception.An efficient algorithm based on the JNTPA has been devised for TPA reduction.The proposed algorithm achieves a more smooth subjective video quality.The proposed algorithm improves the viewing comfort for the human eye.
2 citations
References
More filters
TL;DR: In this article, a structural similarity index is proposed for image quality assessment based on the degradation of structural information, which can be applied to both subjective ratings and objective methods on a database of images compressed with JPEG and JPEG2000.
Abstract: Objective methods for assessing perceptual image quality traditionally attempted to quantify the visibility of errors (differences) between a distorted image and a reference image using a variety of known properties of the human visual system. Under the assumption that human visual perception is highly adapted for extracting structural information from a scene, we introduce an alternative complementary framework for quality assessment based on the degradation of structural information. As a specific example of this concept, we develop a structural similarity index and demonstrate its promise through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000. A MATLAB implementation of the proposed algorithm is available online at http://www.cns.nyu.edu//spl sim/lcv/ssim/.
40,609 citations
TL;DR: The independent test results from the VQEG FR-TV Phase II tests are summarized, as well as results from eleven other subjective data sets that were used to develop the NTIA General Model.
Abstract: The National Telecommunications and Information Administration (NTIA) General Model for estimating video quality and its associated calibration techniques were independently evaluated by the Video Quality Experts Group (VQEG) in their Phase II Full Reference Television (FR-TV) test. The NTIA General Model was the only video quality estimator that was in the top performing group for both the 525-line and 625-line video tests. As a result, the American National Standards Institute (ANSI) adopted the NTIA General Model and its associated calibration techniques as a North American Standard in 2003. The International Telecommunication Union (ITU) has also included the NTIA General Model as a normative method in two Draft Recommendations. This paper presents a description of the NTIA General Model and its associated calibration techniques. The independent test results from the VQEG FR-TV Phase II tests are summarized, as well as results from eleven other subjective data sets that were used to develop the method.
1,268 citations
"Video quality assessment using temp..." refers background or methods in this paper
...Therefore, owing to these limitations, objective assessment has attracted significant attention during the recent years [1], [6]-[12], [14]-[18]....
[...]
...We compared the proposed metric QSVR with some of the existing metrics namely the widely used PSNR, SpeedSSIM [11], V-VIF [16] and the Video Quality Metric (VQM) [12]....
[...]
...Firstly, unlike images, the perceived video quality depends not only on the spatial or frame-level quality but can also be affected by the quality variation along the temporal axis [6]-[12], [15]-[16], [18], [20]....
[...]
...The authors in [12] proposed a VQA algorithm called Video Quality Metric (VQM)....
[...]
...As has been noted by many researchers, considering quality along the temporal axis is an important factor for VQA [6]-[12], [15]-[16], [18], [20]....
[...]
TL;DR: A new philosophy in designing image and video quality metrics is followed, which uses structural dis- tortion as an estimate of perceived visual distortion as part of full-reference (FR) video quality assessment.
Abstract: Objective image and video quality measures play important roles in a variety of image and video pro- cessing applications, such as compression, communication, printing, analysis, registration, restoration, enhancement and watermarking. Most proposed quality assessment ap- proaches in the literature are error sensitivity-based meth- ods. In this paper, we follow a new philosophy in designing image and video quality metrics, which uses structural dis- tortion as an estimate of perceived visual distortion. A com- putationally ecient approach is developed for full-reference (FR) video quality assessment. The algorithm is tested on the video quality experts group (VQEG) Phase I FR-TV test data set. Keywords—Image quality assessment, video quality assess- ment, human visual system, error sensitivity, structural dis- tortion, video quality experts group (VQEG)
1,083 citations
01 Jan 2004
TL;DR: A Structural Similarity Index is developed and its promise is demonstrated through a set of intuitive ex- amples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000.
Abstract: Objective methods for assessing perceptual im- age quality traditionally attempt to quantify the visibility of errors (dierences) between a distorted image and a ref- erence image using a variety of known properties of the hu- man visual system. Under the assumption that human visual perception is highly adapted for extracting structural information from a scene, we introduce an alternative com- plementary framework for quality assessment based on the degradation of structural information. As a specific exam- ple of this concept, we develop a Structural Similarity Index and demonstrate its promise through a set of intuitive ex- amples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000. A MatLab imple- mentation of the proposed algorithm is available online at http://www.cns.nyu.edu/~lcv/ssim/.
1,081 citations
"Video quality assessment using temp..." refers methods in this paper
...We compared the proposed metric QSVR with some of the existing metrics namely the widely used PSNR, SpeedSSIM [11], V-VIF [16] and the Video Quality Metric (VQM) [12]....
[...]
...The well-known image quality assessment (IQA) scheme SSIM [5] has also been extended for VQA....
[...]
...In [10], SSIM was employed for VQA with the use of a weighting scheme that took into account motion using a block motion estimation algorithm....
[...]
...The method proposed in [11] also used SSIM with an alternate weighting scheme based on human perception of motion information....
[...]