Image database TID2013
Nikolay Ponomarenko,Lina Jin,Oleg Ieremeiev,Vladimir V. Lukin,Karen Egiazarian,Jaakko Astola,Benoit Vozel,Kacem Chehdi,Marco Carli,Federica Battisti,C.-C. Jay Kuo +10 more
TLDR
This paper describes a recently created image database, TID2013, intended for evaluation of full-reference visual quality assessment metrics, and methodology for determining drawbacks of existing visual quality metrics is described.Abstract:
This paper describes a recently created image database, TID2013, intended for evaluation of full-reference visual quality assessment metrics. With respect to TID2008, the new database contains a larger number (3000) of test images obtained from 25 reference images, 24 types of distortions for each reference image, and 5 levels for each type of distortion. Motivations for introducing 7 new types of distortions and one additional level of distortions are given; examples of distorted images are presented. Mean opinion scores (MOS) for the new database have been collected by performing 985 subjective experiments with volunteers (observers) from five countries (Finland, France, Italy, Ukraine, and USA). The availability of MOS allows the use of the designed database as a fundamental tool for assessing the effectiveness of visual quality. Furthermore, existing visual quality metrics have been tested with the proposed database and the collected results have been analyzed using rank order correlation coefficients between MOS and considered metrics. These correlation indices have been obtained both considering the full set of distorted images and specific image subsets, for highlighting advantages and drawbacks of existing, state of the art, quality metrics. Approaches to thorough performance analysis for a given metric are presented to detect practical situations or distortion types for which this metric is not adequate enough to human perception. The created image database and the collected MOS values are freely available for downloading and utilization for scientific purposes. We have created a new large database.This database contains larger number of distorted images and distortion types.MOS values for all images are obtained and provided.Analysis of correlation between MOS and a wide set of existing metrics is carried out.Methodology for determining drawbacks of existing visual quality metrics is described.read more
Citations
More filters
Posted Content
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
TL;DR: A new dataset of human perceptual similarity judgments is introduced and it is found that deep features outperform all previous metrics by large margins on this dataset, and suggests that perceptual similarity is an emergent property shared across deep visual representations.
Proceedings ArticleDOI
NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
Eirikur Agustsson,Radu Timofte +1 more
TL;DR: It is concluded that the NTIRE 2017 challenge pushes the state-of-the-art in single-image super-resolution, reaching the best results to date on the popular Set5, Set14, B100, Urban100 datasets and on the authors' newly proposed DIV2K.
Proceedings ArticleDOI
A High-Quality Denoising Dataset for Smartphone Cameras
TL;DR: This paper proposes a systematic procedure for estimating ground truth for noisy images that can be used to benchmark denoising performance for smartphone cameras and shows that CNN-based methods perform better when trained on the authors' high-quality dataset than when trained using alternative strategies, such as low-ISO images used as a proxy for ground truth data.
Journal ArticleDOI
Waterloo Exploration Database: New Challenges for Image Quality Assessment Models
TL;DR: This work establishes a large-scale database named the Waterloo Exploration Database, which in its current state contains 4744 pristine natural images and 94 880 distorted images created from them, and presents three alternative test criteria to evaluate the performance of IQA models, namely, the pristine/distorted image discriminability test, the listwise ranking consistency test, and the pairwise preference consistency test.
Posted Content
Stochastic Adversarial Video Prediction
TL;DR: This work shows that latent variational variable models that explicitly model underlying stochasticity and adversarially-trained models that aim to produce naturalistic images are in fact complementary and combines the two to produce predictions that look more realistic to human raters and better cover the range of possible futures.
References
More filters
Journal ArticleDOI
Image quality assessment: from error visibility to structural similarity
TL;DR: In this article, a structural similarity index is proposed for image quality assessment based on the degradation of structural information, which can be applied to both subjective ratings and objective methods on a database of images compressed with JPEG and JPEG2000.
Journal ArticleDOI
A universal image quality index
Zhou Wang,Alan C. Bovik +1 more
TL;DR: Although the new index is mathematically defined and no human visual system model is explicitly employed, experiments on various image distortion types indicate that it performs significantly better than the widely used distortion metric mean squared error.
Proceedings ArticleDOI
Multiscale structural similarity for image quality assessment
TL;DR: This paper proposes a multiscale structural similarity method, which supplies more flexibility than previous single-scale methods in incorporating the variations of viewing conditions, and develops an image synthesis method to calibrate the parameters that define the relative importance of different scales.
Journal ArticleDOI
FSIM: A Feature Similarity Index for Image Quality Assessment
TL;DR: A novel feature similarity (FSIM) index for full reference IQA is proposed based on the fact that human visual system (HVS) understands an image mainly according to its low-level features.
Journal ArticleDOI
Image information and visual quality
Hamid R. Sheikh,Alan C. Bovik +1 more
TL;DR: An image information measure is proposed that quantifies the information that is present in the reference image and how much of this reference information can be extracted from the distorted image and combined these two quantities form a visual information fidelity measure for image QA.
Related Papers (5)
Most apparent distortion: full-reference image quality assessment and the role of strategy
Eric C. Larson,Damon M. Chandler +1 more