Journal ArticleDOI
Image quality assessment: from error visibility to structural similarity
Reads0
Chats0
TLDR
In this article, a structural similarity index is proposed for image quality assessment based on the degradation of structural information, which can be applied to both subjective ratings and objective methods on a database of images compressed with JPEG and JPEG2000.Abstract:
Objective methods for assessing perceptual image quality traditionally attempted to quantify the visibility of errors (differences) between a distorted image and a reference image using a variety of known properties of the human visual system. Under the assumption that human visual perception is highly adapted for extracting structural information from a scene, we introduce an alternative complementary framework for quality assessment based on the degradation of structural information. As a specific example of this concept, we develop a structural similarity index and demonstrate its promise through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000. A MATLAB implementation of the proposed algorithm is available online at http://www.cns.nyu.edu//spl sim/lcv/ssim/.read more
Citations
More filters
Proceedings ArticleDOI
Image-to-Image Translation with Conditional Adversarial Networks
TL;DR: Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Posted Content
Image-to-Image Translation with Conditional Adversarial Networks
TL;DR: Conditional Adversarial Network (CA) as discussed by the authors is a general-purpose solution to image-to-image translation problems, which can be used to synthesize photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Proceedings ArticleDOI
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig,Lucas Theis,Ferenc Huszar,Jose Caballero,Andrew Cunningham,Alejandro Acosta,Andrew Peter Aitken,Alykhan Tejani,Johannes Totz,Zehan Wang,Wenzhe Shi +10 more
TL;DR: SRGAN as mentioned in this paper proposes a perceptual loss function which consists of an adversarial loss and a content loss, which pushes the solution to the natural image manifold using a discriminator network that is trained to differentiate between the super-resolved images and original photo-realistic images.
Book ChapterDOI
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
TL;DR: In this paper, the authors combine the benefits of both approaches, and propose the use of perceptual loss functions for training feed-forward networks for image style transfer, where a feedforward network is trained to solve the optimization problem proposed by Gatys et al. in real-time.
Journal ArticleDOI
Image Super-Resolution Using Deep Convolutional Networks
TL;DR: Zhang et al. as discussed by the authors proposed a deep learning method for single image super-resolution (SR), which directly learns an end-to-end mapping between the low/high-resolution images.
References
More filters
Proceedings ArticleDOI
Image features that draw fixations
TL;DR: A data-driven approach that uses eye tracking in tandem with principal component analysis to extract low-level image features that attract human gaze that resemble derivatives of the 2D Gaussian operator is described.
Journal ArticleDOI
Linear transform for simultaneous diagonalization of covariance and perceptual metric matrix in image coding
TL;DR: The psychovisual factors in the de8nition of the representation are taken into account together with the statistical factors, by means of the perceptual metric and the covariance matrix, respectively, and the optimal basis for image representation should simultaneously diagonalize both matrices.
Book ChapterDOI
Non-linear Invertible Representation for Joint Statistical and Perceptual Feature Decorrelation
TL;DR: A common framework is presented to analyse the perceptual and statistical interactions among the coefficients of any representation using a recent non-linear perception model and a fast method to invert this representation is presented, so no input-dependent transform has to be stored.
Journal ArticleDOI
P‐14: An Image Processing Model of Contrast Perception and Discrimination of the Human Visual System
TL;DR: An multi-layered image processing model of the primary visual system was built to simulate the center-surround effect on apparent contrast perception and contrast discrimination at the suprathreshold level, and revealed that the mechanisms for apparent Contrast Perception and Contrast discrimination were instinctually different.