Measurement of visual quality is of fundamental importance to numerous image and video processing applications. The goal of quality assessment (QA) research is to design algorithms that can automatically assess the quality of images or videos in a perceptually consistent manner. Image QA algorithms generally interpret image quality as fidelity or similarity with a "reference" or "perfect" image in some perceptual space. Such "full-reference" QA methods attempt to achieve consistency in quality prediction by modeling salient physiological and psychovisual features of the human visual system (HVS), or by signal fidelity measures. In this paper, we approach the image QA problem as an information fidelity problem. Specifically, we propose to quantify the loss of image information to the distortion process and explore the relationship between image information and visual quality. QA systems are invariably involved with judging the visual quality of "natural" images and videos that are meant for "human consumption." Researchers have developed sophisticated models to capture the statistics of such natural signals. Using these models, we previously presented an information fidelity criterion for image QA that related image quality with the amount of information shared between a reference and a distorted image. In this paper, we propose an image information measure that quantifies the information that is present in the reference image and how much of this reference information can be extracted from the distorted image. Combining these two quantities, we propose a visual information fidelity measure for image QA. We validate the performance of our algorithm with an extensive subjective study involving 779 images and show that our method outperforms recent state-of-the-art image QA algorithms by a sizeable margin in our simulations. The code and the data from the subjective study are available at the LIVE website.

Image information and visual quality

We describe a method for removing noise from digital images, based on a statistical model of the coefficients of an overcomplete multiscale oriented basis. Neighborhoods of coefficients at adjacent positions and scales are modeled as the product of two independent random variables: a Gaussian vector and a hidden positive scalar multiplier. The latter modulates the local variance of the coefficients in the neighborhood, and is thus able to account for the empirically observed correlation between the coefficient amplitudes. Under this model, the Bayesian least squares estimate of each coefficient reduces to a weighted average of the local linear estimates over all possible values of the hidden multiplier variable. We demonstrate through simulations with images contaminated by additive white Gaussian noise that the performance of this method substantially surpasses that of previously published methods, both visually and in terms of mean squared error.

/pdf/image-denoising-using-scale-mixtures-of-gaussians-in-the-2qh5uqp80y.pdf

Image denoising using scale mixtures of Gaussians in the wavelet domain

The paper discusses the theory behind the dual-tree transform, shows how complex wavelets with good properties can be designed, and illustrates a range of applications in signal and image processing The authors use the complex number symbol C in CWT to avoid confusion with the often-used acronym CWT for the (different) continuous wavelet transform The four fundamentals, intertwined shortcomings of wavelet transform and some solutions are also discussed Several methods for filter design are described for dual-tree CWT that demonstrates with relatively short filters, an effective invertible approximately analytic wavelet transform can indeed be implemented using the dual-tree approach

/pdf/the-dual-tree-complex-wavelet-transform-4kfm5jwrrq.pdf

The dual-tree complex wavelet transform

Digital audio, video, images, and documents are flying through cyberspace to their respective owners. Unfortunately, along the way, individuals may choose to intervene and take this content for themselves. Digital watermarking and steganography technology greatly reduces the instances of this by limiting or eliminating the ability of third parties to decipher the content that he has taken. The many techiniques of digital watermarking (embedding a code) and steganography (hiding information) continue to evolve as applications that necessitate them do the same. The authors of this second edition provide an update on the framework for applying these techniques that they provided researchers and professionals in the first well-received edition. Steganography and steganalysis (the art of detecting hidden information) have been added to a robust treatment of digital watermarking, as many in each field research and deal with the other. New material includes watermarking with side information, QIM, and dirty-paper codes. The revision and inclusion of new material by these influential authors has created a must-own book for anyone in this profession.

*This new edition now contains essential information on steganalysis and steganography
*New concepts and new applications including QIM introduced
*Digital watermark embedding is given a complete update with new processes and applications

Digital Watermarking and Steganography

Measurement of image quality is crucial for many image-processing algorithms. Traditionally, image quality assessment algorithms predict visual quality by comparing a distorted image against a reference image, typically by modeling the human visual system (HVS), or by using arbitrary signal fidelity criteria. We adopt a new paradigm for image quality assessment. We propose an information fidelity criterion that quantifies the Shannon information that is shared between the reference and distorted images relative to the information contained in the reference image itself. We use natural scene statistics (NSS) modeling in concert with an image degradation model and an HVS model. We demonstrate the performance of our algorithm by testing it on a data set of 779 images, and show that our method is competitive with state of the art quality assessment methods, and outperforms them in our simulations.

/pdf/image-information-and-visual-quality-1lxu3vvwct.pdf

We introduce a simple spatially adaptive statistical model for wavelet image coefficients and apply it to image denoising. Our model is inspired by a recent wavelet image compression algorithm, the estimation-quantization (EQ) coder. We model wavelet image coefficients as zero-mean Gaussian random variables with high local correlation. We assume a marginal prior distribution on wavelet coefficients variances and estimate them using an approximate maximum a posteriori probability rule. Then we apply an approximate minimum mean squared error estimation procedure to restore the noisy wavelet image coefficients. Despite the simplicity of our method, both in its concept and implementation, our denoising results are among the best reported in the literature.

Low-complexity image denoising based on statistical modeling of wavelet coefficients

This paper deals with the application to denoising of a very simple but effective "local" spatially adaptive statistical model for the wavelet image representation that was previously introduced successfully in a compression context. Motivated by the intimate connection between compression and denoising, this paper explores the significant role of the underlying statistical wavelet image model. The model used here, a simplified version of the one proposed by LoPresto, Ramchandran and Orchard (see Proc. IEEE Data Compression Conf., 1997), is that of a mixture process of independent component fields having a zero-mean Gaussian distribution with unknown variances /spl sigma//sub s//sup 2/ that are slowly spatially-varying with the wavelet coefficient location s. We propose to use this model for image denoising by initially estimating the underlying variance field using a maximum likelihood (ML) rule and then applying the minimum mean squared error (MMSE) estimation procedure. In the process of variance estimation, we assume that the variance field is "locally" smooth to allow its reliable estimation, and use an adaptive window-based estimation procedure to capture the effect of edges. Despite the simplicity of our method, our denoising results compare favorably with the best reported results in the denoising literature.

Spatially adaptive statistical modeling of wavelet image coefficients and its application to denoising

An implementation of a technology is described herein for recognizing the audio content of digital signals. The technology determines one or more hash values for the original audio content of a digital signal. In one implementation described herein, audio content recognition facilitates identification of the original audio content and other audio content that is substantially perceptually same to the original audio content. In another implementation described herein, audio content recognition facilitates semantic categorization of such original content so that it may be grouped with other audio works in the same semantic category. This abstract itself is not intended to limit the scope of this patent. The scope of the present invention is pointed out in the appending claims.

Recognizer of audio-content in digital signals

An implementation of a technology is described herein for the protection of rights in the content of a video sequence. This technology further generally relates to a technology facilitating embedding imperceptible, de-synchronization-resistant watermarks in video sequence and facilitating detecting such watermarks. These watermarks are resistant against unintentional and intentional modifications. In particular, the watermarks are resistant to de-synchronization. In addition, the watermarks are perceptually invisible. The watermarks are hidden in the video so that flicker is minimized or eliminated. More specifically, this technology hides a watermark (of portions thereof) over one or more regions of successive frames. Each region has a center defined by a hash value. A watermark (of portions thereof) is encoded into the region in a “plateau” manner. The mark (of portions thereof) is fully encoded in the frames surrounding the region's center, but trail off towards the edges of the region. This abstract itself is not intended to limit the scope of this patent. The scope of the present invention is pointed out in the appending claims.

Robust and stealthy video watermarking

We introduce a new approach for blind image watermarking: We derive robust semi-global features in wavelet domain and quantize them in order to embed the watermark. Quantization of statistics is carried out by adding scaled pseudo-random sequences that are visually unnoticeable. Our algorithm exhibits increased robustness against various attacks and it withstands standard benchmark attacks of wider trange than earlier methods (e.g., Stirmark, random bending etc.) and modifications such as compression, provided they do not cause too severe visual distortions.

M. Kivanc Mihcak

Papers

Low-complexity image denoising based on statistical modeling of wavelet coefficients

Spatially adaptive statistical modeling of wavelet image coefficients and its application to denoising

Recognizer of audio-content in digital signals

Robust and stealthy video watermarking

Blind image watermarking via derivation and quantization of robust semi-global statistics