scispace - formally typeset
Proceedings ArticleDOI

Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation

Reads0
Chats0
TLDR
The results show that the proposed JCAS method outperforms state-of-the-arts in these applications in terms of both quantitative measure and visual perception quality.
Abstract
Analysis sparse representation (ASR) and synthesis sparse representation (SSR) are two representative approaches for sparsity-based image modeling. An image is described mainly by the non-zero coefficients in SSR, while is mainly characterized by the indices of zeros in ASR. To exploit the complementary representation mechanisms of ASR and SSR, we integrate the two models and propose a joint convolutional analysis and synthesis (JCAS) sparse representation model. The convolutional implementation is adopted to more effectively exploit the image global information. In JCAS, a single image is decomposed into two layers, one is approximated by ASR to represent image large-scale structures, and the other by SSR to represent image fine-scale textures. The synthesis dictionary is adaptively learned in JCAS to describe the texture patterns for different single image layer separation tasks. We evaluate the proposed JCAS model on a variety of applications, including rain streak removal, high dynamic range image tone mapping, etc. The results show that our JCAS method outperforms state-of-the-arts in these applications in terms of both quantitative measure and visual perception quality.

read more

Citations
More filters
Posted Content

Pre-Trained Image Processing Transformer

TL;DR: To maximally excavate the capability of transformer, the IPT model is presented to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs and the contrastive learning is introduced for well adapting to different image processing tasks.
Book ChapterDOI

Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining

TL;DR: A novel deep network architecture based on deep convolutional and recurrent neural networks for single image deraining based on contextual information is proposed and outperforms the state-of-the-art approaches under all evaluation metrics.
Proceedings ArticleDOI

Pre-Trained Image Processing Transformer

TL;DR: Hu et al. as discussed by the authors proposed a pre-trained image processing transformer (IPT) model for denoising, super-resolution and deraining tasks, which is trained on corrupted image pairs with multi-heads and multi-tails.
Proceedings ArticleDOI

Progressive Image Deraining Networks: A Better and Simpler Baseline

TL;DR: Wren et al. as discussed by the authors proposed a simple baseline deraining network by considering network architecture, input and output, and loss functions, which can be used as a suitable baseline in future deraining research.
Proceedings ArticleDOI

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

TL;DR: A semi-automatic method that incorporates temporal priors and human supervision to generate a high-quality clean image from each input sequence of real rain images is proposed, and a novel SPatial Attentive Network (SPANet) is proposed to remove rain streaks in a local-to-global manner.
References
More filters
Journal ArticleDOI

Image quality assessment: from error visibility to structural similarity

TL;DR: In this article, a structural similarity index is proposed for image quality assessment based on the degradation of structural information, which can be applied to both subjective ratings and objective methods on a database of images compressed with JPEG and JPEG2000.
Journal ArticleDOI

Nonlinear total variation based noise removal algorithms

TL;DR: In this article, a constrained optimization type of numerical algorithm for removing noise from images is presented, where the total variation of the image is minimized subject to constraints involving the statistics of the noise.
Journal ArticleDOI

$rm K$ -SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation

TL;DR: A novel algorithm for adapting dictionaries in order to achieve sparse signal representations, the K-SVD algorithm, an iterative method that alternates between sparse coding of the examples based on the current dictionary and a process of updating the dictionary atoms to better fit the data.
Journal ArticleDOI

Image Super-Resolution Via Sparse Representation

TL;DR: This paper presents a new approach to single-image superresolution, based upon sparse signal representation, which generates high-resolution images that are competitive or even superior in quality to images produced by other similar SR methods.
Journal ArticleDOI

Enhancing Sparsity by Reweighted ℓ 1 Minimization

TL;DR: A novel method for sparse signal recovery that in many situations outperforms ℓ1 minimization in the sense that substantially fewer measurements are needed for exact recovery.
Related Papers (5)