Missing pixels restoration for remote sensing images using adaptive search window and linear regression
01 Jul 2016-Journal of Electronic Imaging (International Society for Optics and Photonics)-Vol. 25, Iss: 4, pp 043017-043017
TL;DR: The experimental results show that the proposed methods are capable of reconstructing missing regions with good visual quality.
Abstract: The Consultative Committee for Space Data Systems proposed an efficient image compression standard that can do lossless compression (CCSDS-ICS). CCSDS-ICS is the most widely utilized standard for satellite communications. However, the original CCSDS-ICS is weak in terms of error resilience with even a single incorrect bit possibly causing numerous missing pixels. A restoration algorithm based on the neighborhood similar pixel interpolator is proposed to fill in missing pixels. The linear regression model is used to generate the reference image from other panchromatic or multispectral images. Furthermore, an adaptive search window is utilized to sieve out similar pixels from the pixels in the search region defined in the neighborhood similar pixel interpolator. The experimental results show that the proposed methods are capable of reconstructing missing regions with good visual quality.
Citations
More filters
TL;DR: In this article, a new approach by integrating Linear stretch (Ls), Maximum Value Composite (MVC), and Flexible Spatiotemporal DAta Fusion (FSDAF) was proposed to analyze the time-series changes and extract the spatial distribution of abandoned land.
Abstract: Hilly areas are important parts of the world’s landscape. A marginal phenomenon can be observed in some hilly areas, leading to serious land abandonment. Extracting the spatio-temporal distribution of abandoned land in such hilly areas can protect food security, improve people’s livelihoods, and serve as a tool for a rational land plan. However, mapping the distribution of abandoned land using a single type of remote sensing image is still challenging and problematic due to the fragmentation of such hilly areas and severe cloud pollution. In this study, a new approach by integrating Linear stretch (Ls), Maximum Value Composite (MVC), and Flexible Spatiotemporal DAta Fusion (FSDAF) was proposed to analyze the time-series changes and extract the spatial distribution of abandoned land. MOD09GA, MOD13Q1, and Sentinel-2 were selected as the basis of remote sensing images to fuse a monthly 10 m spatio-temporal data set. Three pieces of vegetation indices (VIs: ndvi, savi, ndwi) were utilized as the measures to identify the abandoned land. A multiple spatio-temporal scales sample database was established, and the Support Vector Machine (SVM) was used to extract abandoned land from cultivated land and woodland. The best extraction result with an overall accuracy of 88.1% was achieved by integrating Ls, MVC, and FSDAF, with the assistance of an SVM classifier. The fused VIs image set transcended the single source method (Sentinel-2) with greater accuracy by a margin of 10.8–23.6% for abandoned land extraction. On the other hand, VIs appeared to contribute positively to extract abandoned land from cultivated land and woodland. This study not only provides technical guidance for the quick acquirement of abandoned land distribution in hilly areas, but it also provides strong data support for the connection of targeted poverty alleviation to rural revitalization.
6 citations
TL;DR: In this paper, a unified methodology that automatically segments and repairs Landsat-7 scenes occluded by stripes was proposed, which combines Morphology-based filtering, anisotropic diffusion and block-based pixel replication as an effective, fully unsupervised restoration methodology designed to cope with different gap sizes.
Abstract: Filling damaged pixels in satellite images is a key task present in many Remote Sensing applications. As a representative example of image restoration issue, we can refer to the failure of the Scan Line Corrector (SLC) on board the Landsat Enhanced Thematic Mapper Plus (ETM +) sensor, in which 22% of the scanned pixels in the SLC-off images were missed, thus creating unexpected stipe-type gaps in the scenes. In order to improve the usability of ETM + SLC-off data in a straightforward manner, in this paper we propose a unified methodology that automatically segments and repairs Landsat-7 scenes occluded by stripes. The proposed framework combines Morphology-based filtering, anisotropic diffusion and block-based pixel replication as an effective, fully unsupervised restoration methodology designed to cope with different gap sizes in Landsat images. Our approach does not require having as input data any prior gap mask, side reference image or time-dependent frames of the same scene to work properly. As shown in the experimental results, the current methodology performs adequately for a variety of multispectral remote sensing images with different stripe-size thicknesses and heterogeneous segments. We attest to the accuracy and robustness of our end-to-end framework throughout a variety of qualitative and quantitative evaluations involving state-of-the-art restoration methods.
5 citations
References
More filters
TL;DR: Although the new index is mathematically defined and no human visual system model is explicitly employed, experiments on various image distortion types indicate that it performs significantly better than the widely used distortion metric mean squared error.
Abstract: We propose a new universal objective image quality index, which is easy to calculate and applicable to various image processing applications. Instead of using traditional error summation methods, the proposed index is designed by modeling any image distortion as a combination of three factors: loss of correlation, luminance distortion, and contrast distortion. Although the new index is mathematically defined and no human visual system model is explicitly employed, our experiments on various image distortion types indicate that it performs significantly better than the widely used distortion metric mean squared error. Demonstrative images and an efficient MATLAB implementation of the algorithm are available online at http://anchovy.ece.utexas.edu//spl sim/zwang/research/quality_index/demo.html.
5,285 citations
TL;DR: A new spatial and temporal adaptive reflectance fusion model (STARFM) algorithm is presented to blend Landsat and MODIS surface reflectance so that high-frequency temporal information from MODIS and high-resolution spatial information from Landsat can be blended for applications that require high resolution in both time and space.
Abstract: The 16-day revisit cycle of Landsat has long limited its use for studying global biophysical processes, which evolve rapidly during the growing season. In cloudy areas of the Earth, the problem is compounded, and researchers are fortunate to get two to three clear images per year. At the same time, the coarse resolution of sensors such as the Advanced Very High Resolution Radiometer and Moderate Resolution Imaging Spectroradiometer (MODIS) limits the sensors' ability to quantify biophysical processes in heterogeneous landscapes. In this paper, the authors present a new spatial and temporal adaptive reflectance fusion model (STARFM) algorithm to blend Landsat and MODIS surface reflectance. Using this approach, high-frequency temporal information from MODIS and high-resolution spatial information from Landsat can be blended for applications that require high resolution in both time and space. The MODIS daily 500-m surface reflectance and the 16-day repeat cycle Landsat Enhanced Thematic Mapper Plus (ETM+) 30-m surface reflectance are used to produce a synthetic "daily" surface reflectance product at ETM+ spatial resolution. The authors present results both with simulated (model) data and actual Landsat/MODIS acquisitions. In general, the STARFM accurately predicts surface reflectance at an effective resolution close to that of the ETM+. However, the performance depends on the characteristic patch size of the landscape and degrades somewhat when used on extremely heterogeneous fine-grained landscapes
1,389 citations
Journal Article•
TL;DR: In this article, the spectral properties of enhanced multispectral images with enhanced spatial resolution have been defined and a formal approach and some criteria to provide a quantitative assessment of the spectral quality of these products are defined.
Abstract: Methods have been proposed to produce multispectral images with enhanced spatial resolution using one or more images of the same scene of better spatial resolution. Assuming that the main concern of the user is the quality of the transformation of the multispectral content when increasing the spatial resolution, this paper defines the properties of such enhanced multispectral images. It then proposes both a formal approach and some criteria to provide a quantitative assessment of the spectral quality of these products. Five sets of criteria are defined. They measure the pe$ormance of a method to synthesize the radiometry in a single spectral band as well as the multispectral information when increasing the spatial resolution. The influence of the type of landscape present in the scene upon the assessment of the quality is underlined, as well as its dependence with scale. The whole approach is illustrated by the case of a SPOT image and three different standard methods to enhance the spatial resolution.
1,165 citations
TL;DR: The novel contribution of this paper is the combination of these three previously developed components, image decomposition with inpainting and texture synthesis, which permits the simultaneous use of filling-in algorithms that are suited for different image characteristics.
Abstract: An algorithm for the simultaneous filling-in of texture and structure in regions of missing image information is presented in this paper. The basic idea is to first decompose the image into the sum of two functions with different basic characteristics, and then reconstruct each one of these functions separately with structure and texture filling-in algorithms. The first function used in the decomposition is of bounded variation, representing the underlying image structure, while the second function captures the texture and possible noise. The region of missing information in the bounded variation image is reconstructed using image inpainting algorithms, while the same region in the texture image is filled-in with texture synthesis techniques. The original image is then reconstructed adding back these two sub-images. The novel contribution of this paper is then in the combination of these three previously developed components, image decomposition with inpainting and texture synthesis, which permits the simultaneous use of filling-in algorithms that are suited for different image characteristics. Examples on real images show the advantages of this proposed approach.
1,024 citations
"Missing pixels restoration for remo..." refers background in this paper
...(11), where T1 and T2 are determined from the extent of the landscape homogeneity and the spectral change between the referred image and the damaged image within the search window, respectively....
[...]
TL;DR: A unifying expression is proposed that gathers the majority of PDE-based formalisms for vector-valued image regularization into a single generic anisotropic diffusion equation, allowing us to implement the authors' regularization framework with accuracy by taking the local filtering properties of the proposed equations into account.
Abstract: In this paper, we focus on techniques for vector-valued image regularization, based on variational methods and PDE. Starting from the study of PDE-based formalisms previously proposed in the literature for the regularization of scalar and vector-valued data, we propose a unifying expression that gathers the majority of these previous frameworks into a single generic anisotropic diffusion equation. On one hand, the resulting expression provides a simple interpretation of the regularization process in terms of local filtering with spatially adaptive Gaussian kernels. On the other hand, it naturally disassembles any regularization scheme into the smoothing process itself and the underlying geometry that drives the smoothing. Thus, we can easily specialize our generic expression into different regularization PDE that fulfill desired smoothing behaviors, depending on the considered application: image restoration, inpainting, magnification, flow visualization, etc. Specific numerical schemes are also proposed, allowing us to implement our regularization framework with accuracy by taking the local filtering properties of the proposed equations into account. Finally, we illustrate the wide range of applications handled by our selected anisotropic diffusion equations with application results on color images.
680 citations