The development of the Internet in recent years has made it possible and useful to access many different information systems anywhere in the world to obtain information. While there is much research on the integration of heterogeneous information systems, most commercial systems stop short of the actual integration of available data. Data fusion is the process of fusing multiple records representing the same real-world object into a single, consistent, and clean representation.This article places data fusion into the greater context of data integration, precisely defines the goals of data fusion, namely, complete, concise, and consistent data, and highlights the challenges of data fusion, namely, uncertain and conflicting data values. We give an overview and classification of different ways of fusing data and present several techniques based on standard and advanced operators of the relational algebra and SQL. Finally, the article features a comprehensive survey of data integration systems from academia and industry, showing if and how data fusion is performed in each.

Data fusion

/pdf/landslide-inventory-maps-new-tools-for-an-old-problem-wkxin2jqxg.pdf

Landslide inventory maps: New tools for an old problem

Pansharpening aims at fusing a multispectral and a panchromatic image, featuring the result of the processing with the spectral resolution of the former and the spatial resolution of the latter. In the last decades, many algorithms addressing this task have been presented in the literature. However, the lack of universally recognized evaluation criteria, available image data sets for benchmarking, and standardized implementations of the algorithms makes a thorough evaluation and comparison of the different pansharpening techniques difficult to achieve. In this paper, the authors attempt to fill this gap by providing a critical description and extensive comparisons of some of the main state-of-the-art pansharpening methods. In greater details, several pansharpening algorithms belonging to the component substitution or multiresolution analysis families are considered. Such techniques are evaluated through the two main protocols for the assessment of pansharpening results, i.e., based on the full- and reduced-resolution validations. Five data sets acquired by different satellites allow for a detailed comparison of the algorithms, characterization of their performances with respect to the different instruments, and consistency of the two validation procedures. In addition, the implementation of all the pansharpening techniques considered in this paper and the framework used for running the simulations, comprising the two validation procedures and the main assessment indexes, are collected in a MATLAB toolbox that is made available to the community.

A Critical Comparison Among Pansharpening Algorithms

In this paper, multivariate regression is adopted to improve spectral quality, without diminishing spatial quality, in image fusion methods based on the well-established component substitution (CS) approach. A general scheme that is capable of modeling any CS image fusion method is presented and discussed. According to this scheme, a generalized intensity component is defined as the weighted average of the multispectral (MS) bands. The weights are obtained as regression coefficients between the MS bands and the spatially degraded panchromatic (Pan) image, with the aim of capturing the spectral responses of the sensors. Once it has been integrated into the Gram-Schmidt spectral-sharpening method, which is implemented in environment for visualizing images (ENVI) program, and into the generalized intensity-hue-saturation fusion method, the proposed preprocessing module allows the production of fused images of the same spatial sharpness but of increased spectral quality with respect to the standard implementations. In addition, quantitative scores carried out on spatially degraded data clearly confirm the superiority of the enhanced methods over their baselines.

Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$ Pan Data

Pixel-level image fusion

This work presents a multiresolution framework for merging a multispectral image having an arbitrary number of bands with a higher-resolution panchromatic observation. The fusion method relies on the generalized Laplacian pyramid (GLP), which is a multiscale, oversampled structure. The goal is to selectively perform injection of spatial frequencies from an image to another with the constraint of thoroughly retaining the spectral information of the coarser data. The novel idea is that a model of the modulation transfer functions (MTF) of the multispectral scanner is exploited to design the GLP reduction filter. Thus, the interband structure model (IBSM), which is calculated at the coarser scale, where both MS and PAN data are available, can be extended to the finer scale, without the drawback of the poor enhancement occurring when MTFs are assumed to be ideal filters. Experiments carried out on QuickBird data demonstrate that a superior spatial enhancement, besides the spectral quality typical of injection methods, is achieved by means of the MTF-adjusted fusion.

MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery

This paper introduces a novel approach for evaluating the quality of pansharpened multispectral (MS) imagery without resorting to reference originals. Hence, evaluations are feasible at the highest spatial resolution of the panchromatic (PAN) sensor. Wang and Bovik’s image quality index (QI) provides a statistical similarity measurement between two monochrome images. The QI values between any couple of MS bands are calculated before and after fusion and used to define a measurement of spectral distortion. Analogously, QI values between each MS band and the PAN image are calculated before and after fusion to yield a measurement of spatial distortion. The rationale is that such QI values should be unchanged after fusion, i.e., when the spectral information is translated from the coarse scale of the MS data to the fine scale of the PAN image. Experimental results, carried out on very high-resolution Ikonos data and simulated Pleiades data, demonstrate that the results provided by the proposed approach are consistent and in trend with analysis performed on spatially degraded data. However, the proposed method requires no reference originals and is therefore usable in all practical cases.

Multispectral and panchromatic data fusion assessment without reference

This paper aims at defining a new paradigm (hypersharpening) in remote sensing image fusion. In fact, due to the development of new instruments, thinking only in terms of pansharpening is reductive. Even though some expressions as hyperspectral (HS) pansharpening already exist, there is not a suitable definition when multispectral/hyperspectral data are used as source to extract spatial details. After defining the hypersharpening framework, we draw the readers’ attention to its peculiar characteristics, by proposing and evaluating two hypersharpening methods. Experiments are carried out on the data produced by the updated version of SIM-GA imager, designed by Selex ES, which is composed by a panchromatic camera and two spectrometers in the VNIR and SWIR spectral ranges, respectively. Owing to the different resolution factors among panchromatic, VNIR and SWIR data sets, we can apply hypersharpening to fuse SWIR data to VNIR resolution. Comparisons of hypersharpening with “traditional” pansharpening show hypersharpening is more effective.

Hyper-Sharpening: A First Approach on SIM-GA Data

Multiresolution analysis (MRA) and component substitution (CS) are the two basic frameworks to which image fusion algorithms can be reported when merging multispectral (MS) and panchromatic (Pan) images (pansharpening), acquired with different spatial and spectral resolutions. State-of-the-art algorithms add the spatial details extracted from the Pan into the MS data set by considering different injection strategies. The capability of efficiently modeling the relationships between MS and Pan is crucial for the quality of fusion results and particularly for a correct recovery of local features with a consequent reduction of spectral distortions. Although context-adaptive (CA) injection models have been proposed in the MRA framework, their adoption in CS schemes has been scarcely investigated so far. In this letter, CA strategies are compared with global models by considering a general protocol in which both MRA- and CS-based schemes can be described. Qualitative and quantitative results are reported for three high-resolution data sets from two different sensors, namely, IKONOS and simulated Pleiades. The score gains of well-known and novel quality figures show that CA models are more efficient than global ones.

Massimo Selva

Papers

Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$ Pan Data

MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery

Multispectral and panchromatic data fusion assessment without reference

Hyper-Sharpening: A First Approach on SIM-GA Data

A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images