Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

Hyperspectral remote sensing technology has advanced significantly in the past two decades. Current sensors onboard airborne and spaceborne platforms cover large areas of the Earth surface with unprecedented spectral, spatial, and temporal resolutions. These characteristics enable a myriad of applications requiring fine identification of materials or estimation of physical parameters. Very often, these applications rely on sophisticated and complex data analysis methods. The sources of difficulties are, namely, the high dimensionality and size of the hyperspectral data, the spectral mixing (linear and nonlinear), and the degradation mechanisms associated to the measurement process such as noise and atmospheric effects. This paper presents a tutorial/overview cross section of some relevant hyperspectral data analysis methods and algorithms, organized in six main topics: data fusion, unmixing, classification, target detection, physical parameter retrieval, and fast computing. In all topics, we describe the state-of-the-art, provide illustrative examples, and point to future challenges and research directions.

/pdf/hyperspectral-remote-sensing-data-analysis-and-future-1cxk3zgg98.pdf

Hyperspectral Remote Sensing Data Analysis and Future Challenges

Raman spectroscopy can be used to measure the chemical composition of a sample, which can in turn be used to extract biological information. Many materials have characteristic Raman spectra, which means that Raman spectroscopy has proven to be an effective analytical approach in geology, semiconductor, materials and polymer science fields. The application of Raman spectroscopy and microscopy within biology is rapidly increasing because it can provide chemical and compositional information, but it does not typically suffer from interference from water molecules. Analysis does not conventionally require extensive sample preparation; biochemical and structural information can usually be obtained without labeling. In this protocol, we aim to standardize and bring together multiple experimental approaches from key leaders in the field for obtaining Raman spectra using a microspectrometer. As examples of the range of biological samples that can be analyzed, we provide instructions for acquiring Raman spectra, maps and images for fresh plant tissue, formalin-fixed and fresh frozen mammalian tissue, fixed cells and biofluids. We explore a robust approach for sample preparation, instrumentation, acquisition parameters and data processing. By using this approach, we expect that a typical Raman experiment can be performed by a nonspecialist user to generate high-quality data for biological materials analysis.

/pdf/using-raman-spectroscopy-to-characterize-biological-56ndts7qm5.pdf

Using Raman spectroscopy to characterize biological materials

Traditional imagery—provided, for example, by RGB and/or NIR sensors—has proven to be useful in many agroforestry applications. However, it lacks the spectral range and precision to profile materials and organisms that only hyperspectral sensors can provide. This kind of high-resolution spectroscopy was firstly used in satellites and later in manned aircraft, which are significantly expensive platforms and extremely restrictive due to availability limitations and/or complex logistics. More recently, UAS have emerged as a very popular and cost-effective remote sensing technology, composed of aerial platforms capable of carrying small-sized and lightweight sensors. Meanwhile, hyperspectral technology developments have been consistently resulting in smaller and lighter sensors that can currently be integrated in UAS for either scientific or commercial purposes. The hyperspectral sensors’ ability for measuring hundreds of bands raises complexity when considering the sheer quantity of acquired data, whose usefulness depends on both calibration and corrective tasks occurring in pre- and post-flight stages. Further steps regarding hyperspectral data processing must be performed towards the retrieval of relevant information, which provides the true benefits for assertive interventions in agricultural crops and forested areas. Considering the aforementioned topics and the goal of providing a global view focused on hyperspectral-based remote sensing supported by UAV platforms, a survey including hyperspectral sensors, inherent data processing and applications focusing both on agriculture and forestry—wherein the combination of UAV and hyperspectral sensors plays a center role—is presented in this paper. Firstly, the advantages of hyperspectral data over RGB imagery and multispectral data are highlighted. Then, hyperspectral acquisition devices are addressed, including sensor types, acquisition modes and UAV-compatible sensors that can be used for both research and commercial purposes. Pre-flight operations and post-flight pre-processing are pointed out as necessary to ensure the usefulness of hyperspectral data for further processing towards the retrieval of conclusive information. With the goal of simplifying hyperspectral data processing—by isolating the common user from the processes’ mathematical complexity—several available toolboxes that allow a direct access to level-one hyperspectral data are presented. Moreover, research works focusing the symbiosis between UAV-hyperspectral for agriculture and forestry applications are reviewed, just before the paper’s conclusions.

/pdf/hyperspectral-imaging-a-review-on-uav-based-sensors-data-h7zu88r0tz.pdf

Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry

"A picture is worth one thousand words". This proverb comes from Confucius a Chinese philosopher before about 2500 years ago. Now, the essence of these words is universally understood. A picture can be magical in its ability to quickly communicate a complex story or a set of ideas that can be recalled by the viewer later in time. Visual information plays an important role in our society, it will play an increasingly pervasive role in our lives, and there will be a growing need to have these sources processed further. The pictures or images are used in many application areas like architectural and engineering design, fashion, journalism, advertising, entertainment, etc. Thus it provides the necessary opportunity for us to use the abundance of images. However, the knowledge will be useless if one can't _nd it. In the face of the substantive and increasing apace images, how to search and to retrieve the images that we interested with facility is a fatal problem: it brings a necessity for image retrieval systems. As we know, visual features of the images provide a description of their content. Content-based image retrieval (CBIR), emerged as a promising mean for retrieving images and browsing large images databases. CBIR has been a topic of intensive research in recent years. It is the process of retrieving images from a collection based on automatically extracted features.

/pdf/a-survey-of-shape-feature-extraction-techniques-3qmkhziio7.pdf

A Survey of Shape Feature Extraction Techniques

In this paper, a new denoising method is proposed for hyperspectral data cubes that already have a reasonably good signal-to-noise ratio (SNR) (such as 600 : 1). Given this level of the SNR, the noise level of the data cubes is relatively low. The conventional image denoising methods are likely to remove the fine features of the data cubes during the denoising process. We propose to decorrelate the image information of hyperspectral data cubes from the noise by using principal component analysis (PCA) and removing the noise in the low-energy PCA output channels. The first PCA output channels contain a majority of the total energy of a data cube, and the rest PCA output channels contain a small amount of energy. It is believed that the low-energy channels also contain a large amount of noise. Removing noise in the low-energy PCA output channels will not harm the fine features of the data cubes. A 2-D bivariate wavelet thresholding method is used to remove the noise for low-energy PCA channels, and a 1-D dual-tree complex wavelet transform denoising method is used to remove the noise of the spectrum of each pixel of the data cube. Experimental results demonstrated that the proposed denoising method produces better denoising results than other denoising methods published in the literature.

Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage

Translation invariant (TI) single wavelet denoising was developed by Coifman and Donoho (1994), and they show that TI is better than non-TI single wavelet denoising. On the other other hand, Strela et al. (1994) have found that non-TI multiwavelet denoising gives better results than non-TI single wavelets. We extend Coifman and Donoho's TI single wavelet denoising scheme to multiwavelets. Experimental results show that TI multiwavelet denoising is better than the single case for soft thresholding.

Translation-invariant denoising using multiwavelets

Multiwavelets give better results than single wavelets for signal denoising. We study multiwavelet thresholding by incorporating neighboring coefficients. Experimental results show that this approach is better than the conventional approach, which only uses the term-by-term multiwavelet denoising. Also, it outperforms neighbor single wavelet denoising for some standard test signals and real-life images. This is an extension to Cai and Silverman's (see Sankhya: Ind. J. Stat. B, pt.2, vol.63, p.127-148, 2001) work.

Guangyi Chen

Papers

Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage

Translation-invariant denoising using multiwavelets

Multiwavelets denoising using neighboring coefficients

Image denoising with neighbour dependency and customized wavelet and threshold

Image denoising with complex ridgelets