Forest Type Classification: A Hybrid NN-GA Model Based Approach
01 Jan 2016-pp 227-236
TL;DR: The authors have proposed a GA trained Neural Network classifier to tackle the task of classify tree species and one mixed forest class using geographically weighted variables calculated for Cryptomeria japonica and Chamaecyparis obtusa.
Abstract: Recent researches have used geographically weighted variables calculated for two tree species, Cryptomeria japonica (Sugi, or Japanese Cedar) and Chamaecyparis obtusa (Hinoki, or Japanese Cypress) to classify the two species and one mixed forest class. In machine learning context it has been found to be difficult to predict that a pixel belongs to a specific class in a heterogeneous landscape image, especially in forest images, as ground features of nearly located pixel of different classes have very similar spectral characteristics. In the present work the authors have proposed a GA trained Neural Network classifier to tackle the task. The local search based traditional weight optimization algorithms may get trapped in local optima and may be poor in training the network. NN trained with GA (NN-GA) overcomes the problem by gradually optimizing the input weight vector of the NN. The performance of NN-GA has been compared with NN, SVM and Random Forest classifiers in terms of performance measures like accuracy, precision, recall, F-Measure and Kappa Statistic. The results have been found to be satisfactory and a reasonable improvement has been made over the existing performances in the literature by using NN-GA.
Citations
More filters
TL;DR: A novel application of Particle Swarm Optimization (PSO) trained Artificial Neural Network (ANN) has been employed to separate the patients having Dengue fevers from those who are recovering from it or do not have DF.
Abstract: A mosquito borne pathogen called Dengue virus (DENV) has been emerged as one of the most fatal threats in the recent time. Infections can be in two main forms, namely the DF (Dengue Fever), and DHF (Dengue Hemorrhagic Fever). An efficient detection method for both fever types turns out to be a significant task. Thus, in the present work, a novel application of Particle Swarm Optimization (PSO) trained Artificial Neural Network (ANN) has been employed to separate the patients having Dengue fevers from those who are recovering from it or do not have DF. The ANN’s input weight vector are optimized using PSO to achieve the expected accuracy and to avoid premature convergence toward the local optima. Therefore, a gene expression data (GDS5093 dataset) available publicly is used. The dataset contains gene expression data for DF, DHF, convalescent and healthy control patients of total 56 subjects. Greedy forward selection method has been applied to select most promising genes to identify the DF, DHF and normal (either convalescent or healthy controlled) patients. The proposed system performance was compared to the multilayer perceptron feed-forward neural network (MLP-FFN) classifier. Results proved the dominance of the proposed method with achieved accuracy of 90.91 %.
56 citations
01 Jan 2018
50 citations
TL;DR: A modified bag-of-features method has been proposed to select the most promising genes in the classification process and results indicated a highly statistically significant improvement with the proposed classifier over the traditional ANN-CS model.
Abstract: Dengue fever detection and classification have a vital role due to the recent outbreaks of different kinds of dengue fever. Recently, the advancement in the microarray technology can be employed for such classification process. Several studies have established that the gene selection phase takes a significant role in the classifier performance. Subsequently, the current study focused on detecting two different variations, namely, dengue fever (DF) and dengue hemorrhagic fever (DHF). A modified bag-of-features method has been proposed to select the most promising genes in the classification process. Afterward, a modified cuckoo search optimization algorithm has been engaged to support the artificial neural (ANN-MCS) to classify the unknown subjects into three different classes namely, DF, DHF, and another class containing convalescent and normal cases. The proposed method has been compared with other three well-known classifiers, namely, multilayer perceptron feed-forward network (MLP-FFN), artificial neural network (ANN) trained with cuckoo search (ANN-CS), and ANN trained with PSO (ANN-PSO). Experiments have been carried out with different number of clusters for the initial bag-of-features-based feature selection phase. After obtaining the reduced dataset, the hybrid ANN-MCS model has been employed for the classification process. The results have been compared in terms of the confusion matrix-based performance measuring metrics. The experimental results indicated a highly statistically significant improvement with the proposed classifier over the traditional ANN-CS model.
43 citations
Cites background or methods from "Forest Type Classification: A Hybri..."
...Previously, several recently developed meta-heuristic algorithms have been employed to train ANNs apart from traditional ones, such as genetic algorithm [40], particle swarm optimization [32], and the non-dominated sorting genetic algorithm [41]....
[...]
...ter quality prediction [36], electrical energy output prediction [33], dengue fever classification [42], and environmental application [40]....
[...]
01 Aug 2017
TL;DR: Experimental results clearly show the superiority of the proposed NN-NSGA-II model with different features, which has been evaluated using various performances measuring metrics such as accuracy, precision, recall and F-measure.
Abstract: Automated, efficient and accurate classification of skin diseases using digital images of skin is very important for bio-medical image analysis. Various techniques have already been developed by many researchers. In this work, a technique based on meta-heuristic supported artificial neural network has been proposed to classify images. Here 3 common skin diseases have been considered namely angioma, basal cell carcinoma and lentigo simplex. Images have been obtained from International Skin Imaging Collaboration (ISIC) dataset. A popular multi objective optimization method called Non-dominated Sorting Genetic Algorithm — II is employed to train the ANN (NNNSGA-II). Different feature have been extracted to train the classifier. A comparison has been made with the proposed model and two other popular meta-heuristic based classifier namely NN-PSO (ANN trained with Particle Swarm Optimization) and NN-GA (ANN trained with Genetic algorithm). The results have been evaluated using various performances measuring metrics such as accuracy, precision, recall and F-measure. Experimental results clearly show the superiority of the proposed NN-NSGA-II model with different features.
39 citations
Cites background from "Forest Type Classification: A Hybri..."
...Early stage detection of the disease type is important since appropriate treatments can be applied based on the type of the disease [3]....
[...]
01 Oct 2017
TL;DR: Experimental results indicated towards the superiority of the proposed bag-of-features enabled NN-NSGA-II model in terms of testing phase confusion matrix based performance measuring metrics.
Abstract: The current work proposes a neural based detection method of two different skin diseases using skin imaging. Skin images of two diseases namely Basel Cell Carcinoma and Skin Angioma are utilized. SIFT feature extractor has been employed followed by a clustering phase on feature space in order to reduce the number of features suitable for neural based models. The extracted bag-of-features modified dataset is used to train metaheuristic supported hybrid Artificial Neural Networks to classify the skin images in order to detect the diseases under study. A well-known multi objective optimization technique called Non-dominated Sorting Genetic Algorithm — II is used to train the ANN (NN-NSGA-II). The proposed model is further compared with two other well-known metaheuristic based classifier namely NN-PSO (ANN trained with PSO) and NN-CS (ANN trained with Cuckoo Search) in terms of testing phase confusion matrix based performance measuring metrics such as accuracy, precision, recall and F-measure. Experimental results indicated towards the superiority of the proposed bag-of-features enabled NN-NSGA-II model.
36 citations
References
More filters
[...]
TL;DR: Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the forest, and are also applicable to regression.
Abstract: Random forests are a combination of tree predictors such that each tree depends on the values of a random vector sampled independently and with the same distribution for all trees in the forest. The generalization error for forests converges a.s. to a limit as the number of trees in the forest becomes large. The generalization error of a forest of tree classifiers depends on the strength of the individual trees in the forest and the correlation between them. Using a random selection of features to split each node yields error rates that compare favorably to Adaboost (Y. Freund & R. Schapire, Machine Learning: Proceedings of the Thirteenth International conference, aaa, 148–156), but are more robust with respect to noise. Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the splitting. Internal estimates are also used to measure variable importance. These ideas are also applicable to regression.
79,257 citations
TL;DR: Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
Abstract: LIBSVM is a library for Support Vector Machines (SVMs). We have been actively developing this package since the year 2000. The goal is to help users to easily apply SVM to their applications. LIBSVM has gained wide popularity in machine learning and many other areas. In this article, we present all implementation details of LIBSVM. Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
40,826 citations
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
Abstract: The support-vector network is a new learning machine for two-group classification problems. The machine conceptually implements the following idea: input vectors are non-linearly mapped to a very high-dimension feature space. In this feature space a linear decision surface is constructed. Special properties of the decision surface ensures high generalization ability of the learning machine. The idea behind the support-vector network was previously implemented for the restricted case where the training data can be separated without errors. We here extend this result to non-separable training data.
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated. We also compare the performance of the support-vector network to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
37,861 citations
Book•
08 Sep 2000TL;DR: This book presents dozens of algorithms and implementation examples, all in pseudo-code and suitable for use in real-world, large-scale data mining projects, and provides a comprehensive, practical look at the concepts and techniques you need to get the most out of real business data.
Abstract: The increasing volume of data in modern business and science calls for more complex and sophisticated tools. Although advances in data mining technology have made extensive data collection much easier, it's still always evolving and there is a constant need for new techniques and tools that can help us transform this data into useful information and knowledge. Since the previous edition's publication, great advances have been made in the field of data mining. Not only does the third of edition of Data Mining: Concepts and Techniques continue the tradition of equipping you with an understanding and application of the theory and practice of discovering patterns hidden in large data sets, it also focuses on new, important topics in the field: data warehouses and data cube technology, mining stream, mining social networks, and mining spatial, multimedia and other complex data. Each chapter is a stand-alone guide to a critical topic, presenting proven algorithms and sound implementations ready to be used directly or with strategic modification against live data. This is the resource you need if you want to apply today's most powerful data mining techniques to meet real business challenges. * Presents dozens of algorithms and implementation examples, all in pseudo-code and suitable for use in real-world, large-scale data mining projects. * Addresses advanced topics such as mining object-relational databases, spatial databases, multimedia databases, time-series databases, text databases, the World Wide Web, and applications in several fields. *Provides a comprehensive, practical look at the concepts and techniques you need to get the most out of real business data
23,600 citations
01 Mar 1996
TL;DR: The article discusses the motivations behind the development of ANNs and describes the basic biological neuron and the artificial computational model, and outlines network architectures and learning processes, and presents some of the most commonly used ANN models.
Abstract: Artificial neural nets (ANNs) are massively parallel systems with large numbers of interconnected simple processors. The article discusses the motivations behind the development of ANNs and describes the basic biological neuron and the artificial computational model. It outlines network architectures and learning processes, and presents some of the most commonly used ANN models. It concludes with character recognition, a successful ANN application.
4,281 citations