Data Mining Practical Machine Learning Tools and Techniques

We explore the effect of dimensionality on the nearest neighbor problem. We show that under a broad set of conditions (much broader than independent and identically distributed dimensions), as dimensionality increases, the distance to the nearest data point approaches the distance to the farthest data point. To provide a practical perspective, we present empirical results on both real and synthetic data sets that demonstrate that this effect can occur for as few as 10-15 dimensions. These results should not be interpreted to mean that high-dimensional indexing is never meaningful; we illustrate this point by identifying some high-dimensional workloads for which this effect does not occur. However, our results do emphasize that the methodology used almost universally in the database literature to evaluate high-dimensional indexing techniques is flawed, and should be modified. In particular, most such techniques proposed in the literature are not evaluated versus simple linear scan, and are evaluated over workloads for which nearest neighbor is not meaningful. Often, even the reported experiments, when analyzed carefully, show that linear scan would outperform the techniques being proposed on the workloads studied in high (10-15) dimensionality!.

When is nearest neighbor meaningful

An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction

Integrating the various embedded devices and systems in our environment enables an Internet of Things (IoT) for a smart city. The IoT will generate tremendous amount of data that can be leveraged for safety, efficiency, and infotainment applications and services for city residents. The management of this voluminous data through its lifecycle is fundamental to the realization of smart cities. Therefore, in contrast to existing surveys on smart cities we provide a data-centric perspective, describing the fundamental data management techniques employed to ensure consistency, interoperability, granularity, and reusability of the data generated by the underlying IoT for smart cities. Essentially, the data lifecycle in a smart city is dependent on tightly coupled data management with cross-cutting layers of data security and privacy, and supporting infrastructure. Therefore, we further identify techniques employed for data security and privacy, and discuss the networking and computing technologies that enable smart cities. We highlight the achievements in realizing various aspects of smart cities, present the lessons learned, and identify limitations and research challenges.

Smart Cities: A Survey on Data Management, Security, and Enabling Technologies

斜向妥当化(Cross-Validation)の必要と方法

Forecasting electricity load by a novel recurrent extreme learning machines approach

A novel failure rate prediction model is developed by the extreme learning machine (ELM) to provide key information needed for optimum ongoing maintenance/rehabilitation of a water network, meaning the estimated times for the next failures of individual pipes within the network. The developed ELM model is trained using more than 9500 instances of pipe failure in the Greater Toronto Area, Canada from 1920 to 2005 with pipe attributes as inputs, including pipe length, diameter, material, and previously recorded failures. The models show recent, extensive usage of pipe coating with cement mortar and cathodic protection has significantly increased their lifespan. The predictive model includes the pipe protection method as pipe attributes and can reflect in its predictions, the effect of different pipe protection methods on the expected time to the next pipe failure. The developed ELM has a superior prediction accuracy relative to other available machine learning algorithms such as feed-forward artificial neural network that is trained by backpropagation, support vector regression, and non-linear regression. The utility of the models provides useful inputs when planning and budgeting for watermain inspection, maintenance, and rehabilitation.

Extreme learning machine model for water network management

This study showed that the PD can be diagnosed by using sensors attached at underfoot from gait.Feature extracted by Shifted 1D-LBP, which is sensitive to local changes in time signals.Shifted 1D-LBP has a simple algorithm. It can be used in real time applications.Obtained detection accuracy is 88.8889%.The accuracy results were compared with the results of previous studies in literature. The Parkinson's disease (PD) is one of the most common diseases, especially in elderly people. Although the previous studies showed that the PD can be diagnosed by expert systems through its cardinal symptoms such as the tremor, muscular rigidity, disorders of movements and voice, it was reported that the presented approaches, which utilize simple motor tasks, were limited and lack of standardization. To achieve a standard approach in PD detection, an approach, which is built on shifted one-dimensional local binary patterns (Shifted 1D-LBP) and machine learning methods, was proposed. Shifted 1D-LBP is built on 1D-LBP, which is sensitive to local changes in a signal. In 1D-LBP the positions of neighbors around center data are constant and therefore, the number of patterns that can be exacted by it is limited. This drawback was solved by Shifted 1D-LBP by changeable positions of neighbors. In evaluation and validation stages, the Gait in Parkinson's Disease (gaitpdb) dataset, which consists of three gait datasets that were recorded in different tasks or experiment protocols, were employed. Statistical features were exacted from formed histograms of gait signals transformed by Shifted 1D-LBP. Whole features and selected features were classified by machine learning methods. Obtained results were compared with statistical features exacted from signals in both time and frequency domains and results reported in the literature. Achieved results showed that the proposed approach can be successfully employed in PD detection from gait. This work is not only an attempt to develop a PD detection method, but also a general-purpose approach that is based on detecting local changes in time ordered signals.

Detection of Parkinson's disease by Shifted One Dimensional Local Binary Patterns from gait

In this study, two novel local binary patterns were proposed.First one is based on spatial relations between neighbors with a distance parameter.The second is based on relations between a reference pixel and its neighbor on the same orientation.Two approaches are improved to detect special patterns in images.The results show that the proposed approaches can be used in image processing areas. The recent developments in the image quality, storage and data transmission capabilities increase the importance of texture analysis, which plays an important role in computer vision and image processing. Local binary pattern (LBP) is an effective statistical texture descriptor, which has successful applications in texture classification. In this paper, two novel descriptors were proposed to search different patterns in images built on LBP. One of them is based on the relations between the sequential neighbors with a specified distance and the other one is based on determining the neighbors in the same orientation through central pixel parameter. These descriptors are tested with the Brodatz-1, Brodatz-2, Butterfly and Kylberg datasets to show the applicability of the proposed nLBPd and dLBPα descriptors. The proposed methods are also compared with classical LBP. The average accuracies obtained by ANN with 10 fold cross validation, which are 99.26% (LBPu2 and nLBPd), 94.44% (dLBPα), 95.71% ( n L B P d u 2 ) and %99.64 (nLBPd), for Brodatz-1, Brodatz-2, Butterfly and Kylberg datasets, respectively, show that the proposed methods outperform significant accuracies.

Ömer Faruk Ertuğrul

Papers

Forecasting electricity load by a novel recurrent extreme learning machines approach

Extreme learning machine model for water network management

Detection of Parkinson's disease by Shifted One Dimensional Local Binary Patterns from gait

Two novel local binary pattern descriptors for texture analysis

A novel type of activation function in artificial neural networks: Trained activation function.