Time Series Classification (TSC) is an important and challenging problem in data mining. With the increase of time series data availability, hundreds of TSC algorithms have been proposed. Among these methods, only a few have considered Deep Neural Networks (DNNs) to perform this task. This is surprising as deep learning has seen very successful applications in the last years. DNNs have indeed revolutionized the field of computer vision especially with the advent of novel deeper architectures such as Residual and Convolutional Neural Networks. Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition. In this article, we study the current state-of-the-art performance of deep learning algorithms for TSC by presenting an empirical study of the most recent DNN architectures for TSC. We give an overview of the most successful deep learning applications in various time series domains under a unified taxonomy of DNNs for TSC. We also provide an open source deep learning framework to the TSC community where we implemented each of the compared approaches and evaluated them on a univariate TSC benchmark (the UCR/UEA archive) and 12 multivariate time series datasets. By training 8730 deep learning models on 97 time series datasets, we propose the most exhaustive study of DNNs for TSC to date.

https://link.springer.com/content/pdf/10.1007/s10618-019-00619-1.pdf

Deep learning for time series classification: a review

A deep convolutional neural network model to classify heartbeats

Regardless of successful applications of the convolutional neural networks (CNNs) in different fields, its application to seismic waveform classification and first-break (FB) picking has not been explored yet. This letter investigates the application of CNNs for classifying time-space waveforms from seismic shot gathers and picking FBs of both direct wave and refracted wave. We use representative subimage samples with two types of labeled waveform classification to supervise CNNs training. The goal is to obtain the optimal weights and biases in CNNs, which are solved by minimizing the error between predicted and target label classification. The trained CNNs can be utilized to automatically extract a set of time-space attributes or features from any subimage in shot gathers. These attributes are subsequently inputted to the trained fully connected layer of CNNs to output two values between 0 and 1. Based on the two-element outputs, a discriminant score function is defined to provide a single indication for classifying input waveforms. The FB is then located from the calculated score maps by sequentially using a threshold, the first local minimum rule of every trace and a median filter. Finally, we adopt synthetic and real shot data examples to demonstrate the effectiveness of CNNs-based waveform classification and FB picking. The results illustrate that CNN is an efficient automatic data-driven classifier and picker.

/pdf/seismic-waveform-classification-and-first-break-picking-1776zxtuxs.pdf

Seismic Waveform Classification and First-Break Picking Using Convolution Neural Networks

https://nottingham-repository.worktribe.com/preview/2315217/Multi_Time_Series_Anomaly_Detection_for_Industry_4_0__Neurocomputing_.pdf

Multi-head CNN–RNN for multi-time series anomaly detection: An industrial case study

Statistical and machine learning models in credit scoring: A systematic literature survey

Convolutional neural networks for time series classification

Spatial-temporal local contrast for moving point target detection in space-based infrared imaging system

The micromotion dynamics and geometrical shape are considered to be essential characteristics for exoatmospheric targets discrimination. Many methods have been investigated to retrieve the micromotion features using radar signals returned from targets of a given shape. We explore a way of jointly estimating micromotion dynamics and geometrical shape parameters from the infrared (IR) signals of targets in remote detection distance. It is found that the micromotion dynamics of the target would induce a periodic fluctuating variation on the IR irradiance intensity signature. In addition to the micromotion characteristics, the fluctuation could also reflect target structure properties, which offer a possible clue in extracting the features of micromotion dynamics and geometrical shape. Thus, the data model of target IR irradiance intensity signatures induced by micromotion patterns including spinning, coning, and tumbling is developed, and a method of parameters estimation based on joint optimization analysis techniques is proposed. Experimental results demonstrated that the parameters of target micromotion dynamics and geometrical shape can be effectively estimated using the proposed method, if the input signature contains multiple dominant frequency components.

Micromotion dynamics and geometrical shape parameters estimation of exoatmospheric infrared targets

Object discrimination plays an important role in an infrared (IR) imaging system. However, at a long observing distance, the presence of detector noise and the absence of robust features make space objects' discrimination difficult to tackle with. In this paper, a multi-scale convolutional neural network (MCNN) is proposed for feature learning and classification. It consists of three parts: transformation, local convolution, and full convolution. Different from previous objects' classification methods, the MCNN can automatically extract features of objects at multi-timescales and multi-frequencies. Low-level features are combined with high-level features to simultaneously capture long-term tendency and short-term fluctuations of the time sequences of IR radiation intensity. Training data are generated from IR radiation models considering micro-motion dynamics and inherent properties of space point objects under different scenarios. The simulation results indicate that our method not only promotes the performance but is also robust to the detector noise. The classification accuracy can reach 96% at a strong noise level (signal-to-noise ratio is 10 dB) in a simulation scenario.

/pdf/multi-scale-convolutional-neural-networks-for-space-infrared-4pai857p1i.pdf

Multi-Scale Convolutional Neural Networks for Space Infrared Point Objects Discrimination

A novel waveforms classification method based on convolutional neural networks (CNN) is proposed in this paper. Firstly, convolution and pooling operations are cross used for generating deep features, and then fully connected to the output layer for classification. Different from other traditional approaches which need human-designed features, CNN can discover and extract the suitable internal structure of the input waveform to obtain deep features for classification automatically. So that the generalization ability of this method is significantly improved comparing to other methods. Experimental results show that CNN can obtain state of the art performance for waveforms classification in terms of classification accuracy and noise tolerance.

Huanzhang Lu

Papers

Convolutional neural networks for time series classification

Spatial-temporal local contrast for moving point target detection in space-based infrared imaging system

Micromotion dynamics and geometrical shape parameters estimation of exoatmospheric infrared targets

Multi-Scale Convolutional Neural Networks for Space Infrared Point Objects Discrimination

Waveforms classification based on convolutional neural networks