scispace - formally typeset
Journal ArticleDOI

Representational learning with ELMs for big data

TLDR
Huang et al. as mentioned in this paper proposed ELM-AE, a special case of ELM, where the input is equal to output, and the randomly generated weights are chosen to be orthogonal.
Abstract
Geoffrey Hinton and Pascal Vincent showed that a restricted Boltzmann machine (RBM) and auto-encoders (AE) could be used for feature engineering. These engineered features then could be used to train multiple-layer neural networks, or deep networks. Two types of deep networks based on RBM exist: the deep belief network (DBN)1 and the deep Boltzmann machine (DBM). Guang-Bin Huang and colleagues introduced the extreme learning machine (ELM) as an single-layer feed-forward neural networks (SLFN) with a fast learning speed and good generalization capability. The ELM for SLFNs shows that hidden nodes can be randomly generated. ELM-AE output weights can be determined analytically, unlike RBMs and traditional auto-encoders, which require iterative algorithms. ELM-AE can be seen as a special case of ELM, where the input is equal to output, and the randomly generated weights are chosen to be orthogonal.

read more

Citations
More filters
Journal ArticleDOI

Convolutional Neural Network Based on Extreme Learning Machine for Maritime Ships Recognition in Infrared Images.

TL;DR: A new approach fully based on Extreme Learning Machine (ELM) to learn useful CNN features and perform a fast and accurate classification, which is suitable for infrared-based recognition systems.
Journal ArticleDOI

Automated Diagnosis of Multi-class Brain Abnormalities using MRI Images: A Deep Convolutional Neural Network based Method

TL;DR: A deep convolutional neural network (CNN) based automated approach is designed for the diagnosis of multi-class brain abnormalities and the comparative analysis with existing schemes indicates the superiority of the proposed method.
Journal ArticleDOI

Faster-YOLO: An accurate and faster object detection method

TL;DR: Faster-YOLO is proposed, which is able to perform real-time object detection and improves the detection accuracy effectively by 1.1 percentage points compared to the original YOLOv2, and an average 2X speedup compared to Y OLOv3.
Journal ArticleDOI

Instance cloned extreme learning machine

TL;DR: Experiments and comparisons on 20 UCI data sets, and validations on image and text classification applications, demonstrate that IC-ELM is able to achieve superior results compared to the original ELM algorithm and its variants, as well as several other classical machine learning algorithms.
Proceedings ArticleDOI

Online recurrent extreme learning machine and its application to time-series prediction

TL;DR: A modified version of OS-ELM is proposed, called online recurrent extreme learning machine (OR- ELM), which is able to adjust input weights and can be applied to learn RNN, by applying ELM-auto-encoder and a normalization method called layer normalization (LN).
References
More filters
Journal ArticleDOI

Extreme learning machine: Theory and applications

TL;DR: A new learning algorithm called ELM is proposed for feedforward neural networks (SLFNs) which randomly chooses hidden nodes and analytically determines the output weights of SLFNs which tends to provide good generalization performance at extremely fast learning speed.
Journal ArticleDOI

Extreme Learning Machine for Regression and Multiclass Classification

TL;DR: ELM provides a unified learning platform with a widespread type of feature mappings and can be applied in regression and multiclass classification applications directly and in theory, ELM can approximate any target continuous function and classify any disjoint regions.
Journal ArticleDOI

Universal approximation using incremental constructive feedforward networks with random hidden nodes

TL;DR: This paper proves in an incremental constructive method that in order to let SLFNs work as universal approximators, one may simply randomly choose hidden nodes and then only need to adjust the output weights linking the hidden layer and the output layer.
Journal ArticleDOI

Optimization method based extreme learning machine for classification

TL;DR: Under the ELM learning framework, SVM's maximal margin property and the minimal norm of weights theory of feedforward neural networks are actually consistent and ELM for classification tends to achieve better generalization performance than traditional SVM.
Related Papers (5)