Hybrid neural network

About: Hybrid neural network is a research topic. Over the lifetime, 1305 publications have been published within this topic receiving 18223 citations.

A framework for the general design and computation of hybrid neural networks

Abstract: There is a growing trend to design hybrid neural networks (HNNs) by combining spiking neural networks and artificial neural networks to leverage the strengths of both. Here, we propose a framework for general design and computation of HNNs by introducing hybrid units (HUs) as a linkage interface. The framework not only integrates key features of these computing paradigms but also decouples them to improve flexibility and efficiency. HUs are designable and learnable to promote transmission and modulation of hybrid information flows in HNNs. Through three cases, we demonstrate that the framework can facilitate hybrid model design. The hybrid sensing network implements multi-pathway sensing, achieving high tracking accuracy and energy efficiency. The hybrid modulation network implements hierarchical information abstraction, enabling meta-continual learning of multiple tasks. The hybrid reasoning network performs multimodal reasoning in an interpretable, robust and parallel manner. This study advances cross-paradigm modeling for a broad range of intelligent tasks.

Neural Network based Road Sign Recognition

Abstract: A recent surge of interest is to recognize Road Signs. Signs are visual languages that represent some special circumstantial information of environment. They provide important information for guiding, warning people to make their movements safer, easier and more convenient. This thesis presents a hybrid neural network solution for Road sign recognition which combines local image sampling and artificial neural network. The method is based on BAM for dimensional reduction and multi-layer perception with backpropagation algorithm has been used for training the network. It has been found from practical observations that the number of iterations required to train the network is enormous. The capability of recognition of a neural network increases with increasing the training accuracy. For this process each sign is converted to a designated M×N feature matrix. These feature matrices of signs are then fed into the neural network as input patterns. The neural network is trained with the set of input patterns of the digits to acquire separate knowledge corresponding to each Road sign. In order to justify the effectiveness of the system, different test patterns of the signs are used to verify the system. Experimental results demonstrate that the system is capable of recognizing Road signs with 98% accuracy.

Hybrid neural network based rainfall prediction supported by flower pollination algorithm

Abstract: The present work proposes a hybrid neural network based model for rainfall prediction in the Southern part of the state West Bengal of India. The hybrid model is a multistep method. Initially, the data is clustered into a reasonable number of clusters by applying fuzzy c-means algorithm, then for every cluster a separate Neural Network (NN) is trained with the data points of that cluster using well known metaheuristic Flower Pollination Algorithm (FPA). In addition, as a preprocessing phase a feature selection phase is included. Greedy forward selection algorithm is employed to find the most suitable set of features for predicting rainfall. To establish the ingenuity of the proposed hybrid prediction model (Hybrid Neural Network or HNN) has been compared with two well-known models namely multilayer perceptron feed-forward network (MLP-FFN) using different performance metrics. The data set for simulating the model is collected from Dumdum meteorological station (West Bengal, India), recorded with in the 1989 to 1995. The simulation results have revealed that the proposed model is significantly better than traditional methods in predicting rainfall.

Optimal Control of Switched System Based on Neural Network Optimization

Abstract: The optimal control problem of switched system is to find both the optimal control input and optimal switching signal and is a mixed integer problem. High computational burden in solving this problem is a major obstacle. To solve this problem, this paper presented hybrid neural network combining continuous neurons and discrete neurons and designed lyapunov function to guarantee the convergency of proposed hybrid neural network. This new solution method is more suitable to parallel implementation than the mathematical programming. Simulation results show that this approach can utilize fast converge property and the parallel computation ability of neural network and apply to real-time control.

Deep-DFR: A Memristive Deep Delayed Feedback Reservoir Computing System with Hybrid Neural Network Topology

Abstract: Deep neural networks (DNNs), the brain-like machine learning architecture, have gained immense success in data-extensive applications. In this work, a hybrid structured deep delayed feedback reservoir (Deep-DFR) computing model is proposed and fabricated. Our Deep-DFR employs memristive synapses working in a hierarchical information processing fashion with DFR modules as the readout layer, leading our proposed deep learning structure to be both depth-in-space and depth-in-time. Our fabricated prototype along with experimental results demonstrate its high energy efficiency with low hardware implementation cost. With applications on the image classification, MNIST and SVHN, our Deep-DFR yields a 1.26 $\sim$ 7.69X reduction on the testing error compared to state-of-the-art DNN designs.