Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods. † Correspondence: Chung-Ming Kuan, Institute of Economics, Academia Sinica, 128 Academia Road, Sec. 2, Taipei 115, Taiwan; ckuan@econ.sinica.edu.tw. †† I would like to express my sincere gratitude to the editor, Professor Steven Durlauf, for his patience and constructive comments on early drafts of this entry. I also thank Shih-Hsun Hsu and Yu-Lieh Huang for very helpful suggestions. The remaining errors are all mine.

Artificial neural networks

State-of-the-art in artificial neural network applications: A survey

In recent years, deep learning has garnered tremendous success in a variety of application domains. This new field of machine learning has been growing rapidly and has been applied to most traditional application domains, as well as some new areas that present more opportunities. Different methods have been proposed based on different categories of learning, including supervised, semi-supervised, and un-supervised learning. Experimental results show state-of-the-art performance using deep learning when compared to traditional machine learning approaches in the fields of image processing, computer vision, speech recognition, machine translation, art, medical imaging, medical information processing, robotics and control, bioinformatics, natural language processing, cybersecurity, and many others. This survey presents a brief survey on the advances that have occurred in the area of Deep Learning (DL), starting with the Deep Neural Network (DNN). The survey goes on to cover Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), including Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL). Additionally, we have discussed recent developments, such as advanced variant DL techniques based on these DL approaches. This work considers most of the papers published after 2012 from when the history of deep learning began. Furthermore, DL approaches that have been explored and evaluated in different application domains are also included in this survey. We also included recently developed frameworks, SDKs, and benchmark datasets that are used for implementing and evaluating deep learning approaches. There are some surveys that have been published on DL using neural networks and a survey on Reinforcement Learning (RL). However, those papers have not discussed individual advanced techniques for training large-scale deep learning models and the recently developed method of generative models.

A State-of-the-Art Survey on Deep Learning Theory and Architectures

Presently, COVID-19 has posed a serious threat to researchers, scientists, health professionals, and administrations around the globe from its detection to its treatment. The whole world is witnessing a lockdown like situation because of COVID-19 pandemic. Persistent efforts are being made by the researchers to obtain the possible solutions to control this pandemic in their respective areas. One of the most common and effective methods applied by the researchers is the use of CT-Scans and X-rays to analyze the images of lungs for COVID-19. However, it requires several radiology specialists and time to manually inspect each report which is one of the challenging tasks in a pandemic. In this paper, we have proposed a deep learning neural network-based method nCOVnet, an alternative fast screening method that can be used for detecting the COVID-19 by analyzing the X-rays of patients which will look for visual indicators found in the chest radiography imaging of COVID-19 patients.

/pdf/application-of-deep-learning-for-fast-detection-of-covid-19-ghalnkwdm2.pdf

Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet

The future Internet of Things (IoT) will have a deep economical, commercial and social impact on our lives. The participating nodes in IoT networks are usually resource-constrained, which makes them luring targets for cyber attacks. In this regard, extensive efforts have been made to address the security and privacy issues in IoT networks primarily through traditional cryptographic approaches. However, the unique characteristics of IoT nodes render the existing solutions insufficient to encompass the entire security spectrum of the IoT networks. Machine Learning (ML) and Deep Learning (DL) techniques, which are able to provide embedded intelligence in the IoT devices and networks, can be leveraged to cope with different security problems. In this paper, we systematically review the security requirements, attack vectors, and the current security solutions for the IoT networks. We then shed light on the gaps in these security solutions that call for ML and DL approaches. Finally, we discuss in detail the existing ML and DL solutions for addressing different security problems in IoT networks. We also discuss several future research directions for ML- and DL-based IoT security.

Machine Learning in IoT Security: Current Solutions and Future Challenges

Rapid advances in hardware-based technologies during the past decades have opened up new possibilities for life scientists to gather multimodal data in various application domains, such as omics , bioimaging , medical imaging , and (brain/body)–machine interfaces . These have generated novel opportunities for development of dedicated data-intensive machine learning techniques. In particular, recent research in deep learning (DL), reinforcement learning (RL), and their combination (deep RL) promise to revolutionize the future of artificial intelligence. The growth in computational power accompanied by faster and increased data storage, and declining computing costs have already allowed scientists in various fields to apply these techniques on data sets that were previously intractable owing to their size and complexity. This paper provides a comprehensive survey on the application of DL, RL, and deep RL techniques in mining biological data. In addition, we compare the performances of DL techniques when applied to different data sets across various application domains. Finally, we outline open issues in this challenging research area and discuss future development perspectives.

/pdf/applications-of-deep-learning-and-reinforcement-learning-to-3l72kwyi7n.pdf

Applications of Deep Learning and Reinforcement Learning to Biological Data

The recent expansion of pervasive computing technology has contributed with novel means to pursue human activities in urban space. The urban dynamics unveiled by these means generate an enormous amount of data. These data are mainly endowed by portable and radio-frequency devices, transportation systems, video surveillance, satellites, unmanned aerial vehicles, and social networking services. This has opened a new avenue of opportunities, to understand and predict urban dynamics in detail, and plan various real-time services and applications in response to that. Over the last decade, certain aspects of the crowd, e.g., mobility, sentimental, size estimation and behavioral, have been analyzed in detail and the outcomes have been reported. This paper mainly conducted an extensive survey on various data sources used for different urban applications, the state-of-the-art on urban data generation techniques and associated processing methods in order to demonstrate their merits and capabilities. Then, available open-access crowd data sets for urban event detection are provided along with relevant application programming interfaces. In addition, an outlook on a support system for urban application is provided which fuses data from all the available pervasive technology sources and finally, some open challenges and promising research directions are outlined.

/pdf/advances-in-crowd-analysis-for-urban-applications-through-2npq08dqbs.pdf

Advances in Crowd Analysis for Urban Applications Through Urban Event Detection

Advancement in robotic technology triggered its usability in the next generation healthcare system. Healthcare robots are expected to assist clinicians and healthcare professionals at all settings by monitoring patient’s physiological conditions in real time, facilitating advanced intervention such as robotic surgery, supporting patient care at the hospital and home, dispensing medication, assisting patients with cognition challenges and disabilities, keeping company to geriatric and physically/mentally challenged patients and hospital building management such as disinfecting places. Thus, the robotic agent can enhance healthcare experiences by reducing patient care work and strenuous/repetitive manual tasks. The robotic applications can also be elongated in supporting the healthcare system for the management of pandemics like novel coronavirus (COVID-19) infection and upcoming pandemics. Such applications include collecting the sample from a patient for screening, disinfecting the hospital, supply logistics, and food to the infected patient, collect physiological conditions. This chapter aims to provide an overview of various types of assistive robots employed for healthcare services especially in fighting pandemic and natural disasters.

Healthcare Robots to Combat COVID-19

With the massive improvement in sensing techniques, government agencies and researchers are interested in exploring underwater resources by deploying underwater sensor nodes. The harsh random environment and open acoustic channel are the main two challenges for the researchers. In addition, the network is vulnerable due to faulty and compromised node. This paper presents a trust management model based on Hidden Markov Model (HMM) for measuring the trustworthiness of the sensor nodes to combat malicious or internal attack. In addition, we have also suggested a lightweight stream cipher scheme named ChaCha20 to prevent external attack. Mathematical analysis shows that ChaCha20 performs better in terms of energy efficiency which is suitable for UWSN. The numerical results reveals that the proposed methods are able to prevent attacks in UWSNs.

Mohammed Shamim Kaiser

Papers

Applications of Deep Learning and Reinforcement Learning to Biological Data

Advances in Crowd Analysis for Urban Applications Through Urban Event Detection

Healthcare Robots to Combat COVID-19

Hidden Markov Model based Trust Management Model for Underwater Wireless Sensor Networks