Committee machines-a universal method to deal with non-idealities in memristor-based neural networks.
Dovydas Joksas,Pedro Freitas,Chai Zheng,Wing H. Ng,Mark Buckwell,Can Li,Weidong Zhang,Qiangfei Xia,Anthony J. Kenyon,Adnan Mehonic +9 more
TLDR
A technology-agnostic approach, committee machines, is demonstrated, which increases the inference accuracy of memristive neural networks that suffer from device variability, faulty devices, random telegraph noise and line resistance.Abstract:
Artificial neural networks are notoriously power- and time-consuming when implemented on conventional von Neumann computing systems. Consequently, recent years have seen an emergence of research in machine learning hardware that strives to bring memory and computing closer together. A popular approach is to realise artificial neural networks in hardware by implementing their synaptic weights using memristive devices. However, various device- and system-level non-idealities usually prevent these physical implementations from achieving high inference accuracy. We suggest applying a well-known concept in computer science—committee machines—in the context of memristor-based neural networks. Using simulations and experimental data from three different types of memristive devices, we show that committee machines employing ensemble averaging can successfully increase inference accuracy in physically implemented neural networks that suffer from faulty devices, device-to-device variability, random telegraph noise and line resistance. Importantly, we demonstrate that the accuracy can be improved even without increasing the total number of memristors. Designing reliable and energy-efficient memristor-based artificial neural networks remains a challenge. Here, the authors demonstrate a technology-agnostic approach, committee machines, which increases the inference accuracy of memristive neural networks that suffer from device variability, faulty devices, random telegraph noise and line resistance.read more
Citations
More filters
Journal ArticleDOI
Overview of Immune Response During SARS-CoV-2 Infection: Lessons From the Past.
Vibhuti Kumar Shah,Priyanka Firmal,Priyanka Firmal,Aftab Alam,Dipyaman Ganguly,Samit Chattopadhyay,Samit Chattopadhyay,Samit Chattopadhyay +7 more
TL;DR: The similarities of the coronaviruses that caused SARS and MERS to the novel SARS-CoV-2 in relation to their pathogenicity and immunogenicity are highlighted and various treatment strategies that could be employed for curing COVID-19 are focused on.
Journal ArticleDOI
Molecular and Immunological Diagnostic Tests of COVID-19: Current Status and Challenges.
TL;DR: This review focuses on a broad description of currently available diagnostic tests to detect either the virus (SARS-CoV-2) or virus-induced immune responses and lays out the shortcomings of certain tests and future needs.
Journal ArticleDOI
The interplay between inflammatory pathways and COVID-19: A critical review on pathogenesis and therapeutic options.
TL;DR: The detailed mechanism of occurrence of SARS-CoV-2 induced inflammatory storm and its connection with the pre-existing inflammatory conditions and possible treatment options to cope with the severe clinical manifestations of COVID-19 are provided.
Journal ArticleDOI
Recent advances in CO2 hydrogenation to value-added products — Current challenges and future directions
Samrand Saeidi,Sara Najari,Volker Hessel,Karen Wilson,Frerich J. Keil,Patricia Concepción,Steven L. Suib,Alírio E. Rodrigues +7 more
TL;DR: In this article, a corrugated-wall dual-type membrane reactor is proposed as an emerging alternative for CO2 hydrogenation to value-added products, with key pathways that dictate catalyst activity and selectivity of the most promising materials described.
Journal ArticleDOI
Van der Waals heterojunction for selective visible-light-driven photocatalytic CO2 reduction
Jun Li,Baojing Huang,Qiang Guo,Sheng Guo,Zhikun Peng,Jin Liu,Qingyong Tian,Yongpeng Yang,Qun Xu,Zhongyi Liu,Bin Liu +10 more
TL;DR: In this article, a two-dimensional/two-dimensional (2D/2D) Van der Waals (VDW) heterojunction was proposed for CO2 photoreduction.
References
More filters
Proceedings Article
ImageNet Classification with Deep Convolutional Neural Networks
TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings Article
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
TL;DR: Deep Compression as mentioned in this paper proposes a three-stage pipeline: pruning, quantization, and Huffman coding to reduce the storage requirement of neural networks by 35x to 49x without affecting their accuracy.
Journal ArticleDOI
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Mirko Prezioso,Farnood Merrikh-Bayat,Brian D. Hoskins,Gina C. Adam,Konstantin K. Likharev,Dmitri B. Strukov +5 more
TL;DR: The experimental implementation of transistor-free metal-oxide memristor crossbars, with device variability sufficiently low to allow operation of integrated neural networks, in a simple network: a single-layer perceptron (an algorithm for linear classification).
Posted Content
Energy and Policy Considerations for Deep Learning in NLP
TL;DR: This paper quantifies the approximate financial and environmental costs of training a variety of recently successful neural network models for NLP and proposes actionable recommendations to reduce costs and improve equity in NLP research and practice.
Proceedings ArticleDOI
Energy and Policy Considerations for Deep Learning in NLP
TL;DR: In this article, the authors quantified the approximate financial and environmental costs of training a variety of recently successful neural network models for NLP and proposed actionable recommendations to reduce costs and improve equity in NLP research and practice.
Related Papers (5)
Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China
Chaolin Huang,Yeming Wang,Xingwang Li,Lili Ren,Jianping Zhao,Yi Hu,Li Zhang,Guohui Fan,Jiuyang Xu,Xiaoying Gu,Zhenshun Cheng,Ting Yu,Jia'an Xia,Yuan Wei,Wenjuan Wu,Xuelei Xie,Wen Yin,Li Hui,Min Liu,Yan Xiao,Hong Gao,Li Guo,Jungang Xie,Guang-Fa Wang,Rongmeng Jiang,Zhancheng Gao,Qi Jin,Jianwei Wang,Bin Cao +28 more
Clinical Characteristics of Coronavirus Disease 2019 in China.
Wei-jie Guan,Zhengyi Ni,Yu Hu,Wenhua Liang,Chun-Quan Ou,Jianxing He,Lei Liu,Hong Shan,Chunliang Lei,David S.C. Hui,Bin Du,Lanjuan Li,Guang Zeng,Kowk-Yung Yuen,Ruchong Chen,Chun-Li Tang,Tao Wang,Ping-Yan Chen,Jie Xiang,Shiyue Li,Jinlin Wang,Zi-jing Liang,Yi-xiang Peng,Li Wei,Yong Liu,Ya-hua Hu,Peng Peng,Jian-ming Wang,Ji-yang Liu,Zhong Chen,Gang Li,Zhi-jian Zheng,Shao-qin Qiu,Jie Luo,Chang-jiang Ye,Shao-yong Zhu,Nanshan Zhong +36 more