Open AccessProceedings Article
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Balaji Lakshminarayanan,Alexander Pritzel,Charles Blundell +2 more
- Vol. 30, pp 6402-6413
Reads0
Chats0
TLDR
The authors proposed an alternative to Bayesian NNs that is simple to implement, readily parallelizable, requires very little hyperparameter tuning, and yields high quality predictive uncertainty estimates, which are as good or better than approximate Bayesian nNs.Abstract:
Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs, which learn a distribution over weights, are currently the state-of-the-art for estimating predictive uncertainty; however these require significant modifications to the training procedure and are computationally expensive compared to standard (non-Bayesian) NNs. We propose an alternative to Bayesian NNs that is simple to implement, readily parallelizable, requires very little hyperparameter tuning, and yields high quality predictive uncertainty estimates. Through a series of experiments on classification and regression benchmarks, we demonstrate that our method produces well-calibrated uncertainty estimates which are as good or better than approximate Bayesian NNs. To assess robustness to dataset shift, we evaluate the predictive uncertainty on test examples from known and unknown distributions, and show that our method is able to express higher uncertainty on out-of-distribution examples. We demonstrate the scalability of our method by evaluating predictive uncertainty estimates on ImageNet.read more
Citations
More filters
Journal ArticleDOI
Clinically applicable deep learning for diagnosis and referral in retinal disease
Jeffrey De Fauw,Joseph R. Ledsam,Bernardino Romera-Paredes,Stanislav Nikolov,Nenad Tomasev,Sam Blackwell,Harry Askham,Xavier Glorot,Brendan O'Donoghue,Daniel Visentin,George van den Driessche,Balaji Lakshminarayanan,Clemens Meyer,Faith Mackinder,Simon Bouton,Kareem Ayoub,Reena Chopra,Dominic King,Alan Karthikesalingam,Cian Hughes,Rosalind Raine,Julian Hughes,Dawn A Sim,Catherine A Egan,Adnan Tufail,Hugh Montgomery,Demis Hassabis,Geraint Rees,Trevor Back,Peng T. Khaw,Mustafa Suleyman,Julien Cornebise,Pearse A. Keane,Olaf Ronneberger +33 more
TL;DR: A novel deep learning architecture performs device-independent tissue segmentation of clinical 3D retinal images followed by separate diagnostic classification that meets or exceeds human expert clinical diagnoses of retinal disease.
Posted Content
MixMatch: A Holistic Approach to Semi-Supervised Learning
TL;DR: MixMatch as discussed by the authors predicts low-entropy labels for unlabeled examples and combines them with labeled and unlabelled data using MixUp to obtain state-of-the-art results.
Journal ArticleDOI
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
Moloud Abdar,Farhad Pourpanah,Sadiq Hussain,Dana Rezazadegan,Li Liu,Mohammad Ghavamzadeh,Paul Fieguth,Xiaochun Cao,Abbas Khosravi,U. Rajendra Acharya,U. Rajendra Acharya,U. Rajendra Acharya,Vladimir Makarenkov,Saeid Nahavandi +13 more
TL;DR: This study reviews recent advances in UQ methods used in deep learning and investigates the application of these methods in reinforcement learning (RL), and outlines a few important applications of UZ methods.
Posted Content
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
Yaniv Ovadia,Emily Fertig,Jie Ren,Zachary Nado,D. Sculley,Sebastian Nowozin,Joshua V. Dillon,Balaji Lakshminarayanan,Jasper Snoek +8 more
TL;DR: A large-scale benchmark of existing state-of-the-art methods on classification problems and the effect of dataset shift on accuracy and calibration is presented, finding that traditional post-hoc calibration does indeed fall short, as do several other previous methods.
Journal ArticleDOI
Content-aware image restoration: pushing the limits of fluorescence microscopy.
Martin Weigert,Uwe Schmidt,Tobias Boothe,Andreas Müller,Alexandr Dibrov,Akanksha Jain,Benjamin Wilhelm,Deborah Schmidt,Coleman Broaddus,Siân Culley,Siân Culley,Mauricio Rocha-Martins,Fabián Segovia-Miranda,Caren Norden,Ricardo Henriques,Ricardo Henriques,Marino Zerial,Michele Solimena,Jochen C. Rink,Pavel Tomancak,Loic Royer,Florian Jug,Eugene W. Myers,Eugene W. Myers +23 more
TL;DR: This work shows how content-aware image restoration based on deep learning extends the range of biological phenomena observable by microscopy by bypassing the trade-offs between imaging speed, resolution, and maximal light exposure that limit fluorescence imaging to enable discovery.