Open AccessProceedings Article
RETAIN: An interpretable predictive model for healthcare using reverse time attention mechanism
Edward Choi,Mohammad Taha Bahadori,Jimeng Sun,Joshua Kulas,Andy Schuetz,Walter F. Stewart +5 more
- Vol. 29, pp 3504-3512
Reads0
Chats0
TLDR
In this paper, a two-level neural attention model is proposed to detect influential past visits and significant clinical variables within those visits (e.g. key diagnoses) in reverse time order so that recent clinical visits are likely to receive higher attention.Abstract:
Accuracy and interpretability are two dominant features of successful predictive models. Typically, a choice must be made in favor of complex black box models such as recurrent neural networks (RNN) for accuracy versus less accurate but more interpretable traditional models such as logistic regression. This tradeoff poses challenges in medicine where both accuracy and interpretability are important. We addressed this challenge by developing the REverse Time AttentIoN model (RETAIN) for application to Electronic Health Records (EHR) data. RETAIN achieves high accuracy while remaining clinically interpretable and is based on a two-level neural attention model that detects influential past visits and significant clinical variables within those visits (e.g. key diagnoses). RETAIN mimics physician practice by attending the EHR data in a reverse time order so that recent clinical visits are likely to receive higher attention. RETAIN was tested on a large health system EHR dataset with 14 million visits completed by 263K patients over an 8 year period and demonstrated predictive accuracy and computational scalability comparable to state-of-the-art methods such as RNN, and ease of interpretability comparable to traditional models.read more
Citations
More filters
Proceedings ArticleDOI
Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks
TL;DR: Dipole as discussed by the authors employs bidirectional recurrent neural networks to remember all the information of both the past visits and the future visits, and introduces three attention mechanisms to measure the relationships of different visits for the prediction.
Journal ArticleDOI
Bias in data-driven artificial intelligence systems—An introductory survey
Eirini Ntoutsi,Pavlos Fafalios,Ujwal Gadiraju,Vasileios Iosifidis,Wolfgang Nejdl,Maria-Esther Vidal,Salvatore Ruggieri,Franco Turini,Symeon Papadopoulos,Emmanouil Krasanakis,Ioannis Kompatsiaris,Katharina Kinder-Kurlanda,Claudia Wagner,Fariba Karimi,Miriam Fernandez,Harith Alani,Bettina Berendt,Bettina Berendt,Tina Kruegel,Christian Heinze,Klaus Broelemann,Gjergji Kasneci,Thanassis Tiropanis,Steffen Staab,Steffen Staab,Steffen Staab +25 more
TL;DR: A broad multidisciplinary overview of the area of bias in AI systems is provided, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame.
Posted Content
GRAM: Graph-based Attention Model for Healthcare Representation Learning
TL;DR: Compared to the basic RNN, GRAM achieved 10% higher accuracy for predicting diseases rarely observed in the training data and 3% improved area under the ROC curve for predicting heart failure using an order of magnitude less training data.
Posted Content
Reinforcement Learning in Healthcare: A Survey
Chao Yu,Jiming Liu,Shamim Nemati +2 more
TL;DR: This survey provides an extensive overview of RL applications in a variety of healthcare domains, ranging from dynamic treatment regimes in chronic diseases and critical care, automated medical diagnosis, and many other control or scheduling problems that have infiltrated every aspect of the healthcare system.
Journal ArticleDOI
Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond
Pazilova Nasibaxon Muhammadqosimovna, Rasulov Fayzulla,Guang Yang,Mirzayev G'iyosbek Isroil o'g'li,Qinghao Ye,Jun Xia +4 more
TL;DR: This study surveyed the current progress of XAI and in particular its advances in healthcare applications, and introduced the solutions for XAI leveraging multi-modal and multi-centre data fusion, and subsequently validated in two showcases following real clinical scenarios.