Transfer learning for non-image data in clinical research: a scoping review
Andreas Ebbehoj,Andreas Ebbehoj,Mette Østergaard Thunbo,Ole Emil Andersen,Michala Vilstrup Glindtvad,Adam Hulman +5 more
Reads0
Chats0
TLDR
Transfer learning is a form of machine learning where a pre-trained model trained on a specific task is reused as a starting point and tailored to another task in a different dataset.Abstract:
Background Transfer learning is a form of machine learning where a pre-trained model trained on a specific task is reused as a starting point and tailored to another task in a different dataset. While transfer learning has garnered considerable attention in medical image analysis, its use for clinical non-image data is not well studied. Therefore, the objective of this scoping review was to explore the use of transfer learning for non-image data in the clinical literature. Methods and Findings We systematically searched medical databases (PubMed, EMBASE, CINAHL) for peer-reviewed clinical studies that used transfer learning on human non-image data. We included 83 studies in the review. More than half of the studies (63%) were published within 12 months of the search. Transfer learning was most often applied to time series data (61%), followed by tabular data (18%), audio (12%) and text (8%). Thirty-three (40%) studies applied an image-based model to non-image data after transforming data into images (e.g. spectrograms). Twenty-nine (35%) studies did not have any authors with a health-related affiliation. Many studies used publicly available datasets (66%) and models (49%), but fewer shared their code (27%). Conclusions In this scoping review, we have described current trends in the use of transfer learning for non-image data in the clinical literature. We found that the use of transfer learning has grown rapidly within the last few years. We have identified studies and demonstrated the potential of transfer learning in clinical research in a wide range of medical specialties. More interdisciplinary collaborations and the wider adaption of reproducible research principles are needed to increase the impact of transfer learning in clinical research.read more
Citations
More filters
Journal ArticleDOI
A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications
Laith Alzubaidi,Jinshuai Bai,Aiman Abdul Razzak Al-Sabaawi,José Santamaría,Ahmed Shihab Albahri,Bashar S. Al-Dabbagh,Mohammed A. Fadhel,Mohamed Manoufali,Ali H. Al-Timemy,Ye Duan,Laith Farhan,Yi Lu,Ashish Gupta,Yuantong Gu +13 more
TL;DR: In this article , the authors present a survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization.
Journal ArticleDOI
Automating the overburdened clinical coding system: challenges and next steps
TL;DR: Artificial intelligence and natural language processing (NLP) have found a highly promising application in automated clinical coding (ACC), an innovation that will have profound impacts on the clinical coding industry, billing and revenue management, and potentially clinical care itself as mentioned in this paper .
Journal ArticleDOI
Bottom-up and top-down paradigms of artificial intelligence research approaches to healthcare data science using growing real-world big data
TL;DR: In this article , the authors describe the diverse and growing AI research approaches in healthcare data science and categorize them into two distinct paradigms, the bottom-up and top-down paradigm, to provide health scientists venturing into artificial intelligent research with an understanding of the evolving computational methods and help in deciding on methods to pursue.
Journal ArticleDOI
Deep Transfer Learning Enables Robust Prediction of Antimicrobial Resistance for Novel Antibiotics
Yunxiao Ren,D. Chakraborty,Swapnil Doijad,Linda Falgenhauer,Jane Falgenhauer,Alexander Goesmann,Oliver Schwengers,Dominik Heider +7 more
TL;DR: In this paper , a deep transfer learning model was proposed to improve model performance for AMR prediction on small, imbalanced datasets, which is also applicable to novel antibiotics and emerging resistances in the future.
Journal ArticleDOI
Neurosurgery inpatient outcome prediction for discharge planning with deep learning and transfer learning.
TL;DR: In this article , the authors used transfer learning and an artificial neural network to predict inpatient neurosurgery outcomes from free-text medical data, including the timing of discharge and discharge destination.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
Proceedings ArticleDOI
ImageNet: A large-scale hierarchical image database
TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Proceedings ArticleDOI
Going deeper with convolutions
Christian Szegedy,Wei Liu,Yangqing Jia,Pierre Sermanet,Scott Reed,Dragomir Anguelov,Dumitru Erhan,Vincent Vanhoucke,Andrew Rabinovich +8 more
TL;DR: Inception as mentioned in this paper is a deep convolutional neural network architecture that achieves the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC14).
Journal ArticleDOI
ImageNet classification with deep convolutional neural networks
TL;DR: A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective.
Related Papers (5)
Systematic literature review of machine learning methods used in the analysis of real-world data for patient-provider decision making
Alan Brnabic,Lisa M. Hess +1 more