Wanyue Li

Bio: Wanyue Li is an academic researcher from Chinese Academy of Sciences. The author has contributed to research in topics: Image quality & Adaptive optics. The author has an hindex of 4, co-authored 17 publications receiving 53 citations. Previous affiliations of Wanyue Li include University of Science and Technology of China.

Deep learning for quality assessment of retinal OCT images.

Abstract: Optical coherence tomography (OCT) is a promising high-speed, non-invasive imaging modality providing high-resolution retinal scans. However, a variety of external factors such as light occlusion and patient movement can seriously degrade OCT image quality, which complicates manual retinopathy detection and computer-aided diagnosis. As such, this study first presents an OCT image quality assessment (OCT-IQA) system, capable of automatic classification based on signal completeness, location, and effectiveness. Four CNN architectures (VGG-16, Inception-V3, ResNet-18, and ResNet-50) from the ImageNet classification task were used to train the proposed OCT-IQA system via transfer learning. The ResNet-50 with the best performance was then integrated into the final OCT-IQA network. The usefulness of this approach was evaluated using retinopathy detection results. A retinopathy classification network was first trained by fine-tuning Inception-V3 model. The model was then applied to two test datasets, created randomly from the original dataset, one of which was screened by the OCT-IQA system and only included high quality images while the other was mixed by high and low quality images. Results showed that retinopathy detection accuracy and area under curve (AUC) were 3.75% and 1.56% higher, respectively, for the filtered data (compared with the unfiltered data). These experimental results demonstrate the effectiveness of the proposed OCT-IQA system and suggest that deep learning could be applied to the design of computer-aided systems (CADSs) for automatic retinopathy detection.

Quality improvement of adaptive optics retinal images using conditional adversarial networks

Abstract: The adaptive optics (AO) technique is widely used to compensate for ocular aberrations and improve imaging resolution. However, when affected by intraocular scatter, speckle noise, and other factors, the quality of the retinal image will be degraded. To effectively improve the image quality without increasing the imaging system's complexity, the post-processing method of image deblurring is adopted. In this study, we proposed a conditional adversarial network-based method for directly learning an end-to-end mapping between blurry and restored AO retinal images. The proposed model was validated on synthetically generated AO retinal images and real retinal images. The restoration results of synthetic images were evaluated with the metrics of peak signal-to-noise ratio (PSNR), structural similarity (SSIM), perceptual distance, and error rate of cone counting. Moreover, the blind image quality index (BIQI) was used as the no-reference image quality assessment (NR-IQA) algorithm to evaluate the restoration results on real AO retinal images. The experimental results indicate that the images restored by the proposed method have sharper quality and higher signal-to-noise ratio (SNR) when compared with other state-of-the-art methods, which has great practical significance for clinical research and analysis.

Weakly supervised anomaly segmentation in retinal OCT images using an adversarial learning approach

Abstract: Lesion detection is a critical component of disease diagnosis, but the manual segmentation of lesions in medical images is time-consuming and experience-demanding. These issues have recently been addressed through deep learning models. However, most of the existing algorithms were developed using supervised training, which requires time-intensive manual labeling and prevents the model from detecting unaware lesions. As such, this study proposes a weakly supervised learning network based on CycleGAN for lesions segmentation in full-width optical coherence tomography (OCT) images. The model was trained to reconstruct underlying normal anatomic structures from abnormal input images, then the lesions can be detected by calculating the difference between the input and output images. A customized network architecture and a multi-scale similarity perceptual reconstruction loss were used to extend the CycleGAN model to transfer between objects exhibiting shape deformations. The proposed technique was validated using an open-source retinal OCT image dataset. Image-level anomaly detection and pixel-level lesion detection results were assessed using area-under-curve (AUC) and the Dice similarity coefficient, producing results of 96.94% and 0.8239, respectively, higher than all comparative methods. The average test time required to generate a single full-width image was 0.039 s, which is shorter than that reported in recent studies. These results indicate that our model can accurately detect and segment retinopathy lesions in real-time, without the need for supervised labeling. And we hope this method will be helpful to accelerate the clinical diagnosis process and reduce the misdiagnosis rate.

Automated Cone Photoreceptor Cell Segmentation and Identification in Adaptive Optics Scanning Laser Ophthalmoscope Images Using Morphological Processing and Watershed Algorithm

Abstract: Geometrical analysis of cone photoreceptor cells is important not only for ophthalmic diagnosis, but also for research on eye diseases. In this study, an automated cone photoreceptor cell segmentation and identification method based on morphological processing and watershed algorithm is presented for adaptive optics scanning laser ophthalmoscope images. Our method includes steps for image denoising, rough segmentation, fine segmentation, small region removal, and identification. The effectiveness of the proposed method was confirmed by comparing its results with those obtained manually yielding precision, recall, and F1-score values of 93.6%, 98.0% and 95.8%, respectively. The performance of our method is further verified by processing images with different cone photoreceptor cell densities from healthy retina and an image from an eye with diabetic retinopathy. The experimental results show that our algorithm achieved high accuracy in cone photoreceptor cell segmentation and identification in healthy retinas as well as in retina with diabetic retinopathy.

Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks

Abstract: Fluorescein angiography can provide a map of retinal vascular structure and function, which is commonly used in ophthalmology diagnosis, however, this imaging modality may pose risks of harm to the patients. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted. In this work, we proposed a conditional generative adversarial network(GAN) - based method to directly learn the mapping relationship between structure fundus images and fundus fluorescence angiography images. Moreover, local saliency maps, which define each pixel's importance, are used to define a novel saliency loss in the GAN cost function. This facilitates more accurate learning of small-vessel and fluorescein leakage features.

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

Abstract: Purpose: To assess whether a generative adversarial network (GAN) could synthesize realistic optical coherence tomography (OCT) images that satisfactorily serve as the educational images for retinal specialists, and the training datasets for the classification of various retinal disorders using deep learning (DL). Methods: The GANs architecture was adopted to synthesize high-resolution OCT images trained on a publicly available OCT dataset, including urgent referrals (37,206 OCT images from eyes with choroidal neovascularization, and 11,349 OCT images from eyes with diabetic macular edema) and nonurgent referrals (8617 OCT images from eyes with drusen, and 51,140 OCT images from normal eyes). Four hundred real and synthetic OCT images were evaluated by two retinal specialists (with over 10 years of clinical retinal experience) to assess image quality. We further trained two DL models on either real or synthetic datasets and compared the performance of urgent versus nonurgent referrals diagnosis tested on a local (1000 images from the public dataset) and clinical validation dataset (278 images from Shanghai Shibei Hospital). Results: The image quality of real versus synthetic OCT images was similar as assessed by two retinal specialists. The accuracy of discrimination of real versus synthetic OCT images was 59.50% for retinal specialist 1 and 53.67% for retinal specialist 2. For the local dataset, the DL model trained on real (DL_Model_R) and synthetic OCT images (DL_Model_S) had an area under the curve (AUC) of 0.99, and 0.98, respectively. For the clinical dataset, the AUC was 0.94 for DL_Model_R and 0.90 for DL_Model_S. Conclusions: The GAN synthetic OCT images can be used by clinicians for educational purposes and for developing DL algorithms. Translational Relevance: The medical image synthesis based on GANs is promising in humans and machines to fulfill clinical tasks.

A review of low-cost and portable optical coherence tomography

Abstract: Optical coherence tomography (OCT) is a powerful optical imaging technique capable of visualizing the internal structure of biological tissues at near cellular resolution. For years, OCT has been regarded as the standard of care in ophthalmology, acting as an invaluable tool for the assessment of retinal pathology. However, the costly nature of most current commercial OCT systems has limited its general accessibility, especially in low-resource environments. It is therefore timely to review the development of low-cost OCT systems as a route for applying this technology to population-scale disease screening. Low-cost, portable and easy to use OCT systems will be essential to facilitate widespread use at point of care settings while ensuring that they offer the necessary imaging performances needed for clinical detection of retinal pathology. The development of low-cost OCT also offers the potential to enable application in fields outside ophthalmology by lowering the barrier to entry. In this paper, we review the current development and applications of low-cost, portable and handheld OCT in both translational and research settings. Design and cost-reduction techniques are described for general low-cost OCT systems, including considerations regarding spectrometer-based detection, scanning optics, system control, signal processing, and the role of 3D printing technology. Lastly, a review of clinical applications enabled by low-cost OCT is presented, along with a detailed discussion of current limitations and outlook.