Showing papers in "arXiv: Medical Physics in 2018"

High-fidelity multimode fibre-based endoscopy for deep-brain in vivo imaging

Abstract: Progress in neuroscience constantly relies on the development of new techniques to investigate the complex dynamics of neuronal networks. An ongoing challenge is to achieve minimally-invasive and high-resolution observations of neuronal activity in vivo inside deep brain areas. A perspective strategy is to utilise holographic control of light propagation in complex media, which allows converting a hair-thin multimode optical fibre into an ultra-narrow imaging tool. Compared to current endoscopes based on GRIN lenses or fibre bundles, this concept offers a footprint reduction exceeding an order of magnitude, together with a significant enhancement in resolution. We designed a compact and high-speed system for fluorescent imaging at the tip of a fibre, achieving micron-scale resolution across a 50 um field of view, and yielding 7-kilopixel images at a rate of 3.5 frames/s. Furthermore, we demonstrate in vivo observations of cell bodies and processes of inhibitory neurons within deep layers of the visual cortex and hippocampus of anesthetised mice. This study forms the basis for several perspective techniques of modern microscopy to be delivered deep inside the tissue of living animal models while causing minimal impact on its structural and functional properties.

Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy

Abstract: To enable magnetic resonance (MR)-only radiotherapy and facilitate modelling of radiation attenuation in humans, synthetic-CT (sCT) images need to be generated. Considering the application of MR-guided radiotherapy and online adaptive replanning, sCT generation should occur within minutes. This work aims at assessing whether an existing deep learning network can rapidly generate sCT images to be used for accurate MR-based dose calculations in the entire pelvis. A study was conducted on data of 91 patients with prostate, rectal and cervical cancer who underwent external beam radiotherapy acquiring both CT and MRI for patients' simulation. Dixon reconstructed water, fat and in-phase images obtained from a conventional dual gradient-recalled echo sequence were used to generate sCT images. A conditional generative adversarial network (cGAN) was trained in a paired fashion on 2D transverse slices of 32 prostate cancer patients. The trained network was tested on the remaining patients to generate sCT images. For 30 patients in the test set, dose recalculations of the clinical plan were performed on sCT images. Dose distributions were evaluated comparing voxel-based dose differences, gamma and dose-volume histogram (DVH) analysis. The sCT generation required 5.6 s and 21 s for a single patient volume on a GPU and CPU, respectively. On average, sCT images resulted in a higher dose to the target of maximum 0.3%. Results suggest that accurate MR-based dose calculation using sCT images generated with a cGAN trained on prostate cancer patients is feasible for the entire pelvis. The sCT generation was sufficiently fast to be integrated into an MR-guided radiotherapy workflow.

Human-sized Magnetic Particle Imaging for Brain Applications

Abstract: Determining the brain perfusion is an important task for the diagnosis and treatment of vascular diseases such as occlusions and intracerebral haemorrhage. Even after successful diagnosis and treatment, there is a high risk of restenosis or rebleeding such that patients need intense and frequent attention in the days after treatment. Within this work, we will present a diagnostic tomographic imager that allows access to brain perfusion information quantitatively in short intervals. The imager is the first functional magnetic particle imaging device for brain imaging on a human-scale. It is highly sensitive and allows the detection of an iron concentration of 14.7 ng /ml (263 pmol\ml), which is the lowest iron concentration imaged by MPI so far. The imager is self-shielded and can be used in unshielded environments such as intensive care units. In combination with the low technical requirements this opens up a whole variety of possible medical applications and would allow monitoring possibilities on the stroke and intensive care units.

Three-Dimensional Radiotherapy Dose Prediction on Head and Neck Cancer Patients with a Hierarchically Densely Connected U-net Deep Learning Architecture.

Abstract: The treatment planning process for patients with head and neck (H&N) cancer is regarded as one of the most complicated due to large target volume, multiple prescription dose levels, and many radiation-sensitive critical structures near the target. Treatment planning for this site requires a high level of human expertise and a tremendous amount of effort to produce personalized high quality plans, taking as long as a week, which deteriorates the chances of tumor control and patient survival. To solve this problem, we propose to investigate a deep learning-based dose prediction model, Hierarchically Densely Connected U-net, based on two highly popular network architectures: U-net and DenseNet. We find that this new architecture is able to accurately and efficiently predict the dose distribution, outperforming the other two models, the Standard U-net and DenseNet, in homogeneity, dose conformity, and dose coverage on the test data. Averaging across all organs at risk, our proposed model is capable of predicting the organ-at-risk max dose within 6.3% and mean dose within 5.1% of the prescription dose on the test data. The other models, the Standard U-net and DenseNet, performed worse, having an averaged organ-at-risk max dose prediction error of 8.2% and 9.3%, respectively, and averaged mean dose prediction error of 6.4% and 6.8%, respectively. In addition, our proposed model used 12 times less trainable parameters than the Standard U-net, and predicted the patient dose 4 times faster than DenseNet.

Generating Synthesized Computed Tomography (CT) from Cone-Beam Computed Tomography (CBCT) using CycleGAN for Adaptive Radiation Therapy

Abstract: Cone beam computed tomography (CBCT) images can be used for dose calculation in adaptive radiation therapy (ART). The main challenges are the large artefacts and inaccurate Hounsfield unit (HU) values. Currently, deformed planning CT images are often used for this purpose, although anatomical accuracy might be a concern. Ideally, we would like to convert CBCT images to CT images with artifacts removed or greatly reduced and HU values corrected while keeping the anatomical accuracy. Recently, deep learning has achieved great success in image-to-image translation tasks. It is very difficult to acquire paired CT and CBCT images with exactly matching anatomy for supervised training. To overcome this limitation, we developed and tested a cycle generative adversarial network (CycleGAN) which is an unsupervised learning method and does not require paired training datasets to synthesize CT images from CBCT images. The synthesized CT (sCT) images have been compared with the deformed planning CT (dpCT) showing visual and quantitative similarity with artifacts being removed and HU value errors being reduced from 71.78 HU to 27.98 HU. Dose calculation accuracy using sCT images has been improved over the original CBCT images, with the average Gamma Index passing rate increased from 95.4% to 97.4% for 1 mm/1% criteria. A deformable phantom study has been conducted and demonstrated better anatomical accuracy for sCT over dpCT.

Intelligent Inverse Treatment Planning via Deep Reinforcement Learning, a Proof-of-Principle Study in High Dose-rate Brachytherapy for Cervical Cancer

Abstract: Inverse treatment planning in radiation therapy is formulated as optimization problems. The objective function and constraints consist of multiple terms designed for different clinical and practical considerations. Weighting factors of these terms are needed to define the optimization problem. While a treatment planning system can solve the optimization problem with given weights, adjusting the weights for high plan quality is performed by human. The weight tuning task is labor intensive, time consuming, and it critically affects the final plan quality. An automatic weight-tuning approach is strongly desired. The weight tuning procedure is essentially a decision making problem. Motivated by the tremendous success in deep learning for decision making with human-level intelligence, we propose a novel framework to tune the weights in a human-like manner. Using treatment planning in high-dose-rate brachytherapy as an example, we develop a weight tuning policy network (WTPN) that observes dose volume histograms of a plan and outputs an action to adjust organ weights, similar to the behaviors of a human planner. We train the WTPN via end-to-end deep reinforcement learning. Experience replay is performed with the epsilon greedy algorithm. Then we apply the trained WTPN to guide treatment planning of testing patient cases. The trained WTPN successfully learns the treatment planning goals to guide the weight tuning process. On average, the quality score of plans generated under the WTPN's guidance is improved by ~8.5% compared to the initial plan with arbitrary weights, and by 10.7% compared to the plans generated by human planners. To our knowledge, this is the first tool to adjust weights for the treatment planning in a human-like fashion based on learnt intelligence. The study demonstrates potential feasibility to develop intelligent treatment planning system via deep reinforcement learning.

Cryogen-Free dissolution Dynamic Nuclear Polarization polarizer operating at 3.35 T, 6.70 T and 10.1 T

Abstract: Purpose: A novel dissolution dynamic nuclear polarization (dDNP) polarizer platform is presented. The polarizer meets a number of key requirements for in vitro, pre-clinical and clinical applications. Method: It uses no liquid cryogens, operates in continuous mode, accommodates a wide range of sample sizes up to and including those required for human studies, and is fully automated. Results: It offers a wide operational window both in terms of magnetic field, up to 10.1 T, and temperature, from room temperature down to 1.3 K. The polarizer delivers a 13C liquid state polarization for [1-13C]pyruvate of 70%. The build-up time constant in the solid state is approx. 1200 s (20 min), allowing a sample throughput of at least one sample per hour including sample loading and dissolution. Conclusion: We confirm the previously reported strong field dependence in the range 3.35 to 6.7 T, but see no further increase in polarization when increasing the magnetic field strength to 10.1 T for [1-13C]pyruvate and trityl. Using a custom dry magnet, cold head and recondensing, closed-cycle cooling system, combined with a modular DNP probe, automation and fluid handling systems; we have designed a unique dDNP system with unrivalled flexibility and performance.

Searching for the neurite density with diffusion MRI: challenges for biophysical modeling

Abstract: In vivo mapping of the neurite density with diffusion MRI (dMRI) is a high but challenging aim. First, it is unknown whether all neurites exhibit completely anisotropic ('stick-like') diffusion. Second, the 'density' of tissue components may be confounded by non-diffusion properties such as T2 relaxation. Third, the domain of validity for the estimated parameters to serve as indices of neurite density is incompletely explored. We investigated these challenges by acquiring data with 'b-tensor encoding' and multiple echo times in both healthy brain and white matter lesions. Results showed that microscopic anisotropy from b-tensor data is associated with myelinated axons but not with dendrites. Furthermore, b-tensor and multi-echo data showed that unbiased density estimates in white matter lesions require data-driven estimates of compartment-specific T2 times. Finally, the 'stick' fractions of different biophysical models could generally not serve as neurite density indices across the healthy brain and white matter lesions, where outcomes of comparisons depended on the choice of constraints. In particular, constraining compartment-specific T2 times was ambiguous in the healthy brain and had a large impact on estimated values. In summary, estimating neurite density may require accounting for different diffusion and/or T2 properties between axons and dendrites. Constrained 'index' parameters could be valid within limited domains that should be delineated by future studies.

Combined Diffusion-Relaxometry MRI to Identify Dysfunction in the Human Placenta

Abstract: Purpose: A combined diffusion-relaxometry MR acquisition and analysis pipeline for in-vivo human placenta, which allows for exploration of coupling between T2* and apparent diffusion coefficient (ADC) measurements in a sub 10 minute scan time. Methods: We present a novel acquisition combining a diffusion prepared spin-echo with subsequent gradient echoes. The placentas of 17 pregnant women were scanned in-vivo, including both healthy controls and participants with various pregnancy complications. We estimate the joint T2*-ADC spectra using an inverse Laplace transform. Results: T2*-ADC spectra demonstrate clear quantitative separation between normal and dysfunctional placentas. Conclusions: Combined T2*-diffusivity MRI is promising for assessing fetal and maternal health during pregnancy. The T2*-ADC spectrum potentially provides additional information on tissue microstructure, compared to measuring these two contrasts separately. The presented method is immediately applicable to the study of other organs.

Male pelvic synthetic CT generation from T1-weighted MRI using 2D and 3D convolutional neural networks

Abstract: To achieve magnetic resonance (MR)-only radiotherapy, a method needs to be employed to estimate a synthetic CT (sCT) for generating electron density maps and patient positioning reference images. We investigated 2D and 3D convolutional neural network (CNN) methods to generate a male pelvic sCT using a T1-weighted MR image. A retrospective study was performed using CTs and T1-weighted MR images of 20 prostate cancer patients. The proposed 2D CNN model, which contained 27 convolutional layers, was modified from the SegNet for better performance. 3D version of the CNN model was also developed. Both CNN models were trained from scratch to map intensities of T1-weighted MR images to CT Hounsfield Unit (HU) values. Each sCT was generated in a five-fold-cross-validation framework and compared with the corresponding CT using voxel-wise mean absolute error (MAE), and dice similarity coefficient (DSC), recall, and precision for bony structures. Wilcoxon signed-rank tests were performed to evaluate the differences between the both models. The MAE averaged across all patients were 40.5 $\pm$ 5.4 HU and 37.6 $\pm$ 5.1 HU for the 2D and 3D CNN models, respectively. The DSC, recall, and precision of the bony structures were 0.81 $\pm$ 0.04, 0.85 $\pm$ 0.04, and 0.77 $\pm$ 0.09 for the 2D CNN model, and 0.82 $\pm$ 0.04, 0.84 $\pm$ 0.04, and 0.80 $\pm$ 0.08 for the 3D CNN model, respectively. P values of the Wilcoxon signed-rank tests were less than 0.05 except for recall, which was 0.6. The 2D and 3D CNN models generated accurate pelvic sCTs for the 20 patients using T1-weighted MR images. The evaluation metrics and statistical tests indicated that the 3D model was able to generate sCTs with better MAE, bone DSC, and bone precision. The accuracy of the dose calculation and patient positioning using generated sCTs will be tested and compared for the two models in the future.

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

Abstract: Inter-and intra-observer variation in delineating regions of interest (ROIs) occurs because of differences in expertise level and preferences of the radiation oncologists. We evaluated the accuracy of a segmentation model using the U-Net structure to delineate the prostate, bladder, and rectum in male pelvic CT images. The dataset used for training and testing the model consisted of raw CT scan images of 85 prostate cancer patients. We designed a 2D U-Net model to directly learn a mapping function that converts a 2D CT grayscale image to its corresponding 2D OAR segmented image. Our network contains blocks of convolution 2D layers with variable kernel sizes, channel number, and activation functions. On the left side of the U-Net model, we used three 3x3 convolutions, each followed by a rectified linear unit (ReLu) (activation function), and one max pooling operation. On the right side of the U-Net model, we used a 2x2 transposed convolution and two 3x3 convolution networks followed by a ReLu activation function. The automatic segmentation using the U-Net generated an average dice similarity coefficient (DC) and standard deviation (SD) of the following: DC +- SD (0.88 +- 0.12), (0.95 +- 0.04), and (0.92 +- 0.06) for the prostate, bladder, and rectum, respectively. Furthermore, the mean of average surface Hausdorff distance (ASHD) and SD were 1.2 +- 0.9 mm, 1.08 +- 0.8 mm, and 0.8 +- 0.6 mm for the prostate, bladder, and rectum, respectively. Our proposed method, which employs the U-Net structure, is highly accurate and reproducible for automated ROI segmentation. This provides a foundation to improve automatic delineation of the boundaries between the target and surrounding normal soft tissues on a standard radiation therapy planning CT scan.

A full-scale clinical prototype for proton range verification using prompt gamma-ray spectroscopy

Abstract: We present a full-scale clinical prototype system for in vivo range verification of proton pencil-beams using the prompt gamma-ray spectroscopy method. The detection system consists of eight LaBr3 scintillators and a tungsten collimator, mounted on a rotating frame. Custom electronics and calibration algorithms have been developed for the measurement of energy- and time-resolved gamma-ray spectra during proton irradiation at a clinical dose rate. Using experimentally determined nuclear reaction cross sections and a GPU-accelerated Monte Carlo simulation, a detailed model of the expected gamma-ray emissions is created for each individual pencil-beam. The absolute range of the proton pencil-beams is determined by minimizing the discrepancy between the measurement and this model, leaving the absolute range of the beam and the elemental concentrations of the irradiated matter as free parameters. The system was characterized in a clinical-like situation by irradiating different phantoms with a scanning pencil-beam. A dose of 0.9 Gy was delivered to a 5x10x10 cm^3 target with a beam current of 2 nA incident on the phantom. Different range shifters and materials were used to test the robustness of the verification method and to calculate the accuracy of the detected range. The absolute proton range was determined for each spot of the distal energy layer with a mean statistical precision of 1.1 mm at a 95% confidence level and a mean systematic deviation of 0.5 mm, when aggregating pencil-beam spots within a cylindrical region of 10 mm radius and 10 mm depth. Small range errors that we introduced were successfully detected and even large differences in the elemental composition do not affect the range verification accuracy. These results show that our system is suitable for range verification during patient treatments in our upcoming clinical study.

Three-Dimensional Dose Prediction for Lung IMRT Patients with Deep Neural Networks: Robust Learning from Heterogeneous Beam Configurations

Abstract: The use of neural networks to directly predict three-dimensional dose distributions for automatic planning is becoming popular. However, the existing methods only use patient anatomy as input and assume consistent beam configuration for all patients in the training database. The purpose of this work is to develop a more general model that, in addition to patient anatomy, also considers variable beam configurations, to achieve a more comprehensive automatic planning with a potentially easier clinical implementation, without the need of training specific models for different beam settings.

Fully Automated Organ Segmentation in Male Pelvic CT Images

Abstract: Accurate segmentation of prostate and surrounding organs at risk is important for prostate cancer radiotherapy treatment planning. We present a fully automated workflow for male pelvic CT image segmentation using deep learning. The architecture consists of a 2D localization network followed by a 3D segmentation network for volumetric segmentation of prostate, bladder, rectum, and femoral heads. We used a multi-channel 2D U-Net followed by a 3D U-Net with encoding arm modified with aggregated residual networks, known as ResNeXt. The models were trained and tested on a pelvic CT image dataset comprising 136 patients. Test results show that 3D U-Net based segmentation achieves mean (SD) Dice coefficient values of 90 (2.0)% ,96 (3.0)%, 95 (1.3)%, 95 (1.5)%, and 84 (3.7)% for prostate, left femoral head, right femoral head, bladder, and rectum, respectively, using the proposed fully automated segmentation method.

Integrated and efficient diffusion-relaxometry using ZEBRA

Abstract: The emergence of multiparametric diffusion models combining diffusion and relaxometry measurements provide powerful new ways to explore tissue microstructure with the potential to provide new insights into tissue structure and function. However, their ability to provide rich analyses and the potential for clinical translation critically depends on the availability of efficient, integrated, multi-dimensional acquisitions. We propose a fully integrated sequence simultaneously sampling the acquisition parameter spaces required for T1 and T2* relaxometry and diffusion MRI. Slice-level interleaved diffusion encoding, multiple spin/gradient echoes and slice-shuffling are combined for higher efficiency, sampling flexibility and enhanced internal consistency. In-vivo data was successfully acquired on healthy adult brains. Obtained parametric maps as well as clustering results demonstrate the potential of the technique regarding its ability to provide eloquent data with an acceleration of roughly 20 compared to conventionally used approaches. The proposed integrated acquisition, called ZEBRA, offers significant acceleration and flexibility compared to existing diffusion-relaxometry studies and thus facilitates wider use of these techniques both for research-driven and clinical applications.

Super-resolution MRI through Deep Learning

Abstract: Magnetic resonance imaging (MRI) is extensively used for diagnosis and image-guided therapeutics. Due to hardware, physical and physiological limitations, acquisition of high-resolution MRI data takes long scan time at high system cost, and could be limited to low spatial coverage and also subject to motion artifacts. Super-resolution MRI can be achieved with deep learning, which is a promising approach and has a great potential for preclinical and clinical imaging. Compared with polynomial interpolation or sparse-coding algorithms, deep learning extracts prior knowledge from big data and produces superior MRI images from a low-resolution counterpart. In this paper, we adapt two state-of-the-art neural network models for CT denoising and deblurring, transfer them for super-resolution MRI, and demonstrate encouraging super-resolution MRI results toward two-fold resolution enhancement.

Recent Advances in Computational Modeling of Thrombosis

Abstract: The study of thrombosis is crucial to understand and develop new therapies for diseases like deep vein thrombosis, diabetes related strokes, pulmonary embolism etc. The last two decades have seen an exponential growth in studies related to the blood clot formation using computational tools and through experiments. Despite of this growth, the complete mechanism behind thrombus formation and hemostasis is not known yet. The computational models and methods used in this context are diversified into different spatiotemporal scales, yet there is no single model which can predict both physiological and mechanical properties of the blood clots. In this review, we will attempt to list out all major strategies attempted by researchers so far to model the blood clot formation using existing computational techniques. This review classifies them into continuum level, system level, discrete particles and multi-scale methods. We will also discuss the strength and weakness of various methods and possible future directions in which the computational blood clot research can thrive.

Sensitive Chronocoulometric Detection of miRNA at Screen-printed Electrodes modified by Gold decorated MoS2 Nanosheets

Abstract: Here a new chronocoulometric sensor, based on semiconducting 2H MoS2 nanosheets decorated with a controlled density of monodispersed small gold nanoparticles, was fabricated via electrodeposition, for the highly sensitive detection of miRNA-21. The size and interparticle spacing of AuNPs was optimized by controlling nucleation and growth rates through tuning of deposition-potential and Au-precursor concentration and by getting simultaneous feedback from morphological and electrochemical activity studies. The sensing strategy, involved the selective immobilization of thiolated capture probe DNA (CP) at AuNPs and hybridization of CP to a part of miRNA target, whereas the remaining part of the target was complementary to a signaling non-labelled DNA sequence. Chronocoulometry provided precise quantification of nucleic acids at each step of the sensor assay by interrogating [Ru(NH3)6]3+ electrostatically bound to phosphate backbones of oligonucleotides. A detailed and systematic optimization study demonstrated that the thinnest and smallest MoS2 NSs improved the sensitivity of the AuNP@MoS2 sensor achieving an impressive detection limit of 100 aM, which is 2 orders of magnitude lower than that of bare Au electrode and also enhanced the DNA-miRNA hybridization efficiency by 25%. Such improved performance can be attributed to the controlled packing density of CPs achieved by their self -assembly on AuNPs, large interparticle density, small size and the intimate coupling between AuNPs and MoS2. Alongside the outstanding sensitivity, the sensor exhibited excellent selectivity down to femtomolar concentrations, for discriminating complementary miRNA-21 target in a complex system composed of different foreign targets including mismatched and non-complementary miRNA-155. These advantages make our sensor a promising contender in the point of care miRNA sensor family for medical diagnostics.

Multicompartment Magnetic Resonance Fingerprinting

Abstract: Magnetic resonance fingerprinting (MRF) is a technique for quantitative estimation of spin-relaxation parameters from magnetic-resonance data. Most current MRF approaches assume that only one tissue is present in each voxel, which neglects the tissue's microstructure, and may lead to artifacts in the recovered parameter maps at boundaries between tissues. In this work, we propose a multicompartment MRF model that accounts for the presence of multiple tissues per voxel. The model is fit to the data by iteratively solving a sparse linear inverse problem at each voxel, in order to express the magnetization signal as a linear combination of a few fingerprints in the precomputed dictionary. Thresholding-based methods commonly used for sparse recovery and compressed sensing do not perform well in this setting due to the high local coherence of the dictionary. Instead, we solve this challenging sparse-recovery problem by applying reweighted-l1-norm regularization, implemented using an efficient interior-point method. The proposed approach is validated with simulated data at different noise levels and undersampling factors, as well as with a controlled phantom imaging experiment on a clinical magnetic-resonance system.

Personalized modeling for real-time pressure ulcer prevention in sitting posture

Abstract: , Ischial pressure ulcer is an important risk for every paraplegic person and a major public health issue. Pressure ulcers appear following excessive compression of buttock's soft tissues by bony structures, and particularly in ischial and sacral bones. Current prevention techniques are mainly based on daily skin inspection to spot red patches or injuries. Nevertheless, most pressure ulcers occur internally and are difficult to detect early. Estimating internal strains within soft tissues could help to evaluate the risk of pressure ulcer. A subject-specific biomechanical model could be used to assess internal strains from measured skin surface pressures. However, a realistic 3D non-linear Finite Element buttock model, with different layers of tissue materials for skin, fat and muscles, requires somewhere between minutes and hours to compute, therefore forbidding its use in a real-time daily prevention context. In this article, we propose to optimize these computations by using a reduced order modeling technique (ROM) based on proper orthogonal decompositions of the pressure and strain fields coupled with a machine learning method. ROM allows strains to be evaluated inside the model interactively (i.e. in less than a second) for any pressure field measured below the buttocks. In our case, with only 19 modes of variation of pressure patterns, an error divergence of one percent is observed compared to the full scale simulation for evaluating the strain field. This reduced model could therefore be the first step towards interactive pressure ulcer prevention in a daily setup. Highlights-Buttocks biomechanical modelling,-Reduced order model,-Daily pressure ulcer prevention.

High-fidelity, high-isotropic resolution diffusion imaging through gSlider acquisition with B1+ & T1 corrections and integrated {\Delta}B0/Rx shim array

Abstract: Purpose: B1+ and T1 corrections and dynamic multi-coil shimming approaches were proposed to improve the fidelity of high isotropic resolution Generalized slice dithered enhanced resolution (gSlider) diffusion imaging. Methods: An extended reconstruction incorporating B1+ inhomogeneity and T1 recovery information was developed to mitigate slab-boundary artifacts in short-TR gSlider acquisitions. Slab-by-slab dynamic B0 shimming using a multi-coil integrated {\Delta}B0/Rx shim-array, and high in-plane acceleration (Rinplane=4) achieved with virtual-coil GRAPPA were also incorporated into a 1 mm isotropic resolution gSlider acquisition/reconstruction framework to achieve an 8-11 fold reduction in geometric distortion compared to single-shot EPI. Results: The slab-boundary artifacts were alleviated by the proposed B1+ and T1 corrections compared to the standard gSlider reconstruction pipeline for short-TR acquisitions. Dynamic shimming provided >50% reduction in geometric distortion compared to conventional global 2nd order shimming. 1 mm isotropic resolution diffusion data show that the typically problematic temporal and frontal lobes of the brain can be imaged with high geometric fidelity using dynamic shimming. Conclusions: The proposed B1+ and T1 corrections and local-field control substantially improved the fidelity of high isotropic resolution diffusion imaging, with reduced slab-boundary artifacts and geometric distortion compared to conventional gSlider acquisition and reconstruction. This enabled high-fidelity whole-brain 1 mm isotropic diffusion imaging with 64 diffusion-directions in 20 minutes using a 3T clinical scanner.

Knowledge-based automated planning with three-dimensional generative adversarial networks

Abstract: We develop a knowledge-based automated planning (KBAP) pipeline that generates treatment plans using deep neural network architectures for predicting 3D doses. Our pipeline consisted of a generative adversarial network (GAN) to predict dose from a CT image followed by two optimization models to learn objective function weights and generate fluence-based plans, respectively. We investigated three different GAN models. The first two models predicted dose for each axial slice independently. One predicted dose as a RGB color map, while the other predicted a scalar value for dose directly. The third GAN model predicted scalar doses for the full 3D CT image at once, considering correlations between adjacent CT slices. For all models, we also investigated the impact of scaling the GAN predictions before optimization. Each GAN model was trained on 130 previously delivered oropharyngeal treatment plans. Performance was tested on 87 out-of-sample plans, by evaluating using clinical planning criteria and compared to their corresponding clinical plans. The best performing KBAP plans were generated with the 3D GAN, which predicted dose values followed by scaling. These plans satisfied close to 77% of all clinical criteria, compared to the clinical plans, which satisfied 64% of all criteria. Additionally, these KBAP plans satisfied the same criteria as the clinical plans 84% more frequently compared to the 2D GAN model using RGB dose prediction. The 3D GAN predictions were also more similar to the final plan compared to the other approaches, as it better captured the vertical dosimetric relationship between adjacent axial slices. The deliverable plans better captured implicit constraints associated with physical deliverability. Overall, our final plans had superior performance in satisfying clinical criteria and generated more realistic predictions compared to the previous state-of-the-art.

Reliable Gene Mutation Prediction in Clear Cell Renal Cell Carcinoma through Multi-classifier Multi-objective Radiogenomics Model

Abstract: Genetic studies have identified associations between gene mutations and clear cell renal cell carcinoma (ccRCC). Because the complete gene mutational landscape cannot be characterized through biopsy and sequencing assays for each patient, non-invasive tools are needed to determine the mutation status for tumors. Radiogenomics may be an attractive alternative tool to identify disease genomics by analyzing amounts of features extracted from medical images. Most current radiogenomics predictive models are built based on a single classifier and trained through a single objective. However, since many classifiers are available, selecting an optimal model is difficult. On the other hand, a single objective may not be a good measure to guide model training. We proposed a new multi-classifier multi-objective (MCMO) radiogenomics predictive model. To obtain more reliable prediction results, similarity-based sensitivity and specificity were defined and considered as the two objective functions simultaneously during training. To take advantage of different classifiers, the evidential reasoning (ER) approach was used for fusing the output of each classifier. Additionally, a new similarity-based multi-objective optimization algorithm (SMO) was developed for training the MCMO to predict ccRCC related gene mutations (VHL, PBRM1 and BAP1). Preliminary results revealed an association between some quantitative computed tomography (CT) features and underlying mutations. Using the proposed MCMO model, we achieved a predictive area under the receiver operating characteristic curve (AUC) over 0.86 for VHL, PBRM1, and BAP1 genes with balanced sensitivity and specificity. Furthermore, MCMO outperformed all the individual classifiers and yielded more reliable results than other optimization algorithms and commonly used fusion strategies.

Combining Many-objective Radiomics and 3-dimensional Convolutional Neural Network through Evidential Reasoning to Predict Lymph Node Metastasis in Head and Neck Cancer

Abstract: Lymph node metastasis (LNM) is a significant prognostic factor in patients with head and neck cancer, and the ability to predict it accurately is essential for treatment optimization. PET and CT imaging are routinely used for LNM identification. However, uncertainties of LNM always exist especially for small size or reactive nodes. Radiomics and deep learning are the two preferred imaging-based strategies for node malignancy prediction. Radiomics models are built based on handcrafted features, and deep learning can learn the features automatically. We proposed a hybrid predictive model that combines many-objective radiomics (MO-radiomics) and 3-dimensional convolutional neural network (3D-CNN) through evidential reasoning (ER) approach. To build a more reliable model, we proposed a new many-objective radiomics model. Meanwhile, we designed a 3D-CNN that fully utilizes spatial contextual information. Finally, the outputs were fused through the ER approach. To study the predictability of the two modalities, three models were built for PET, CT, and PET&CT. The results showed that the model performed best when the two modalities were combined. Moreover, we showed that the quantitative results obtained from the hybrid model were better than those obtained from MO-radiomics and 3D-CNN.

Magnetocardiography on an isolated animal heart with a room-temperature optically pumped magnetometer

Abstract: Optically pumped magnetometers are becoming a promising alternative to cryogenically-cooled superconducting magnetometers for detecting and imaging biomagnetic fields. Magnetic field detection is a completely non-invasive method, which allows one to study the function of excitable human organs with a sensor placed outside the human body. For instance, magnetometers can be used to detect brain activity or to study the activity of the heart. We have developed a highly sensitive miniature optically pumped magnetometer based on cesium atomic vapor kept in a paraffin-coated glass container. The magnetometer is optimized for detection of biological signals and has high temporal and spatial resolution. It is operated at room- or human body temperature and can be placed in contact with or at a mm-distance from a biological object. With this magnetometer, we detected the heartbeat of an isolated guinea-pig heart, which is an animal widely used in biomedical studies. In our recordings of the magnetocardiogram, we can in real-time observe the P-wave, QRS-complex and T-wave associated with the cardiac cycle. We also demonstrate that our device is capable of measuring the cardiac electrographic intervals, such as the RR- and QT-interval, and detecting drug-induced prolongation of the QT-interval, which is important for medical diagnostics.

Predicting kinetics using musculoskeletal modeling and inertial motion capture

Abstract: Inverse dynamic analysis using musculoskeletal modeling is a powerful tool, which is utilized in a range of applications to estimate forces in ligaments, muscles, and joints, non-invasively. To date, the conventional input used in this analysis is derived from optical motion capture (OMC) and force plate (FP) systems, which restrict the application of musculoskeletal models to gait laboratories. To address this problem, we propose a musculoskeletal model, capable of estimating the internal forces based solely on inertial motion capture (IMC) input and a ground reaction force and moment (GRF&M) prediction method. We validated the joint angle and kinetic estimates of the lower limbs against an equally constructed musculoskeletal model driven by OMC and FP system. The sagittal plane joint angles of ankle, knee, and hip presented excellent Pearson correlations (\rho = 0.95, 0.99, and 0.99, respectively) and root-mean-squared differences (RMSD) of 4.1 $\pm$ 1.3$\circ$, 4.4 $\pm$ 2.0$\circ$, and 5.7 $\pm$ 2.1$\circ$, respectively. The GRF&M predicted using IMC input were found to have excellent correlations for three components (vertical:\rho = 0.97, RMSD=9.3 $\pm$ 3.0 %BW, anteroposterior: \rho = 0.91, RMSD=5.5 $\pm$ 1.2 %BW, sagittal: \rho = 0.91, RMSD=1.6 $\pm$ 0.6 %BW*BH), and strong correlations for mediolateral (\rho = 0.80, RMSD=2.1 $\pm$ 0.6%BW ) and transverse (\rho = 0.82, RMSD=0.2 $\pm$ 0.1 %BW*BH). The proposed IMC-based method removes the complexity and space-restrictions of OMC and FP systems and could enable applications of musculoskeletal models in either monitoring patients during their daily lives or in wider clinical practice.

Complexity-weighted doses reduce biological uncertainty in proton radiotherapy planning.

Abstract: Purpose: Variations in proton Relative Biological Effectiveness (RBE) with Linear Energy Transfer (LET) remain one of the largest sources of uncertainty in proton radiotherapy. This work seeks to identify physics-based metrics which can be applied to reduce this biological uncertainty. Materials and Methods: Three different physical metrics - dose, dose $\times$ LET and a complexity-weighted dose (CWD, Dose $\times$ (1+$\kappa LET_D$) ) were compared with in vitro experimental studies of proton RBE and clinical treatment plans analysed using RBE models. The biological effects of protons in each system were plotted against these metrics to quantify the degree of biological uncertainty introduced by RBE variations in each case. Results: When the biological effects of protons were plotted against dose alone, significant biological uncertainty was introduced as the LET-dependence of RBE was neglected. Plotting biological effects against dose $\times$ LET significantly over-estimated the impact of LET on cell survival, leading to similar or greater levels of biological uncertainty. CWD, by contrast, significantly reduced biological uncertainties in both experiments and clinical plans. For prostate and medulloblastoma treatment plans, biological uncertainties were reduced from $\pm$ 5% to less than 1%. Conclusions: While not a replacement for full RBE models, physics-based metrics such as CWD have the potential to significantly reduce the uncertainties in proton planning which result from variations in RBE. These metrics may be used to identify regions in normal tissues which may see unexpectedly high effects due to end-of-range elevations of RBE, or as a tool in optimisation to deliver uniform biological effects.

Quantitative Histopathology of Stained Tissues using Color Spatial Light Interference Microscopy (cSLIM)

Abstract: Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstained tissues, which disrupts the established specimen processing. Here we present color spatial light interference microscopy (cSLIM) as a new whole slide imaging modality that performs interferometric imaging with a color detector array. As a result, cSLIM yields in a single scan both the intrinsic tissue phase map and the standard color bright-field image, familiar to the pathologist. Our results on 196 breast cancer patients indicate that cSLIM can provide not only diagnostic but also prognostic information from the alignment of collagen fibers in the tumor microenvironment. The effects of staining on the tissue phase maps were corrected by a simple mathematical normalization. These characteristics are likely to reduce barriers to clinical translation for the new cSLIM technology.

Exploiting flow dynamics for super-resolution in contrast-enhanced ultrasound

Abstract: Ultrasound localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles with low-concentration within the bloodstream reveal the vasculature with capillary resolution. Despite its high spatial resolution, low microbubble concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single super-resolved image. %since each echo is required to be well separated from adjacent microbubbles. Such long acquisition times and stringent constraints on microbubble concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable microbubble overlap. %Yet, non of the reported methods exploit the fact that microbubbles actually flow within the bloodstream. % to improve recovery. Here, we further improve sparsity-based super-resolution ultrasound imaging by exploiting the inherent flow of microbubbles and utilize their motion kinematics. While doing so, we also provide quantitative measurements of microbubble velocities. Our method relies on simultaneous tracking and super-localization of individual microbubbles in a frame-by-frame manner, and as such, may be suitable for real-time implementation. We demonstrate the effectiveness of the proposed approach on both simulations and {\it in-vivo} contrast enhanced human prostate scans, acquired with a clinically approved scanner.

Multimodal Functional and Structural Brain Connectivity Analysis in Autism: A Preliminary Integrated Approach with EEG, fMRI and DTI

Abstract: This paper proposes a novel approach of integrating different neuroimaging techniques to characterize an autistic brain. Different techniques like EEG, fMRI and DTI have traditionally been used to find biomarkers for autism, but there have been very few attempts for a combined or multimodal approach of EEG, fMRI and DTI to understand the neurobiological basis of autism spectrum disorder (ASD). Here, we explore how the structural brain network correlate with the functional brain network, such that the information encompassed by these two could be uncovered only by using the latter. In this paper, source localization from EEG using independent component analysis (ICA) and dipole fitting has been applied first, followed by selecting those dipoles that are closest to the active regions identified with fMRI. This allows translating the high temporal resolution of EEG to estimate time varying connectivity at the spatial source level. Our analysis shows that the estimated functional connectivity between two active regions can be correlated with the physical properties of the structure obtained from DTI analysis. This constitutes a first step towards opening the possibility of using pervasive EEG to monitor the long-term impact of ASD treatment without the need for frequent expensive fMRI or DTI investigations.