Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The outside world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the governing laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Several lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual \"filling in,\" visual stability despite eye movements, change blindness, sensory substitution, and color perception.

A sensorimotor account of vision and visual consciousness-Authors' Response-Acting out our sensory experience

State-of-the-art retinal optical coherence tomography

We have combined Fourier-domain optical coherence tomography (FD-OCT) with a closed-loop adaptive optics (AO) system using a Hartmann-Shack wavefront sensor and a bimorph deformable mirror. The adaptive optics system measures and corrects the wavefront aberration of the human eye for improved lateral resolution (~4 μm) of retinal images, while maintaining the high axial resolution (~6 μm) of stand alone OCT. The AO-OCT instrument enables the three-dimensional (3D) visualization of different retinal structures in vivo with high 3D resolution (4×4×6 μm). Using this system, we have demonstrated the ability to image microscopic blood vessels and the cone photoreceptor mosaic.

/pdf/adaptive-optics-optical-coherence-tomography-for-high-3r5d76hchu.pdf

Adaptive-optics optical coherence tomography for high-resolution and high-speed 3D retinal in vivo imaging

We demonstrate ultrahigh speed spectral / Fourier domain optical coherence tomography (OCT) using an ultrahigh speed CMOS line scan camera at rates of 70,000 - 312,500 axial scans per second. Several design configurations are characterized to illustrate trade-offs between acquisition speed, resolution, imaging range, sensitivity and sensitivity roll-off performance. Ultrahigh resolution OCT with 2.5 - 3.0 micron axial image resolution is demonstrated at approximately 100,000 axial scans per second. A high resolution spectrometer design improves sensitivity roll-off and imaging range performance, trading off imaging speed to 70,000 axial scans per second. Ultrahigh speed imaging at >300,000 axial scans per second with standard image resolution is also demonstrated. Ophthalmic OCT imaging of the normal human retina is investigated. The high acquisition speeds enable dense raster scanning to acquire densely sampled volumetric three dimensional OCT (3D-OCT) data sets of the macula and optic disc with minimal motion artifacts. Imaging with approximately 8 - 9 micron axial resolution at 250,000 axial scans per second, a 512 x 512 x 400 voxel volumetric 3D-OCT data set can be acquired in only approximately 1.3 seconds. Orthogonal registration scans are used to register OCT raster scans and remove residual axial eye motion, resulting in 3D-OCT data sets which preserve retinal topography. Rapid repetitive imaging over small volumes can visualize small retinal features without motion induced distortions and enables volume registration to remove eye motion. Cone photoreceptors in some regions of the retina can be visualized without adaptive optics or active eye tracking. Rapid repetitive imaging of 3D volumes also provides dynamic volumetric information (4D-OCT) which is shown to enhance visualization of retinal capillaries and should enable functional imaging. Improvements in the speed and performance of 3D-OCT volumetric imaging promise to enable earlier diagnosis and improved monitoring of disease progression and response to therapy in ophthalmology, as well as have a wide range of research and clinical applications in other areas.

Ultrahigh speed spectral / Fourier domain OCT ophthalmic imaging at 70,000 to 312,500 axial scans per second

By compensating for the aberrations in the eye that cause blur, the adaptive optics scanning laser ophthalmoscope (AOSLO) yields high-magnification, high-resolution, real-time images of the living human retina. Features as small as single cone photoreceptors can be resolved, single leukocytes are recorded in real time as they pass through the smallest retinal capillaries, and the optical sectioning capability can be used to visualize independent layers of the retinal tissue ranging from the nerve fiber layer, through the blood vessels to the photoreceptors. The use of AO technology not only enhances the breadth of applications of conventional SLOs, but it facilitates a host of new applications. Here we provide an overview of AOSLO performance and its applications, including two clinical examples. Finally, we preview two novel applications; one where the AOSLO is used to present AO-corrected stimuli directly onto the retina while simultaneously recording their exact retinal position, and a second application where AOSLO videos are used to provide very precise, high-frequency measures of eye movements.

/pdf/what-can-adaptive-optics-do-for-a-scanning-laser-q153grtzjk.pdf

What can adaptive optics do for a scanning laser ophthalmoscope

Purpose Adaptive optics scanning laser ophthalmoscope (AOSLO) capillary perfusion images can possess large variations in contrast, intensity, and background signal, thereby limiting the use of global or adaptive thresholding techniques for automatic segmentation. We sought to develop an automated approach to segment perfused capillaries in AOSLO images. Methods 12,979 image patches were extracted from manually segmented AOSLO montages from 14 eyes and used to train a convolutional neural network (CNN) that classified pixels as capillaries, large vessels, background, or image canvas. 1764 patches were extracted from AOSLO montages of four separate subjects, and were segmented manually by two raters (ground truth) and automatically by the CNN, an Otsu's approach, and a Frangi approach. A modified Dice coefficient was created to account for slight spatial differences between the same manually and CNN-segmented capillaries. Results CNN capillary segmentation had an accuracy (0.94), a Dice coefficient (0.67), and a modified Dice coefficient (0.90) that were significantly higher than other automated approaches (P 0.05). Conclusions Close agreement between the CNN and manual segmentations enables robust and objective quantification of perfused capillary metrics. The developed CNN is time and computationally efficient, and distinguishes capillaries from areas containing diffuse background signal and larger underlying vessels. Translational Relevance This automatic segmentation algorithm greatly increases the efficiency of quantifying AOSLO capillary perfusion images.

Automatic Segmentation of Retinal Capillaries in Adaptive Optics Scanning Laser Ophthalmoscope Perfusion Images Using a Convolutional Neural Network.

Embodiments of the invention generally provide apparatuses and methods utilized in optics, and more specifically to apparatuses and methods for adaptive optics correction and imaging. Real-time wavefront sensorless adaptive optics correction and imaging is used with the living human eye to produce optical quality rivaling that of wavefront sensor based control in the similar systems. Using an optimization algorithm that is based on an image quality metric, the apparatus and method optimize the optical quality in ocular image frames acquired with an adaptive optics system.

Wavefront sensorless adaptive correction of the wave aberration for an eye

Significance Pupillometry protocols evaluating rod/cone- and melanopsin-driven responses often use mydriatics to ensure maximal stimulus exposure; however, retinal effects of mydriatics are not fully understood. We demonstrate that dilation with either atropine or phenylephrine results in similar enhancements of rod/cone- and melanopsin-driven pupil responses. Purpose The purposes of this study were to compare the effects of atropine, a muscarinic antagonist, and phenylephrine, an adrenergic agonist, on consensual pupil responses and to assess the repeatability of pupil metrics without mydriasis. Methods Right eye pupil responses of 20 adults aged 21 to 42 years were recorded before and 45 minutes after instillation of 0.5% atropine or 2.5% phenylephrine in the left eye. Stimuli were presented to the left eye and included six alternating 1-second 651-nm "red" and 456-nm "blue" flashes. Metrics included baseline pupil diameter, maximal constriction, 6- and 30-second post-illumination pupil responses, and early (0 to 10 seconds) and late (10 to 30 seconds) areas under the curve. Results Dilation of the stimulated eye with either mydriatic significantly increased the 6-second post-illumination pupil response and early and late areas under the curve for blue stimuli, and early area under the curve for red stimuli (P .05 for all). Without mydriasis, intersession intraclass correlation coefficients for pupil metrics were 0.63 and 0.50 (6- and 30-second post-illumination pupil responses, respectively) and 0.78 and 0.44 (early and late areas under the curve, respectively) for blue stimuli, with no significant difference between sessions (P > .05 for all). Conclusions Dilation with phenylephrine or atropine resulted in similar enhancements of the rod/cone- and melanopsin-driven pupil responses, despite differing mechanisms. Early pupil metrics without mydriasis demonstrated moderate to good intersession repeatability.

/pdf/effects-of-mydriatics-on-rod-cone-and-melanopsin-driven-4nk65cdk18.pdf

Effects of Mydriatics on Rod/Cone- and Melanopsin-driven Pupil Responses.

In vivo examination of cone photoreceptors in patients with Retinitis Pigmentosa implanted over five years ago with encapsulated Ciliary Neurotrophic Factor

Hope M Queener

Papers

What can adaptive optics do for a scanning laser ophthalmoscope

Automatic Segmentation of Retinal Capillaries in Adaptive Optics Scanning Laser Ophthalmoscope Perfusion Images Using a Convolutional Neural Network.

Wavefront sensorless adaptive correction of the wave aberration for an eye

Effects of Mydriatics on Rod/Cone- and Melanopsin-driven Pupil Responses.

In vivo examination of cone photoreceptors in patients with Retinitis Pigmentosa implanted over five years ago with encapsulated Ciliary Neurotrophic Factor