The analysis of medical images has been woven into the fabric of the pattern analysis and machine intelligence (PAMI) community since the earliest days of these Transactions. Initially, the efforts in this area were seen as applying pattern analysis and computer vision techniques to another interesting dataset. However, over the last two to three decades, the unique nature of the problems presented within this area of study have led to the development of a new discipline in its own right. Examples of these include: the types of image information that are acquired, the fully three-dimensional image data, the nonrigid nature of object motion and deformation, and the statistical variation of both the underlying normal and abnormal ground truth. In this paper, we look at progress in the field over the last 20 years and suggest some of the challenges that remain for the years to come.

https://hal.inria.fr/inria-00615100/document

Medical image analysis: progress over two decades and the challenges ahead

https://bio3d.colorado.edu/SerialEM/serialEMJSB.pdf

Automated electron microscope tomography using robust prediction of specimen movements.

中枢神経系疾患の治療は正常細胞（ニューロン）の機能維持を目的とするが，脳血管障害のように機能障害の原因が細胞の死滅に基づくことは多い．一方，脳腫瘍の治療においては薬物療法や放射線療法といった腫瘍細胞の死滅を目標とするものが大きな位置を占める．いずれの場合にも，細胞死の機序を理解することは各種病態や治療法の理解のうえで重要である．現在のところ最も研究の進んでいる細胞死の型はアポトーシスである．そのなかで重要な位置を占めるミトコンドリアにおける反応および抗アポトーシス因子について概要を紹介する．

Neuroscience 細胞死：最近の知見

MUCKE aims to mine a large volume of images, to structure them conceptually and to use this conceptual structuring in order to improve large-scale image retrieval. The last decade witnessed important progress concerning low-level image representations. However, there are a number problems which need to be solved in order to unleash the full potential of image mining in applications. The central problem with low-level representations is the mismatch between them and the human interpretation of image content. This problem can be instantiated, for instance, by the incapability of existing descriptors to capture spatial relationships between the concepts represented or by their incapability to convey an explanation of why two images are similar in a content-based image retrieval framework. We start by assessing existing local descriptors for image classification and by proposing to use co-occurrence matrices to better capture spatial relationships in images. The main focus in MUCKE is on cleaning large scale Web image corpora and on proposing image representations which are closer to the human interpretation of images. Consequently, we introduce methods which tackle these two problems and compare results to state of the art methods. Note: some aspects of this deliverable are withheld at this time as they are pending review. Please contact the authors for a preview.

http://ieeexplore.ieee.org/iel2/4524/12820/00592460.pdf

Image Processing

http://www.cvs.rochester.edu/knill_lab/papers/35_TINS_2004.pdf

The Bayesian brain: the role of uncertainty in neural coding and computation

Low-contrast features such as thrombus, dissection, and even stents can be difficult to detect in coronary x-ray images or angiograms. For these reasons we propose to improve the clinical visualization of low-contrast structures using layer decomposition. Our method for layer decomposition models the cone-beam projections through the chest as a set of superposed layers moving with translation, rotation, and scaling. We solve for the layer motions using phase correlation methods. We solve for the layer densities by averaging along moving trajectories and subtracting new layer densities from previous layer estimates. We apply layer decomposition to clinical coronary angiograms with and without contrast material. The reconstructed vessel layer represents a motion-compensated temporal average of structures co-moving with the vessel. Subtraction of background layers from the original image sequence yields a tracked background-subtracted sequence which has no vessel-motion artifacts and almost no increase in noise, unlike standard background substraction techniques. Layer decomposition improves vessel definition and visibility of low-contrast objects in cine x-ray image sequences.© (2000) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.

Layer decomposition of coronary angiograms

Purpose To validate a normal-resolution (NR) simulation (NRsim) algorithm that uses high-resolution (HR) or super-high resolution (SHR) acquisitions on a commercial HR computed tomography (CT) scanner by comparing image quality between NRsim-generated images and actual NR images. NRsim is intended to allow direct comparison between normal-resolution CT and HR/SHR reconstructions in clinical investigations, without repeating exams. Methods The Aquilion Precision CT (Canon Medical Systems Corporation) HR CT scanner has three resolution modes resulting from detector binning in the channel (x-y) and row (z) directions. For NR, each detector element is 0.5 mm × 0.5 mm along the channel and row directions, 0.25 mm × 0.5 mm for HR, and 0.25 mm × 0.25 mm for SHR. The NRsim algorithm simulates NR acquisitions from HR or SHR acquisitions (termed NRHR and NRSHR , respectively) by downsampling the pre-log raw data in the channel direction for the HR acquisitions and in the channel and row direction for the SHR acquisition. The downsampled data are then reconstructed using the same process as NR. The axial modulation transfer function (MTF), slice sensitivity profile (SSP), and CT number accuracy were measured using the Catphan 600 phantom, and the three-dimensional noise power spectrum (NPS) was measured in water-equivalent phantoms for standard protocols across a range of size-specific dose estimates (SSDE): head (6.2-29.8 mGy), lung (2.2-18.2 mGy), and body (5.6-19.4 mGy). The MTF and NPS measurements were combined to estimate low-contrast detectability (LCD) using a non-prewhitening model observer with an eye filter for a 5-mm disk with 10 HU contrast. All metrics were compared for NR, NRHR , and NRSHR images reconstructed using filtered back projection (FBP) and an iterative reconstruction algorithm (AIDR3D). We chose a 15% error threshold as a reasonable definition of success for NRsim when compared against actual NR based on published studies showing that a just-noticeable difference in image noise level for human observers is typically Results The axial MTF and SSPs for NRsim were in good agreement with NR demonstrated by a maximum difference of 5.1% for the MTF at 10% and 50% across materials (air, Teflon, LDPE, and polystyrene) and a maximum SSP difference of 2.2%. Noise magnitude differences were within 15% across the SSDE levels with the exception of below 4.5 mGy for the lung protocol with FBP. The relative RMSE of normalized NPS comparisons were all Conclusions NRsim, an algorithm for simulating NR acquisitions using HR and SHR raw data, was introduced and shown to generate images with spatial resolution, noise, HU accuracy, and LCD largely equivalent to scans acquired using an actual NR acquisition. At SSDE levels below ~5 mGy for the lung protocol, differences in noise magnitude and LCD for NRSHR were >15% which defines a region where NRsim degrades due to contributions from electronic noise.

Validation of synthesized normal-resolution image data generated from high-resolution acquisitions on a commercial CT scanner

The surprisingly high human efficiency at learning to recognize faces

The neural mechanisms driving perception and saccades during search use information about the target but are also based on an inhibitory surround not present in the target luminance profile (e.g., Eckstein et al., 2007). Here, we ask whether these inhibitory surrounds might reflect a strategy that the brain has adapted to optimize the search for targets in natural scenes. To test this hypothesis, we sought to estimate the best linear template (behavioral receptive field), built from linear combinations of Gabor channels representing V1 simple cells in search for an additive Gaussian target embedded in natural images. Statistically nonstationary and non-Gaussian properties of natural scenes preclude calculation of the best linear template from analytic expressions and require an iterative optimization method such as a virtual evolution via a genetic algorithm. Evolved linear receptive fields built from linear combinations of Gabor functions include substantial inhibitory surround, larger than those found in humans performing target search in white noise. The inhibitory surrounds were robust to changes in the contrast of the signal, generalized to a larger calibrated natural image data set, and tasks in which the signal occluded other objects in the image. We show that channel nonlinearities can have strong effects on the observed linear behavioral receptive field but preserve the inhibitory surrounds. Together, the results suggest that the apparent suboptimality of inhibitory surrounds in human behavioral receptive fields when searching for a target in white noise might reflect a strategy to optimize detection of signals in natural scenes. Finally, we contend that optimized linear detection of spatially compact signals in natural images might be a new possible hypothesis, distinct from decorrelation of visual input and sparse representations (e.g., Graham et al., 2006), to explain the evolution of center-surround organization of receptive fields in early vision.

Virtual evolution for visual search in natural images results in behavioral receptive fields with inhibitory surrounds.

A method for image guidance of coronary stent deployment using radiopaque markers and the image processing technique of moving layer decomposition. The radiopaque markers are attached to guidewires or delivery balloons that are used to place the stent and co-moves with the coronary vessel. A series of fluoroscopic images are taken during the stent placement and are used to genearate layer images which represent different structures in the angiograms, such as the stent and guidewires, background structures, etc. The clearly visible images of the markers are used in the layer decomposition. Although stents are less radiopaque than the markers, visibility of previously deployed stents is also enhanced in the layer images. The layer images are used to guide placement of multiple stents to prevent overlap or gaps between the stents. After stent expansion, angiographic images are acquired of the lumen filled with liquid contrast agent. Layer decomposition is applied to these images in order to visually or quantitatively determine the lumen narrowing (or broadening) in the stented region.

Craig K. Abbey

Papers

Layer decomposition of coronary angiograms

Validation of synthesized normal-resolution image data generated from high-resolution acquisitions on a commercial CT scanner

The surprisingly high human efficiency at learning to recognize faces

Virtual evolution for visual search in natural images results in behavioral receptive fields with inhibitory surrounds.

Image guidance method coronary stent deployment