Psychophysical and physiological evidence indicates that the visual system of primates and humans has evolved a specialized processing focus moving across the visual scene. This study addresses the question of how simple networks of neuron-like elements can account for a variety of phenomena associated with this shift of selective visual attention. Specifically, we propose the following: (1) A number of elementary features, such as color, orientation, direction of movement, disparity etc. are represented in parallel in different topographical maps, called the early representation. (2) There exists a selective mapping from the early topographic representation into a more central non-topographic representation, such that at any instant the central representation contains the properties of only a single location in the visual scene, the selected location. We suggest that this mapping is the principal expression of early selective visual attention. One function of selective attention is to fuse information from different maps into one coherent whole. (3) Certain selection rules determine which locations will be mapped into the central representation. The major rule, using the conspicuity of locations in the early representation, is implemented using a so-called Winner-Take-All network. Inhibiting the selected location in this network causes an automatic shift towards the next most conspicious location. Additional rules are proximity and similarity preferences. We discuss how these rules can be implemented in neuron-like networks and suggest a possible role for the extensive back-projection from the visual cortex to the LGN.

Shifts in selective visual attention: towards the underlying neural circuitry.

Sensations of color show a strong correlation with reflectance, even though the amount of visible light reaching the eye depends on the product of reflectance and illumination. The visual system must achieve this remarkable result by a scheme that does not measure flux. Such a scheme is described as the basis of retinex theory. This theory assumes that there are three independent cone systems, each starting with a set of receptors peaking, respectively, in the long-, middle-, and short-wavelength regions of the visible spectrum. Each system forms a separate image of the world in terms of lightness that shows a strong correlation with reflectance within its particular band of wavelengths. These images are not mixed, but rather are compared to generate color sensations. The problem then becomes how the lightness of areas in these separate images can be independent of flux. This article describes the mathematics of a lightness scheme that generates lightness numbers, the biologic correlate of reflectance, independent of the flux from objects

/pdf/lightness-and-retinex-theory-232bqfwem1.pdf

Lightness and Retinex Theory

Introduction to synaptic circuits, Gordon M.Shepherd and Christof Koch membrane properties and neurotransmitter actions, David A.McCormick peripheral ganglia, Paul R.Adams and Christof Koch spinal cord - ventral horn, Robert E.Burke olfactory bulb, Gordon M.Shepherd, and Charles A.Greer retina, Peter Sterling cerebellum, Rodolfo R.Llinas and Kerry D.Walton thalamus, S.Murray Sherman and Christof Koch basal ganglia, Charles J.Wilson olfactory cortex, Lewis B.Haberly hippocampus, Thomas H.Brown and Anthony M.Zador neocortex, Rodney J.Douglas and Kevan A.C.Martin Gordon M.Shepherd. Appendix: Dendretic electrotonus and synaptic integration.

The synaptic organization of the brain

Using generic interpolation machinery based on solving Poisson equations, a variety of novel tools are introduced for seamless editing of image regions. The first set of tools permits the seamless importation of both opaque and transparent source image regions into a destination region. The second set is based on similar mathematical ideas and allows the user to modify the appearance of the image seamlessly, within a selected region. These changes can be arranged to affect the texture, the illumination, and the color of objects lying in the region, or to make tileable a rectangular selection.

Poisson image editing

Direct observation and recorded color images of the same scenes are often strikingly different because human visual perception computes the conscious representation with vivid color and detail in shadows, and with resistance to spectral shifts in the scene illuminant. A computation for color images that approaches fidelity to scene observation must combine dynamic range compression, color consistency-a computational analog for human vision color constancy-and color and lightness tonal rendition. In this paper, we extend a previously designed single-scale center/surround retinex to a multiscale version that achieves simultaneous dynamic range compression/color consistency/lightness rendition. This extension fails to produce good color rendition for a class of images that contain violations of the gray-world assumption implicit to the theoretical foundation of the retinex. Therefore, we define a method of color restoration that corrects for this deficiency at the cost of a modest dilution in color consistency. Extensive testing of the multiscale retinex with color restoration on several test scenes and over a hundred images did not reveal any pathological behaviour.

A multiscale retinex for bridging the gap between color images and the human observation of scenes

Photographic process whereby a fully developed and fixed negative is formed concurrently with a positive silver transfer image

A binocular rangefinder defines a field of view and superimposes thereon a composite stereoscopic virtual image of a pair of dissimilar, stereoscopically related reticles, the image having depthwise extension along a line of sight extending from the observer into the field of view. The apparent position of the image along the line of sight is variable and ranging information is obtainable concerning subjects within the field appearing between far and near limits established by the depthwise extension of the image.

Stereoscopic rangefinder with movable reticles

This paper describes an experiment that Smitty performed while I was giving the William James lectures at Harvard. It was a modification of Craik’s and Cornsweet’s experiments using mixtures of red and blue instead of black and white. Smitty’s experiment tested whether the colors produced were the colors one would expect from the predictions of Retinex theory. This paper describes the experiment, the predictions, and the results.

Smitty Stevens’ Test of Retinex Theory

This invention relates to a light-polarizing material coated with a photosensitive layer. Objects of the invention are to provide a lightpolarizing surface having thereon a layer of photosensitive material; a transparent support providing a light-polarizing surface coated with ,photosensitive...

Edwin H Land

Papers

Photographic process whereby a fully developed and fixed negative is formed concurrently with a positive silver transfer image

Stereoscopic rangefinder with movable reticles

Smitty Stevens’ Test of Retinex Theory

Light-polarizing material coated with a photosensitive layer

Photographic film unit having a frangible fluid container therein