Publisher Summary This chapter focuses on the modern notion of short-term memory, called working memory. Working memory refers to the temporary maintenance of information that was just experienced or just retrieved from long-term memory but no longer exists in the external environment. These internal representations are short-lived, but can be maintained for longer periods of time through active rehearsal strategies, and can be subjected to various operations that manipulate the information in such a way that makes it useful for goal-directed behavior. Working memory is a system that is critically important in cognition and seems necessary in the course of performing many other cognitive functions, such as reasoning, language comprehension, planning, and spatial processing. This chapter demonstrates the functional importance of dopamine to working memory function in several ways. Elucidation of the cognitive and neural mechanisms underlying human working memory is an important focus of cognitive neuroscience and neurology for much of the past decade. One conclusion that arises from research is that working memory, a faculty that enables temporary storage and manipulation of information in the service of behavioral goals, can be viewed as neither a unitary, nor a dedicated system. Data from numerous neuropsychological and neurophysiological studies in animals and humans demonstrates that a network of brain regions, including the prefrontal cortex, is critical for the active maintenance of internal representations.

Chapter 11 Working memory

Brain-computer interfaces for communication and control.

Synchronous rhythms represent a core mechanism for sculpting temporal coordination of neural activity in the brain-wide network. This review focuses on oscillations in the cerebral cortex that occur during cognition, in alert behaving conditions. Over the last two decades, experimental and modeling work has made great strides in elucidating the detailed cellular and circuit basis of these rhythms, particularly gamma and theta rhythms. The underlying physiological mechanisms are diverse (ranging from resonance and pacemaker properties of single cells to multiple scenarios for population synchronization and wave propagation), but also exhibit unifying principles. A major conceptual advance was the realization that synaptic inhibition plays a fundamental role in rhythmogenesis, either in an interneuronal network or in a reciprocal excitatory-inhibitory loop. Computational functions of synchronous oscillations in cognition are still a matter of debate among systems neuroscientists, in part because the notion of regular oscillation seems to contradict the common observation that spiking discharges of individual neurons in the cortex are highly stochastic and far from being clocklike. However, recent findings have led to a framework that goes beyond the conventional theory of coupled oscillators and reconciles the apparent dichotomy between irregular single neuron activity and field potential oscillations. From this perspective, a plethora of studies will be reviewed on the involvement of long-distance neuronal coherence in cognitive functions such as multisensory integration, working memory, and selective attention. Finally, implications of abnormal neural synchronization are discussed as they relate to mental disorders like schizophrenia and autism.

/pdf/neurophysiological-and-computational-principles-of-cortical-48xnk4ixsg.pdf

Neurophysiological and Computational Principles of Cortical Rhythms in Cognition

Reaching and grasping in primates depend on the coordination of neural activity in large frontoparietal ensembles. Here we demonstrate that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain–machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters (i.e., hand position, velocity, gripping force, and the EMGs of multiple arm muscles) from the electrical activity of frontoparietal neuronal ensembles. As single neurons typically contribute to the encoding of several motor parameters, we observed that high BMIc accuracy required recording from large neuronal ensembles. Continuous BMIc operation by monkeys led to significant improvements in both model predictions and behavioral performance. Using visual feedback, monkeys succeeded in producing robot reach-and-grasp movements even when their arms did not move. Learning to operate the BMIc was paralleled by functional reorganization in multiple cortical areas, suggesting that the dynamic properties of the BMIc were incorporated into motor and sensory cortical representations.

https://www.ai.rug.nl/~lambert/projects/BCI/literature/serious/invasive/neural-implants-plbi-01-02-carmena.pdf

Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates

https://www.lehigh.edu/~inbios21/PDF/Fall2007/Brain-Machine_Interface.pdf

Brain–machine interfaces: past, present and future

A number of cortical structures are reported to have elevated single unit firing rates sustained throughout the memory period of a working memory task. How the nervous system forms and maintains these memories is unknown but reverberating neuronal network activity is thought to be important. We studied the temporal structure of single unit (SU) activity and simultaneously recorded local field potential (LFP) activity from area LIP in the inferior parietal lobe of two awake macaques during a memory-saccade task. Using multitaper techniques for spectral analysis, which play an important role in obtaining the present results, we find elevations in spectral power in a 50--90 Hz (gamma) frequency band during the memory period in both SU and LFP activity. The activity is tuned to the direction of the saccade providing evidence for temporal structure that codes for movement plans during working memory. We also find SU and LFP activity are coherent during the memory period in the 50--90 Hz gamma band and no consistent relation is present during simple fixation. Finally, we find organized LFP activity in a 15--25 Hz frequency band that may be related to movement execution and preparatory aspects of the task. Neuronal activity could be used to control a neural prosthesis but SU activity can be hard to isolate with cortical implants. As the LFP is easier to acquire than SU activity, our finding of rich temporal structure in LFP activity related to movement planning and execution may accelerate the development of this medical application.

Temporal structure in neuronal activity during working memory in Macaque parietal cortex

Many cortical structures have elevated firing rates during working memory, but it is not known how the activity is maintained. To investigate whether reverberating activity is important, we studied the temporal structure of local field potential (LFP) activity and spiking from area LIP in two awake macaques during a memory-saccade task. Using spectral analysis, we found spatially tuned elevated power in the gamma band (25-90 Hz) in LFP and spiking activity during the memory period. Spiking and LFP activity were also coherent in the gamma band but not at lower frequencies. Finally, we decoded LFP activity on a single-trial basis and found that LFP activity in parietal cortex discriminated between preferred and anti-preferred direction with approximately the same accuracy as the spike rate and predicted the time of a planned movement with better accuracy than the spike rate. This finding could accelerate the development of a cortical neural prosthesis.

/pdf/temporal-structure-in-neuronal-activity-during-working-5ndmszxaa3.pdf

Temporal structure in neuronal activity during working memory in macaque parietal cortex

Electrical stimulation of the visual system might serve as the foundation for a prosthetic device for the blind. We examined whether microstimulation of the dorsal lateral geniculate nucleus of the thalamus can generate localized visual percepts in alert monkeys. To assess electrically generated percepts, an eye-movement task was used with targets presented on a computer screen (optically) or through microstimulation of the lateral geniculate nucleus (electrically). Saccades (fast, direct eye movements) made to electrical targets were comparable to saccades made to optical targets. Gaze locations for electrical targets were well predicted by measured visual response maps of cells at the electrode tips. With two electrodes, two distinct targets could be independently created. A sequential saccade task verified that electrical targets were processed not in motor coordinates, but in visual spatial coordinates. Microstimulation produced predictable visual percepts, showing that this technique may be useful for a visual prosthesis.

https://www.pnas.org/content/pnas/104/18/7670.full.pdf

Demonstration of artificial visual percepts generated through thalamic microstimulation

Common causes of blindness are diseases that affect the ocular structures, such as glaucoma, retinitis pigmentosa, and macular degeneration, rendering the eyes no longer sensitive to light. The visual pathway, however, as a predominantly central structure, is largely spared in these cases. It is thus widely thought that a device-based prosthetic approach to restoration of visual function will be effective and will enjoy similar success as cochlear implants have for restoration of auditory function. In this article the authors review the potential locations for stimulation electrode placement for visual prostheses, assessing the anatomical and functional advantages and disadvantages of each. Of particular interest to the neurosurgical community is placement of deep brain stimulating electrodes in thalamic structures that has shown substantial promise in an animal model. The theory of operation of visual prostheses is discussed, along with a review of the current state of knowledge. Finally, the visual prosthesis is proposed as a model for a general high-fidelity machine-brain interface.

/pdf/getting-signals-into-the-brain-visual-prosthetics-through-3szlsand1k.pdf

Getting signals into the brain: visual prosthetics through thalamic microstimulation

Electrical stimulation of the thalamus has been widely used to test for the existence of monosynaptic input to cortical neurons, typically with stimulation currents that evoke cortical spikes with high probability. We stimulated the lateral geniculate nucleus (LGN) of the thalamus and recorded monosynaptically evoked spikes from layer 4 neurons in visual cortex. We found that with moderate currents, cortical spikes were evoked with low to moderate probability and their occurrence was modulated by ongoing sensory (visual) input. Furthermore, when repeated at 8–12 Hz, electrical stimulation of the thalamic afferents caused such profound inhibition that cortical spiking activity was suppressed, aside from electrically evoked monosynaptic spikes. Visual input to layer 4 cortical cells between electrical stimuli must therefore have derived exclusively from LGN afferents. We used white-noise visual stimuli to make a 2D map of the receptive field of each cortical simple cell during repetitive electrical stimulation in the LGN. The receptive field of electrically evoked monosynaptic spikes (and thus of the thalamic input alone) was significantly elongated. Its primary subfield was comparable to that of the control receptive field, but secondary (flanking) subfields were weaker. These findings extend previous results from intracellular recordings, but also demonstrate the effectiveness of an extracellular method of measuring subthreshold afferent input to cortex.

https://www.pnas.org/content/pnas/99/25/16261.full.pdf

John S. Pezaris

Papers

Temporal structure in neuronal activity during working memory in Macaque parietal cortex

Temporal structure in neuronal activity during working memory in macaque parietal cortex

Demonstration of artificial visual percepts generated through thalamic microstimulation

Getting signals into the brain: visual prosthetics through thalamic microstimulation

The spatial receptive field of thalamic inputs to single cortical simple cells revealed by the interaction of visual and electrical stimulation