Neural constraints on learning
Patrick T. Sadtler,Kristin M. Quick,Matthew D. Golub,Steven M. Chase,Stephen I. Ryu,Elizabeth C. Tyler-Kabara,Byron M. Yu,Aaron P. Batista +7 more
Reads0
Chats0
TLDR
The results suggest that the existing structure of a network can shape learning, and offer a network-level explanation for the observation that the authors are more readily able to learn new skills when they are related to the skills that they already possess.Abstract:
Learning, whether motor, sensory or cognitive, requires networks of neurons to generate new activity patterns. As some behaviours are easier to learn than others, we asked if some neural activity patterns are easier to generate than others. Here we investigate whether an existing network constrains the patterns that a subset of its neurons is capable of exhibiting, and if so, what principles define this constraint. We employed a closed-loop intracortical brain-computer interface learning paradigm in which Rhesus macaques (Macaca mulatta) controlled a computer cursor by modulating neural activity patterns in the primary motor cortex. Using the brain-computer interface paradigm, we could specify and alter how neural activity mapped to cursor velocity. At the start of each session, we observed the characteristic activity patterns of the recorded neural population. The activity of a neural population can be represented in a high-dimensional space (termed the neural space), wherein each dimension corresponds to the activity of one neuron. These characteristic activity patterns comprise a low-dimensional subspace (termed the intrinsic manifold) within the neural space. The intrinsic manifold presumably reflects constraints imposed by the underlying neural circuitry. Here we show that the animals could readily learn to proficiently control the cursor using neural activity patterns that were within the intrinsic manifold. However, animals were less able to learn to proficiently control the cursor using activity patterns that were outside of the intrinsic manifold. These results suggest that the existing structure of a network can shape learning. On a timescale of hours, it seems to be difficult to learn to generate neural activity patterns that are not consistent with the existing network structure. These findings offer a network-level explanation for the observation that we are more readily able to learn new skills when they are related to the skills that we already possess.read more
Citations
More filters
Journal ArticleDOI
Dimensionality reduction for large-scale neural recordings.
John P. Cunningham,Byron M. Yu +1 more
TL;DR: This review examines three important motivations for population studies: single-trial hypotheses requiring statistical power, hypotheses of population response structure and exploratory analyses of large data sets, and practical advice about selecting methods and interpreting their outputs.
Journal ArticleDOI
Inferring single-trial neural population dynamics using sequential auto-encoders.
Chethan Pandarinath,Daniel J. O’Shea,Jasmine Collins,Rafal Jozefowicz,Rafal Jozefowicz,Sergey D. Stavisky,Jonathan C. Kao,Jonathan C. Kao,Eric M. Trautmann,Matthew T. Kaufman,Matthew T. Kaufman,Stephen I. Ryu,Stephen I. Ryu,Leigh R. Hochberg,Jaimie M. Henderson,Krishna V. Shenoy,Larry F. Abbott,David Sussillo,David Sussillo +18 more
TL;DR: LFADS, a deep learning method for analyzing neural population activity, can extract neural dynamics from single-trial recordings, stitch separate datasets into a single model, and infer perturbations, for example, from behavioral choices to these dynamics.
Journal ArticleDOI
Speech synthesis from neural decoding of spoken sentences
TL;DR: A neural decoder that explicitly leverages kinematic and sound representations encoded in human cortical activity to synthesize audible speech, which is readily identified and transcribed by listeners and could synthesize speech when a participant silently mimed sentences.
Journal ArticleDOI
Toward an Integration of Deep Learning and Neuroscience.
TL;DR: In this paper, the authors argue that a range of implementations of credit assignment through multiple layers of neurons are compatible with our current knowledge of neural circuitry, and that the brain's specialized systems can be interpreted as enabling efficient optimization for specific problem classes.
Journal ArticleDOI
Robust neuronal dynamics in premotor cortex during motor planning
TL;DR: It is shown that preparatory activity is remarkably robust to large-scale unilateral silencing: detailed neural dynamics that drive specific future movements were quickly and selectively restored by the network.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Journal ArticleDOI
The information capacity of the human motor system in controlling the amplitude of movement.
TL;DR: The motor system in the present case is defined as including the visual and proprioceptive feedback loops that permit S to monitor his own activity, and the information capacity of the motor system is specified by its ability to produce consistently one class of movement from among several alternative movement classes.
Journal ArticleDOI
Cortical control of a prosthetic arm for self-feeding
Meel Velliste,Sagi Perel,Sagi Perel,M. Chance Spalding,M. Chance Spalding,Andrew S. Whitford,Andrew S. Whitford,Andrew B. Schwartz +7 more
TL;DR: A system that permits embodied prosthetic control is described and monkeys (Macaca mulatta) use their motor cortical activity to control a mechanized arm replica in a self-feeding task, and this demonstration of multi-degree-of-freedom embodied prosthetics control paves the way towards the development of dexterous prosthetic devices that could ultimately achieve arm and hand function at a near-natural level.
Journal ArticleDOI
Error Correction, Sensory Prediction, and Adaptation in Motor Control
TL;DR: Evidence shows that forward models remain calibrated through motor adaptation: learning driven by sensory prediction errors, and is used to produce a lifetime of calibrated movements.
Journal ArticleDOI
Context-dependent computation by recurrent dynamics in prefrontal cortex
TL;DR: This work studies prefrontal cortex activity in macaque monkeys trained to flexibly select and integrate noisy sensory inputs towards a choice, and finds that the observed complexity and functional roles of single neurons are readily understood in the framework of a dynamical process unfolding at the level of the population.