scispace - formally typeset
Search or ask a question

Showing papers by "John M. Beggs published in 2010"


Journal ArticleDOI
13 Jan 2010-Entropy
TL;DR: How maximum entropy models have been applied to neuronal ensemble data to account for spatial and temporal correlations is reviewed and criticisms of the maximum entropy approach are discussed that argue that it is not generally applicable to larger ensembles of neurons.
Abstract: Understanding how ensembles of neurons collectively interact will be a key step in developing a mechanistic theory of cognitive processes. Recent progress in multineuron recording and analysis techniques has generated tremendous excitement over the physiology of living neural networks. One of the key developments driving this interest is a new class of models based on the principle of maximum entropy. Maximum entropy models have been reported to account for spatial correlation structure in ensembles of neurons recorded from several different types of data. Importantly, these models require only information about the firing rates of individual neurons and their pairwise correlations. If this approach is generally applicable, it would drastically simplify the problem of understanding how neural networks behave. Given the interest in this method, several groups now have worked to extend maximum entropy models to account for temporal correlations. Here, we review how maximum entropy models have been applied to neuronal ensemble data to account for spatial and temporal correlations. We also discuss criticisms of the maximum entropy approach that argue that it is not generally applicable to larger ensembles of neurons. We conclude that future maximum entropy models will need to address three issues: temporal correlations, higher-order correlations, and larger ensemble sizes. Finally, we provide a brief list of topics for future research.

50 citations


Journal ArticleDOI
TL;DR: The authors found that some human tissue removed from epilepsy patients exhibited prolonged periods of hyperactivity not seen in rat slices, and found a positive correlation between the branching parameter, a measure of network gain, and firing rate in human slices during periods ofhyperactivity.
Abstract: :Some forms of epilepsy may arise as a result of pathologic interactions among neurons. Many forms of collective activity have been identified, including waves, spirals, oscillations, synchrony, and neuronal avalanches. All these emergent activity patterns have been hypothesized to show path

48 citations


Journal ArticleDOI
TL;DR: In this paper, the authors compare stable activity patterns from cortical slice networks recorded with multielectrode arrays to stable patterns produced by a model with a tunable weight distribution, and conclude that local cortical networks are very likely to use a highly skewed weight distribution to optimize information retention.
Abstract: How living neural networks retain information is still incompletely understood. Two prominent ideas on this topic have developed in parallel, but have remained somewhat unconnected. The first of these, the "synaptic hypothesis," holds that information can be retained in synaptic connection strengths, or weights, between neurons. Recent work inspired by statistical mechanics has suggested that networks will retain the most information when their weights are distributed in a skewed manner, with many weak weights and only a few strong ones. The second of these ideas is that information can be represented by stable activity patterns. Multineuron recordings have shown that sequences of neural activity distributed over many neurons are repeated above chance levels when animals perform well-learned tasks. Although these two ideas are compelling, no one to our knowledge has yet linked the predicted optimum distribution of weights to stable activity patterns actually observed in living neural networks. Here, we explore this link by comparing stable activity patterns from cortical slice networks recorded with multielectrode arrays to stable patterns produced by a model with a tunable weight distribution. This model was previously shown to capture central features of the dynamics in these slice networks, including neuronal avalanche cascades. We find that when the model weight distribution is appropriately skewed, it correctly matches the distribution of repeating patterns observed in the data. In addition, this same distribution of weights maximizes the capacity of the network model to retain stable activity patterns. Thus, the distribution that best fits the data is also the distribution that maximizes the number of stable patterns. We conclude that local cortical networks are very likely to use a highly skewed weight distribution to optimize information retention, as predicted by theory. Fixed distributions impose constraints on learning, however. The network must have mechanisms for preserving the overall weight distribution while allowing individual connection strengths to change with learning.

39 citations