Close to a transition between different phases a substance can show universal behavior that is independent of the microscopic details and is characterized by power law correlations and critical exponents. In this Colloquium the concepts of criticality and universality are discussed when applied to biological systems and suggest that in some cases these systems can extract functional advantages close to criticality.

Colloquium : Criticality and dynamical scaling in living systems

Bioinspired hardware holds the promise of low-energy, intelligent, and highly adaptable computing systems. Applications span from automatic classification for big data management, through unmanned vehicle control, to control for biomedical prosthesis. However, one of the major challenges of fabricating bioinspired hardware is building ultrahigh-density networks out of complex processing units interlinked by tunable connections. Nanometer-scale devices exploiting spin electronics (or spintronics) can be a key technology in this context. In particular, magnetic tunnel junctions (MTJs) are well suited for this purpose because of their multiple tunable functionalities. One such functionality, nonvolatile memory, can provide massive embedded memory in unconventional circuits, thus escaping the von-Neumann bottleneck arising when memory and processors are located separately. Other features of spintronic devices that could be beneficial for bioinspired computing include tunable fast nonlinear dynamics, controlled stochasticity, and the ability of single devices to change functions in different operating conditions. Large networks of interacting spintronic nanodevices can have their interactions tuned to induce complex dynamics such as synchronization, chaos, soliton diffusion, phase transitions, criticality, and convergence to multiple metastable states. A number of groups have recently proposed bioinspired architectures that include one or several types of spintronic nanodevices. In this paper, we show how spintronics can be used for bioinspired computing. We review the different approaches that have been proposed, the recent advances in this direction, and the challenges toward fully integrated spintronics complementary metal–oxide–semiconductor (CMOS) bioinspired hardware.

/pdf/spintronic-nanodevices-for-bioinspired-computing-1marhe96x1.pdf

Spintronic Nanodevices for Bioinspired Computing

The rapid development of information technology has led to urgent requirements for high efficiency and ultralow power consumption. In the past few decades, neuromorphic computing has drawn extensive attention due to its promising capability in processing massive data with extremely low power consumption. Here, we offer a comprehensive review on emerging artificial neuromorphic devices and their applications. In light of the inner physical processes, we classify the devices into nine major categories and discuss their respective strengths and weaknesses. We will show that anion/cation migration-based memristive devices, phase change, and spintronic synapses have been quite mature and possess excellent stability as a memory device, yet they still suffer from challenges in weight updating linearity and symmetry. Meanwhile, the recently developed electrolyte-gated synaptic transistors have demonstrated outstanding energy efficiency, linearity, and symmetry, but their stability and scalability still need to be optimized. Other emerging synaptic structures, such as ferroelectric, metal–insulator transition based, photonic, and purely electronic devices also have limitations in some aspects, therefore leading to the need for further developing high-performance synaptic devices. Additional efforts are also demanded to enhance the functionality of artificial neurons while maintaining a relatively low cost in area and power, and it will be of significance to explore the intrinsic neuronal stochasticity in computing and optimize their driving capability, etc. Finally, by looking into the correlations between the operation mechanisms, material systems, device structures, and performance, we provide clues to future material selections, device designs, and integrations for artificial synapses and neurons.

A comprehensive review on emerging artificial neuromorphic devices

Criticality in the brain: A synthesis of neurobiology, models and cognition.

The brain is characterized by heterogeneous patterns of structural connections supporting unparalleled feats of cognition and a wide range of behaviours. New non-invasive imaging techniques now allow comprehensive mapping of these patterns. However, a fundamental challenge remains to understand how the brain’s structural wiring supports cognitive processes, with major implications for personalized mental health treatments. Here, we review recent efforts to meet this challenge, drawing on physics intuitions, models and theories, spanning the domains of statistical mechanics, information theory, dynamical systems and control. We first describe the organizing principles of brain network architecture instantiated in structural wiring under constraints of spatial embedding and energy minimization. We then survey models of brain network function that stipulate how neural activity propagates along structural connections. Finally, we discuss perturbative experiments and models for brain network control; these use the physics of signal transmission along structural connections to infer intrinsic control processes that support goal-directed behaviour and to inform stimulation-based therapies for neurological and psychiatric disease. Throughout, we highlight open questions that invite the creative efforts of pioneering physicists. The brain is the quintessential complex system, boasting incredible feats of cognition and supporting a wide range of behaviours. Physics has much to offer in the quest to distil the brain’s complexity to a number of cogent organizing principles.

The physics of brain network structure, function and control

Sensory nervous systems adapt to their environment—a mechanism thought to ensure network dynamics remain critical. Visual cortex experiments show that adaptation maintains criticality even as sensory input drives the system away from this regime. A long-standing hypothesis at the interface of physics and neuroscience is that neural networks self-organize to the critical point of a phase transition, thereby optimizing aspects of sensory information processing1,2,3. This idea is partially supported by strong evidence for critical dynamics observed in the cerebral cortex4,5,6,7,8,9,10, but the impact of sensory input on these dynamics is largely unknown. Thus, the foundations of this hypothesis—the self-organization process and how it manifests during strong sensory input—remain unstudied experimentally. Here we show in visual cortex and in a computational model that strong sensory input initially elicits cortical network dynamics that are not critical, but adaptive changes in the network rapidly tune the system to criticality. This conclusion is based on observations of multifaceted scaling laws predicted to occur at criticality4,11. Our findings establish sensory adaptation as a self-organizing mechanism that maintains criticality in visual cortex during sensory information processing.

/pdf/adaptation-to-sensory-input-tunes-visual-cortex-to-5edy18lfgo.pdf

Adaptation to sensory input tunes visual cortex to criticality

Mounting evidence supports the hypothesis that the cortex operates near a critical state, defined as the transition point between order (large-scale activity) and disorder (small-scale activity). This criticality is manifested by power law distribution of the size and duration of spontaneous cascades of activity, which are referred as neuronal avalanches. The existence of such neuronal avalanches has been confirmed by several studies both in vitro and in vivo, among different species and across multiple spatial scales. However, despite the prevalence of scale free activity, still very little is known concerning whether and how the scale-free nature of cortical activity is altered during external stimulation. To address this question, we performed in vivo two-photon population calcium imaging of layer 2/3 neurons in primary visual cortex of behaving mice during visual stimulation and conducted statistical analyses on the inferred spike trains. Our investigation for each mouse and condition revealed power law distributed neuronal avalanches, and irregular spiking individual neurons. Importantly, both the avalanche and the spike train properties remained largely unchanged for different stimuli, while the cross-correlation structure varied with stimuli. Our results establish that microcircuits in the visual cortex operate near the critical regime, while rearranging functional connectivity in response to varying sensory inputs.

/pdf/neocortical-activity-is-stimulus-and-scale-invariant-12czsplsg0.pdf

Neocortical activity is stimulus- and scale-invariant.

The Wilson–Cowan equations represent a landmark in the history of computational neuroscience. Along with the insights Wilson and Cowan offered for neuroscience, they crystallized an approach to mod...

https://journals.physiology.org/doi/pdf/10.1152/jn.00404.2019

Before and beyond the Wilson-Cowan equations.

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population activity. Mounting evidence suggests that neural networks of cerebral cortex operate at a critical regime, which is defined as a transition point between two phases of short lasting and chaotic activity. However, despite the fact that criticality brings about certain functional advantages for information processing, its supporting evidence is still far from conclusive, as it has been mostly based on power law scaling of size and durations of cascades of activity. Moreover, to what degree such hypothesis could explain some fundamental features of neural activity is still largely unknown. One of the most prevalent features of cortical activity in vivo is known to be spike irregularity of spike trains, which is measured in terms of the coefficient of variation (CV) larger than one. Here, using a minimal computational model of excitatory nodes, we show that irregular spiking (CV > 1) naturally emerges in a recurrent network operating at criticality. More importantly, we show that even at the presence of other sources of spike irregularity, being at criticality maximizes the mean coefficient of variation of neurons, thereby maximizing their spike irregularity. Furthermore, we also show that such a maximized irregularity results in maximum correlation between neuronal firing rates and their corresponding spike irregularity (measured in terms of CV). On the one hand, using a model in the universality class of directed percolation, we propose new hallmarks of criticality at single-unit level, which could be applicable to any network of excitable nodes. On the other hand, given the controversy of the neural criticality hypothesis, we discuss the limitation of this approach to neural systems and to what degree they support the criticality hypothesis in real neural networks. Finally, we discuss the limitations of applying our results to real networks and to what degree they support the criticality hypothesis.

/pdf/criticality-predicts-maximum-irregularity-in-recurrent-2duy2ex3u7.pdf

Criticality predicts maximum irregularity in recurrent networks of excitatory nodes

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population activity. Mounting evidence suggests that neural networks of cerebral cortex operate at criticality. How operating near this network state impacts the variability of neuronal spiking is largely unknown. Here we show in a computational model that two prevalent features of cortical single-neuron activity, irregular spiking and the decline of response variability at stimulus onset, are both emergent properties of a recurrent network operating near criticality. Importantly, our work reveals that the relation between the irregularity of spiking and the number of input connections to a neuron, i.e., the in-degree, is maximized at criticality. Our findings establish criticality as a unifying principle for the variability of single-neuron spiking and the collective behavior of recurrent circuits in cerebral cortex.

Yahya Karimipanah

Papers

Adaptation to sensory input tunes visual cortex to criticality

Neocortical activity is stimulus- and scale-invariant.

Before and beyond the Wilson-Cowan equations.

Criticality predicts maximum irregularity in recurrent networks of excitatory nodes

New hallmarks of criticality in recurrent neural networks