Humans integrate visual and haptic information in a statistically optimal fashion.
TL;DR: The nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator, and this model behaved very similarly to humans in a visual–haptic task.
Abstract: When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position, but in some circumstances the percept is clearly affected by haptics. Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Citations
More filters
TL;DR: This target article critically examines this "hierarchical prediction machine" approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action.
Abstract: Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to adaptive success. This target article critically examines this "hierarchical prediction machine" approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency.
3,640 citations
Cites background from "Humans integrate visual and haptic ..."
...…doing so in ways that delicately and responsively reflect the current (context-dependent) levels of uncertainty associated with the information from different channels (Ernst and Banks (2002), Knill and Pouget (2004) – and for further discussion, see Mamassian et al (2002), Rescorla (In Press))....
[...]
TL;DR: How noise affects neuronal networks and the principles the nervous system applies to counter detrimental effects of noise are highlighted, and noise's potential benefits are discussed.
Abstract: Noise — random disturbances of signals — poses a fundamental problem for information processing and affects all aspects of nervous-system function. However, the nature, amount and impact of noise in the nervous system have only recently been addressed in a quantitative manner. Experimental and computational methods have shown that multiple noise sources contribute to cellular and behavioural trial-to-trial variability. We review the sources of noise in the nervous system, from the molecular to the behavioural level, and show how noise contributes to trial-to-trial variability. We highlight how noise affects neuronal networks and the principles the nervous system applies to counter detrimental effects of noise, and briefly discuss noise's potential benefits.
2,350 citations
TL;DR: A major challenge for neuroscientists is to test ideas for how this might be achieved in populations of neurons experimentally, and so determine whether and how neurons code information about sensory uncertainty.
2,067 citations
TL;DR: This work shows that subjects internally represent both the statistical distribution of the task and their sensory uncertainty, combining them in a manner consistent with a performance-optimizing bayesian process.
Abstract: When we learn a new motor skill, such as playing an approaching tennis ball, both our sensors and the task possess variability. Our sensors provide imperfect information about the ball's velocity, so we can only estimate it. Combining information from multiple modalities can reduce the error in this estimate. On a longer time scale, not all velocities are a priori equally probable, and over the course of a match there will be a probability distribution of velocities. According to bayesian theory, an optimal estimate results from combining information about the distribution of velocities-the prior-with evidence from sensory feedback. As uncertainty increases, when playing in fog or at dusk, the system should increasingly rely on prior knowledge. To use a bayesian strategy, the brain would need to represent the prior distribution and the level of uncertainty in the sensory feedback. Here we control the statistical variations of a new sensorimotor task and manipulate the uncertainty of the sensory feedback. We show that subjects internally represent both the statistical distribution of the task and their sensory uncertainty, combining them in a manner consistent with a performance-optimizing bayesian process. The central nervous system therefore employs probabilistic models during sensorimotor learning.
1,811 citations
Cites methods from "Humans integrate visual and haptic ..."
...On each trial one of four types of feedback (j0, jM, jL, j1) was displayed; the selection of the feedback was random, with the relative frequencies of the four types being (3, 1, 1, 1) respectively....
[...]
TL;DR: It is shown that human subjects assess volatility in an optimal manner and adjust decision-making accordingly, and this optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex when each trial outcome is observed.
Abstract: Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
1,728 citations
Additional excerpts
...Error (0) and rewarded (1) trials 0 1,000 2,000 3,000...
[...]
...Stay (0) or switch (1) trials 0 50 100...
[...]
References
More filters
TL;DR: The large ecological and societal consequences of changing biodiversity should be minimized to preserve options for future solutions to global environmental problems.
Abstract: Human alteration of the global environment has triggered the sixth major extinction event in the history of life and caused widespread changes in the global distribution of organisms. These changes in biodiversity alter ecosystem processes and change the resilience of ecosystems to environmental change. This has profound consequences for services that humans derive from ecosystems. The large ecological and societal consequences of changing biodiversity should be minimized to preserve options for future solutions to global environmental problems.
3,977 citations
TL;DR: Functional composition and functional diversity were the principal factors explaining plant productivity, plant percent nitrogen, plant total nitrogen, and light penetration in grassland plots.
Abstract: Humans are modifying both the identities and numbers of species in ecosystems, but the impacts of such changes on ecosystem processes are controversial. Plant species diversity, functional diversity, and functional composition were experimentally varied in grassland plots. Each factor by itself had significant effects on many ecosystem processes, but functional composition and functional diversity were the principal factors explaining plant productivity, plant percent nitrogen, plant total nitrogen, and light penetration. Thus, habitat modifications and management practices that change functional diversity and functional composition are likely to have large impacts on ecosystem processes.
2,762 citations
TL;DR: The selection effect is zero on average and varies from negative to positive in different localities, depending on whether species with lower- or higher-than-average biomass dominate communities, while the complementarity effect is positive overall, supporting the hypothesis that plant diversity influences primary production in European grasslands through niche differentiation or facilitation.
Abstract: The impact of biodiversity loss on the functioning of ecosystems and their ability to provide ecological services has become a central issue in ecology. Several experiments have provided evidence that reduced species diversity may impair ecosystem processes such as plant biomass production. The interpretation of these experiments, however, has been controversial because two types of mechanism may operate in combination. In the 'selection effect', dominance by species with particular traits affects ecosystem processes. In the 'complementarity effect', resource partitioning or positive interactions lead to increased total resource use. Here we present a new approach to separate the two effects on the basis of an additive partitioning analogous to the Price equation in evolutionary genetics. Applying this method to data from the pan-European BIODEPTH experiment reveals that the selection effect is zero on average and varies from negative to positive in different localities, depending on whether species with lower- or higher-than-average biomass dominate communities. In contrast, the complementarity effect is positive overall, supporting the hypothesis that plant diversity influences primary production in European grasslands through niche differentiation or facilitation.
2,502 citations
TL;DR: It is argued that engineering has both negative and positive effects on species richness and abundances at small scales, but the net effects are probably positive at larger scales encompassing engineered and nonengineered environments in ecological and evolutionary space and time.
Abstract: Physical ecosystem engineers are organisms that directly or indirectly control the availability of resources to other organisms by causing physical state changes in biotic or abiotic materials. Physical ecosystem engineering by organisms is the physical modification, maintenance, or creation of habitats. Ecological effects of engineers on many other species occur in virtually all ecosystems because the physical state changes directly create nonfood resources such as living space, directly control abiotic resources, and indirectly modulate abiotic forces that, in turn, affect resource use by other organisms. Trophic interactions and resource competition do not constitute engineering. Engineering can have significant or trivial effects on other species, may involve the physical structure of an organism (like a tree) or structures made by an organism (like a beaver dam), and can, but does not invariably, have feedback effects on the engineer. We argue that engineering has both negative and positive effects on species richness and abundances at small scales, but the net effects are probably positive at larger scales encompassing engineered and nonengineered environments in ecological and evolutionary space and time. Models of the population dynamics of engineers suggest that the engineer/habitat equilibrium is often, but not always, locally stable and may show long-term cycles, with potential ramifications for community and ecosystem stability. As yet, data adequate to parameterize such a model do not exist for any engineer species. Because engineers control flows of energy and materials but do not have to participate in these flows, energy, mass, and stoichiometry do not appear to be useful in predicting which engineers will have big effects. Empirical observations suggest some potential generalizations about which species will be important engineers in which ecosystems. We point out some of the obvious, and not so obvious, ways in which engineering and trophic relations interact, and we call for greater research on physical ecosystem engineers, their impacts, and their interface with trophic relations.
2,163 citations
TL;DR: These results help resolve debate over biodiversity and ecosystem functioning, show effects at higher than expected diversity levels, and demonstrate, for these ecosystems, that even the best-chosen monocultures cannot achieve greater productivity or carbon stores than higher-diversity sites.
Abstract: Plant diversity and niche complementarity had progressively stronger effects on ecosystem functioning during a 7-year experiment, with 16-species plots attaining 2.7 times greater biomass than monocultures. Diversity effects were neither transients nor explained solely by a few productive or unviable species. Rather, many higher-diversity plots outperformed the best monoculture. These results help resolve debate over biodiversity and ecosystem functioning, show effects at higher than expected diversity levels, and demonstrate, for these ecosystems, that even the best-chosen monocultures cannot achieve greater productivity or carbon stores than higher-diversity sites.
2,091 citations