Making Sense of Real-World Scenes.

Successful decision making critically involves metacognitive processes such as monitoring and control of our decision process. Metacognition enables agents to modify ongoing behavior adaptively and determine what to do next in situations in which external feedback is not (immediately) available. Despite the importance of metacognition for many aspects of life, little is known about how our metacognitive system operates or about what kind of information is used for metacognitive (second-order) judgments. In particular, it remains an open question whether metacognitive judgments are based on the same information as first-order decisions. Here, we investigated the relationship between metacognitive performance and first-order task performance by recording EEG signals while participants were asked to make a “diagnosis” after seeing a sample of fictitious patient data (a complex pattern of colored moving dots of different sizes). To assess metacognitive performance, participants provided an estimate about the quality of their diagnosis on each trial. Results demonstrate that the information that contributes to first-order decisions differs from the information that supports metacognitive judgments. Further, time–frequency analyses of EEG signals reveal that metacognitive performance is associated specifically with prefrontal theta-band activity. Together, our findings are consistent with a hierarchical model of metacognition and suggest a crucial role for prefrontal oscillations in metacognitive performance. SIGNIFICANCE STATEMENT Monitoring and control of our decision process (metacognition) is a crucial aspect of adaptive decision making. Crucially, metacognitive skills enable us to adjust ongoing behavior and determine future decision making when immediate feedback is not available. In the present study, we constructed a “diagnosis task” that allowed us to assess in what way first-order task performance and metacognition are related to each other. Results demonstrate that the contribution of sensory evidence (size, color, and motion direction) differs between first- and second-order decision making. Further, our results indicate that metacognitive performance specifically is orchestrated by means of prefrontal theta oscillations. Together, our findings suggest a hierarchical model of metacognition.

https://www.jneurosci.org/content/jneuro/37/4/781.full.pdf

Sure I'm Sure: Prefrontal Oscillations Support Metacognitive Monitoring of Decision Making

Affordances, i.e. the opportunity of actions offered by the environment, are one of the central research topics for the theoretical perspectives that view cognition as emerging from the interaction between the environment and the body. Being at the bridge between perception and action, affordances help to question a dichotomous view of perception and action. While Gibson’s view of affordances is mainly externalist, many contemporary approaches define affordances (and micro-affordances) as the product of long-term visuomotor associations in the brain. These studies have emphasized the fact that affordances are activated automatically, independently from the context and the previous intention to act: for example, affordances related to objects’ size would emerge even if the task does not require focusing on size. This emphasis on the automaticity of affordances has led to overlook their flexibility and contextual-dependency. In this contribution I will outline and discuss recent perspectives and evidence that reveal the flexibility and context-dependency of affordances, clarifying how they are modulated by the physical, cultural and social context. I will focus specifically on social affordances, i.e. on how perception of affordances might be influenced by the presence of multiple actors having different goals.

/pdf/affordances-context-and-sociality-2ckvem5clr.pdf

Affordances, context and sociality

Recent research has shown that the sensorimotor system plays a significant role in a variety of cognitive processes. In this paper, we will review recent studies performed in our lab (Body Action Language Lab, BALLAB) or in labs with which we collaborate, showing the involvement of the sensorimotor system at different levels. With the purpose of expounding on this aspect, we focus on studies that highlight two main characteristics of the involvement of the sensorimotor systems. First, we concentrate on the flexibility of sensorimotor grounding during interaction with objects. We report evidence showing how social context and current situations influence affordance activation. We then focus on the tactile and kinesthetic involvement in body-object interaction. Second, we illustrate flexible sensorimotor grounding in word use. We review studies showing that not only concrete words, like “bottle,” but also abstract words, like “freedom,” “thinking,” and “perhaps,” are grounded in the sensorimotor system. We report evidence showing that abstract words activate sensory modalities and involve the mouth effector more than concrete words due to their privileged relationship with language, both outer and inner speech. We discuss the activation of the mouth sensorimotor system in light of studies on adults (e.g., studies employing articulatory suppression), children (e.g., studies on the effects of pacifier use on word acquisition and processing), and infants (e.g. studies on emergence of new words). Finally, we pinpoint possible mechanisms at play in the acquisition and use of abstract concepts. We argue that with abstract concepts, we rely more on other people to learn or negotiate the meaning of words; we have called this mechanism social metacognition.Social metacognition is bidirectionally linked to our sensorimotor system. On the one hand, linguistic explanations constitute a primary source of grounding that may be re-enacted when retrieving a concept, for example through inner speech. On the other hand, it leads us to feel closer and be more synchronous in movement with others, who can help us understand the meaning of very complex words. Overall, we show that the sensorimotor system provides a grounding basis not only for objects and concrete words but also for more abstract and concrete ones. We conclude by arguing that future research should address and deepen two different and interrelated aspects concerning the involvement of the sensorimotor system during object and word processing. First, the sensorimotor system is flexibly modulated by the context, as studies on affordances reveal. Second, the sensorimotor system can be involved at different levels, and its role can be integrated and flanked by that of other systems, like the linguistic one, as studies on abstract concepts clearly show. We urge future research aimed at unravelling the role of the sensorimotor system in cognition to fully explore the complexity of this intricate-and sometimes slippery-relation.

/pdf/from-affordances-to-abstract-words-the-flexibility-of-the-3yau6tl97t.pdf

From Affordances to Abstract Words: The Flexibility of the Sensorimotor Grounding

Metacognitive abilities allow us to adjust ongoing behavior and modify future decisions in the absence of external feedback. Although metacognition is critical in many daily life settings, it remains unclear what information is actually being monitored and what kind of information is being used for metacognitive decisions. In the present study, we investigated whether response information connected to perceptual events contribute to metacognitive decision-making. Therefore, we recorded EEG signals during a perceptual color discrimination task while participants were asked to provide an estimate about the quality of their decision on each trial. Critically, the moment participants provided their confidence judgments varied across conditions, thereby changing the amount of action information (e.g., response competition or response fluency) available for metacognitive decisions. Results from three experiments demonstrate that metacognitive performance improved when first-order action information was available at the moment metacognitive decisions about the perceptual task had to be provided. This behavioral effect was accompanied by enhanced functional connectivity (beta phase synchrony) between motor areas and prefrontal regions, exclusively observed during metacognitive decision-making. Our findings demonstrate that action information contributes to metacognitive decision-making, thereby painting a picture of metacognition as a process that integrates sensory evidence and information about our interactions with the world.

/pdf/action-information-contributes-to-metacognitive-decision-2s652nk6mm.pdf

Aisha Fouad

Papers

Conflict in the kitchen: Contextual modulation of responsiveness to affordances