Functions of Learning Rate in Adaptive Reward Learning.
Reads0
Chats0
TLDR
It is found that, when human participants performed a reward learning task, reward magnitude modulated learning rate and this modulation was reflected in brain regions where the reward feedback is also encoded, such as the medial prefrontal cortex, precuneus, and posterior cingulate cortex.Abstract:
As a crucial cognitive function, learning applies prediction error (the discrepancy between the prediction from learning and the world state) to adjust predictions of the future. How much prediction error affects this adjustment also depends on the learning rate. Our understanding to the learning rate is still limited, in terms of (1) how it is modulated by other factors, and (2) the specific mechanisms of how learning rate interacts with prediction error to update learning. We applied computational modeling and functional magnetic resonance imaging to investigate these issues. We found that, when human participants performed a reward learning task, reward magnitude modulated learning rate. Modulation strength further predicted the difference in behavior following high vs. low reward across subjects. Imaging results further showed that this modulation was reflected in brain regions where the reward feedback is also encoded, such as the medial prefrontal cortex (MFC), precuneus, and posterior cingulate cortex. Furthermore, for the first time, we observed that the integration of the learning rate and the reward prediction error was represented in MFC activity. These findings extend our understanding of adaptive learning by demonstrating how it functions in a chain reaction of prediction updating.read more
Citations
More filters
Journal ArticleDOI
Strengthening risk prediction using statistical learning in children with autism spectrum disorder
Tanu,Deepti Kakkar +1 more
TL;DR: In this article, the authors investigated the prediction ability in children with ASD in the risk-involving situations and computed the impact of statistical learning (SL) in strengthening their risk knowledge.
Journal ArticleDOI
Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate.
Vijay Mohan K. Namboodiri,Taylor Hobbs,Ivan Trujillo-Pisanty,Rhiana C. Simon,Madelyn M. Gray,Garret D. Stuber +5 more
TL;DR: In this article, the authors demonstrate using two-photon calcium imaging and optogenetics in mice that certain functionally distinct subpopulations of ventral/medial orbitofrontal cortex (vmOFC) neurons signal learning rate control.
Journal ArticleDOI
Functional neural interactions during adaptive reward learning: An functional magnetic resonance imaging study
TL;DR: A reinforcement‐learning model with an adaptive learning rate and functional magnetic resonance imaging was applied to simulate the individual's reward‐learning behavior and the functional interactions of the whole brain under the experimental condition of reward were examined.
Journal ArticleDOI
A New Explanation for the Frog-in-the-Pan Phenomenon Based on the Cognitive-Evolutionary Model of Surprise
TL;DR: In this paper , a new explanation for the frog-in-the-pan (FIP) phenomenon could be explained by the elicitation of surprise emotion, which makes participants more sensitive to the change.
Journal ArticleDOI
Additively Combining Utilities and Beliefs: Research Gaps and Algorithmic Developments.
Anush Ghambaryan,Anush Ghambaryan,Boris Gutkin,Boris Gutkin,Vasily Klucharev,Etienne Koechlin +5 more
TL;DR: In this paper, a suboptimal strategy is proposed to combine reward magnitude and reward probability attributes of options for value-based decision making in complex environments, such as those with uncertain and volatile mapping of reward probabilities onto options, may engender computational strategies that are not necessarily optimal in terms of normative frameworks but may ensure effective learning and behavioral flexibility in conditions of limited neural computational resources.
References
More filters
Journal ArticleDOI
The Brain's Default Network Anatomy, Function, and Relevance to Disease
TL;DR: Past observations are synthesized to provide strong evidence that the default network is a specific, anatomically defined brain system preferentially active when individuals are not focused on the external environment, and for understanding mental disorders including autism, schizophrenia, and Alzheimer's disease.
Journal ArticleDOI
A Neural Substrate of Prediction and Reward
TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal Article
Spectral Analysis and Time Series
TL;DR: In this article, the authors introduce the concept of Stationary Random Processes and Spectral Analysis in the Time Domain and Frequency Domain, and present an analysis of Processes with Mixed Spectra.