Online evaluation of novel choices by simultaneous representation of multiple memories
Summary (3 min read)
Deciding between novel goods
- Each good was a novel combination of two different familiar foods (Fig. 1a ).
- Participants were given the opportunity to observe these novel goods without being allowed to sample them by either taste or smell.
- This involvement accords with recent evidence that vmPFC encodes value preference for executable choices and dmPFC does so for choices that are modeled abstractly 7 .
- Thus, their only recourse was to construct, online, an expectation of the compound's value from knowledge of the individual components.
- A key question is whether subjects constructed a novel representation of the compound by explicitly combining the representations of each component and, if so, which brain regions support this construction process.
Constructing representations of novel goods using memories
- Participants trained extensively on these associations between food items and abstract shapes.
- The key comparison of interest here was the brain activity elicited by novel goods when preceded by related components (for example, A or B followed by AB) compared with novel goods when preceded by unrelated components (for example, C or D followed by AB).
- The authors result implies that these brain regions construct a value representation of a novel item from component memories, and do so by simultaneously engaging neuronal representations of these components.
Plasticity between simultaneously active memories
- If this is the case then it follows that during the construction of the compound good AB, the neuronal ensembles representing components A and B should be simultaneously active.
- This can also be tested using fMRI adaptation, which predicts a differential effect for components that were part of the same compound compared with components that were not.
- This suggests that the mechanism underlying this suppression occurred during the earlier construction of the novel good and not during the participant's elicitation of the component item at the time that this signal was measured.
- It is important to note that these three de facto tests of mPFC function (valuation, construction and plasticity) do not rely on the same data.
- MPFC can therefore evaluate novel goods by constructing explicit representations of expected outcomes from familiar components, a process that engenders plasticity between simultaneously active component representations.
The influence of sensory experience upon construction
- The authors then asked whether consummatory exposure to the novel goods would reduce a need to construct value online.
- Any difference between the two groups in the representation or evaluation of novel goods could therefore be attributed to the effect of sensory exposure.
- In both groups, the neural activity observed in mPFC was consistent with a role for this brain region in the evaluation of compound goods (Fig. 3b,c ).
- To determine whether this single experience was enough to reduce a need for online value construction, the authors compared adaptation effects across the two groups.
- To avoid selection bias, the authors used ROIs derived from whole-brain adaptation effects averaged across both adaptation contrasts in the two groups (Online Methods and Fig. 4a,b ).
Temporal dynamics of construction mechanism
- If experiential and constructed valuation use distinct neural mechanisms, it is possible that the value construction mechanism could itself substitute for a direct experience and train experiential valuation mechanisms.
- As the experiment progressed, subjects gained substantial experience in constructing the representation of the novel good.
- As their experiment extended over three separate blocks, the authors were able to study changes in value construction-related adaptation effects over time (Figs. 5 and 6 ).
- This was not true for components that had been used to construct high-value novel goods.
- When averaging across the final two blocks, both the mPFC and hippocampus showed a significant positive correlation with the value of the compound items (mPFC, r = 0.64, P = 0.002; hippocampus, r = 0.63, P = 0.003, Fig. 6b,d and Supplementary Fig. 5 ), after accounting for variance explained by the value of the component items in both cases.
DISCUSSION
- The neural mechanisms by which these processes are achieved have remained unclear, particularly in circumstances in which anticipated outcomes have not previously been experienced.
- Rather, the most plausible explanation for this change is that, through repeated representation of a novel compound, previously unrelated memories were recruited simultaneously, inducing a form of plasticity between the underlying representations of necessary components.
- If subjects are asked to ignore all of their own experiences and preferences and to instead guess what a very different individual would choose, mPFC value signals can immediately reflect the preferences of this new individual 7, 38 .
- These findings show that a potential new experience can be prospectively represented and evaluated by invoking multiple memories simultaneously in hippocampus and mPFC.
METHODS
- Methods and any associated references are available in the online version of the paper.
- Any Supplementary Information and Source Data files are available in the online version of the paper, also known as Note.
ONLINE METHODS
- 39 healthy volunteers participated in the fMRI experiment and were assigned to one of two groups (unfamiliar and familiar) by drawing from Matlab's pseudo-random number generator.
- The experimenter chose two novel goods, AB and CD, for each participant, under the constraint that the participant liked all four individual component foods (A and B, C and D) from which the two novel goods were formed.
- The trials were sorted into seven principal categories with 32 trials of each category per scan session, presented in a randomized order.
- Preprocessing and statistical analyses were carried out using SPM8 (Wellcome Trust Centre for Neuroimaging, http://www.fil.ion.ucl.ac.uk/spm).
- To detect brain regions involved in constructing the novel goods (component to compound), the authors used the contrast [(AB preceded by C) − (AB preceded by A)], averaging across all possible permutations (that is, explanatory variables (2) − ( 1)).
Did you find this useful? Give us your feedback
Citations
575 citations
539 citations
Cites background from "Online evaluation of novel choices ..."
...Indeed, when subjects imagine the taste of a new food that they have never experienced but is constructed from known ingredients (such as Tea-Jelly), both regions show evidence that cellular ensembles for the ingredients are active simultaneously (Barron et al., 2013)....
[...]
360 citations
330 citations
Cites background from "Online evaluation of novel choices ..."
...Similar activations have been reported nearby (10, 29, 30)....
[...]
...A dorsal medial frontal area in humans, area 9, was linked to decision making when the outcome had to be imagined or modeled in some way (30, 40), and its activity coupling pattern resembled area 9 (79) in the monkey medial frontal cortex....
[...]
...Area 9’s coupling pattern resembled that of the area linked to imagination of other peoples’ values and unexperienced rewards (30, 40) (Fig....
[...]
...A region near area 14m has been linked to decisions or attentional selection of choices (21, 23, 29, 30)....
[...]
...A similar region was active when people imagined howmuch they would like new and unexperienced food items that were nevertheless composed of familiar components (30)....
[...]
310 citations
References
5,735 citations
2,426 citations
2,185 citations
2,171 citations
1,743 citations
Related Papers (5)
Frequently Asked Questions (13)
Q2. What have the authors stated for future works in "Online evaluation of novel choices by simultaneous representation of multiple memories" ?
Whereas the teaching signal provided to a habitual system replicates, or fine tunes, previous sensory experience, the teaching signal provided to a goal-directed system may establish an internal model of the future world by repeated imagination of a novel experience. This value dependence effect suggests that the representations of the component memories were simultaneously present during valuation of the novel compounds. Their data suggest that mPFC can combine previous experiences to construct prospective outcomes de novo on each trial and can then evaluate these constructed outcomes. Consistent with the proposed function of memory in prospective inference44,45, the formation of associative links46,47 and constructive episodic simulation48,49, their data suggest that hippocampal activity can also have an active role in constructing de novo experiences in non-spatial contexts.
Q3. What is the effect of the construction mechanism on the hippocampus?
In the absence of sensory exposure, there was evidence for the construction mechanism only in early trials: block 1 compared with blocks 2 and 3 for unfamiliar subjects.
Q4. How many explanatory variables were used to detect the plasticity effects of the novel goods?
To detect plasticity effects between the related components (component to component), the authors used the contrast [(A preceded by C) − (A preceded by B)], again averaging across all possible permutations (that is, explanatory variables (4) − (3)).
Q5. What is the plausible explanation for this change?
the most plausible explanation for this change is that, through repeated representation of a novel compound, previously unrelated memories were recruited simultaneously, inducing a form of plasticity between the underlying representations of necessary components.
Q6. What is the role of hippocampal activity in constructing de novo experiences?
Consistent with the proposed function of memory in prospective inference44,45, the formation of associative links46,47 and constructive episodic simulation48,49, their data suggestthat hippocampal activity can also have an active role in constructing de novo experiences in non-spatial contexts.
Q7. How long did the participants have to continue with the task?
Participants were required to continue with this stimulus-item learning task until their average reaction time per block approached 800 ms with 100% accuracy.
Q8. How many items were shown for each trial?
On each trial, 1 of the 12 abstract shapes was shown for 400 ms before all six possible items were presented in randomized positions across the screen.
Q9. What is the role of hippocampal activity in spatial memory?
hippocampal activity is often recorded in concert with a network involving mPFC in studies of spatial memory and scene construction12,19,43.
Q10. How many explanatory variables were used to detect the brain regions involved in constructing the novel?
To detect brain regions involved in constructing the novel goods (component to compound), the authors used the contrast [(AB preceded by C) − (AB preceded by A)], averaging across all possible permutations (that is, explanatory variables (2) − (1)).
Q11. What was the effect of the second repetition suppression on the construction process?
During the construction process, a second repetition suppression effect was observed between distinct and previously unassociated memories that contributed to the construction.
Q12. What effect was observed during the pre-scan training task?
This effect implies that the neural representation of related, compared with unrelated, component items became more similar as a consequence of the pre-scan training task, during which the participants were first exposed to the novel compounds.
Q13. How many explanatory variables were used to detect adaptation to repeated items?
To detect brain regions showing adaptation to repeated item, but not stimulus (item to self), the authors used the contrast [(item preceded by different item) − (item preceded by itself but paired with a different stimulus)] (that is, explanatory variables (4) − (5)).