How the human brain reconstructs, step-by-step, the core elements of past experiences is still unclear. Here, we map the spatiotemporal trajectories along which visual object memories are reconstructed during associative recall. Specifically, we inquire whether retrieval reinstates feature representations in a copy-like but reversed direction with respect to the initial perceptual experience, or alternatively, this reconstruction involves format transformations and regions beyond initial perception. Participants from two cohorts studied new associations between verbs and randomly paired object images, and subsequently recalled the objects when presented with the corresponding verb cue. We first analyze multivariate fMRI patterns to map where in the brain high- and low-level object features can be decoded during perception and retrieval, showing that retrieval is dominated by conceptual features, represented in comparatively late visual and parietal areas. A separately acquired EEG dataset is then used to track the temporal evolution of the reactivated patterns using similarity-based EEG-fMRI fusion. This fusion suggests that memory reconstruction proceeds from anterior frontotemporal to posterior occipital and parietal regions, in line with a conceptual-to-perceptual gradient but only partly following the same trajectories as during perception. Specifically, a linear regression statistically confirms that the sequential activation of ventral visual stream regions is reversed between image perception and retrieval. The fusion analysis also suggests an information relay to frontoparietal areas late during retrieval. Together, the results shed light onto the temporal dynamics of memory recall and the transformations that the information undergoes between the initial experience and its later reconstruction from memory.
Remembering facilitates future remembering. This benefit of practicing by active retrieval, as compared to more passive relearning, is known as the testing effect and is one of the most robust findings in the memory literature. It has typically been assessed using verbal materials such as word pairs, sentences, or educational texts. We here investigate if memory for visual materials equally benefits from retrieval-mediated learning. Based on cognitive and neuroscientific theories, we hypothesize that testing effects will be limited to meaningful visual images that can be related to preexisting knowledge. In a series of four experiments, we systematically varied the type of material (meaningless "squiggle" shapes vs. meaningful object images) and the format of the test used to probe memory (a visually driven alternative forced-choice test vs. a remember/know recognition test). Within each experiment, we assessed the effects of practice type (retrieval or restudy) and the delay of the final test (immediate vs. 1 week) on the resulting practice benefits. Abstract shapes never showed a significant testing benefit, irrespective of test format. Meaningful object images did benefit from testing, particularly at long delays, and with a test format probing the recollective component of recognition memory. Together, our results indicate that retrieval can facilitate the recollection of visual images when they represent meaningful semantic units. This pattern of results is predicted by cognitive and neurobiologically motivated theories proposing that retrieval's benefits emerge through spreading activation in semantic networks, producing more easily accessible and longer-lasting memory traces.
Our understanding of how information unfolds when we recall events from memory remains limited. In this study, we investigate whether the reconstruction of visual object memories follows a backward trajectory along the ventral visual stream with respect to perception, such that their neural feature representations are gradually reinstated from late areas close to the hippocampus backwards to lower-level sensory areas. We use multivariate analyses of fMRI activation patterns to map the constituent features of the object memories onto the brain during retrieval, and EEG-fMRI fusion to track the temporal evolution of the reactivated patterns. Participants studied new associations between verbs and randomly paired object images in an encoding phase, and subsequently recalled the objects when presented with the corresponding verb cue. Decoding reactivated memory features from fMRI activity revealed that retrieval patterns were dominated by conceptual features, represented in comparatively late visual and parietal areas. Representational-similarity-based fusion then allowed us to map the EEG patterns that emerged at each given time point of a trial onto the spatially resolved fMRI patterns. This fusion suggests that memory reconstruction proceeds backwards along the ventral visual stream from anterior fronto-temporal to posterior occipital and parietal regions, in line with a semantic-to-perceptual gradient. A linear regression on the peak time points of reactivated brain regions statistically confirms that the temporal progression is reversed with respect to encoding. Together, the results shed light onto the spatio-temporal trajectories along which memories are reconstructed during associative retrieval, and which features of an image are reconstructed when in time and where in the brain.
Over the last two decades, inhibitory control has featured prominently in accounts of how humans and other organisms regulate their behaviour and thought. Previous work on how the brain stops actions and thoughts, however, has emphasised distinct prefrontal regions supporting these functions, suggesting domain-specific mechanisms. Here we show that stopping actions and thoughts recruits common regions in the right dorsolateral and ventrolateral prefrontal cortex to suppress diverse content, via dynamic targeting. Within each region, classifiers trained to distinguish action-stopping from action-execution also identify when people are suppressing their thoughts (and vice versa). Effective connectivity analysis reveals that both prefrontal regions contribute to action and thought stopping by targeting the motor cortex or the hippocampus, depending on the goal, to suppress their task-specific activity. These findings support the existence of a domain-general system that underlies inhibitory control and establish Dynamic Targeting as a mechanism enabling this ability.
Empathy relies on the ability to mirror and to explicitly infer others' inner states. Theoretical accounts suggest that memories play a role in empathy, but direct evidence of reactivation of autobiographical memories (AM) in empathy is yet to be shown. We addressed this question in two experiments. In Experiment 1, electrophysiological activity (EEG) was recorded from 28 participants. Participants performed an empathy task in which targets for empathy were depicted in contexts for which participants either did or did not have an AM, followed by a task that explicitly required memory retrieval of the AM and non-AM contexts. The retrieval task was implemented to extract the neural fingerprints of AM and non-AM contexts, which were then used to probe data from the empathy task. An EEG pattern classifier was trained and tested across tasks and showed evidence for AM reactivation when participants were preparing their judgement in the empathy task. Participants self-reported higher empathy for people depicted in situations they had experienced themselves as compared to situations they had not experienced. A second independent fMRI experiment replicated this behavioural finding and showed increased activation for AM compared to non-AM in the brain networks underlying empathy: precuneus, posterior parietal cortex, superior and inferior parietal lobule, and superior frontal gyrus. Together, our study reports behavioural, electrophysiological, and fMRI evidence that robustly supports AM reactivation in empathy.
Generalised knowledge can adaptively guide our behaviour and help us navigate the world. In this study, we aim to test the role of memory retrieval in promoting such generalisation of memories. Retrieval is known to be a powerful memory enhancer. Both cognitive and neurobiological theories of retrieval-mediated learning propose that this benefit is due to the co-activation of related (semantic) information during retrieval, which strengthens this co-activated associative network. By doing so, retrieval might play an important role in the generalisation of the memory trace. Here, we used univariate and pattern fMRI analyses to investigate whether memory representations that undergo retrieval (vs. restudy) become generalised over time. Participants encoded scene-object pairs and either retrieved or restudied the objects over two sessions, two days apart. We analysed univariate and multivariate changes in brain activity specific to retrieval but not restudy, and tested whether predicted changes occur rapidly within a session, or evolve slowly, across the two days. Consistent with a role of retrieval in the semanticisation of memories, univariate analyses showed an increase in medial prefrontal cortex (mPFC) activation across consecutive retrieval attempts, and a multivariate increase in similarity between categorically related information. In addition to this semanticisation, we also observed that retrieval strengthened the patterns unique to the original study episodes. Semantic-categorical and episode-unique strengthening both evolved slowly, across two days, and were most pronounced in parietal areas. Our findings corroborate the hypothesis that retrieval supports the creation of a generalised memory trace, and show that this strengthening does not come at the expense of episode-unique information. Active remembering thus seems to promote a stable and adaptive memory that can be flexibly used to access both contextually specific and more abstract generalised information.
Seemingly effortless tasks, such as recognizing faces and retrieving names, become harder as we age. Such difficulties may be due to the competition generated in memory by irrelevant information that comes to mind when trying to recall a specific face or name. It is unknown, however, whether age-related struggles in retrieving these representations stem from an inability to detect competition in the first place, or from being unable to suppress competing information once interference is detected. To investigate this, we used the retrieval practice paradigm, shown to elicit memory interference, while recording electrophysiological activity in young and older adults. In two experiments, young participants showed Retrieval-Induced Forgetting (RIF), reflecting the suppression of competing information, whereas older adults did not. Neurally, mid-frontal theta power (~4–8 Hz) during the first retrieval cycle, a proxy for interference detection, increased in young compared to older adults, indicating older adults were less capable of detecting interference. Moreover, while theta power was reduced across practice cycles in younger adults, a measure of interference resolution, older adults did not show such a reduction. Thus, in contrast with younger adults, the lack of an early interference detection signal rendered older adults unable to recruit memory selection mechanisms, eliminating RIF.
The testing-effect, or retrieval-mediated learning, is one of the most robust effects in memory research. It shows that actively and repeatedly retrieving information, compared to merely restudying it, improves long-term retention. Surprisingly, little is known about the neurocognitive mechanisms underlying this phenomenon. Attempting to fill this gap, a recent framework proposed that retrieval acts as a fast memory consolidation mechanism, stabilizing memories through online reactivation, similar to memory replay during offline (e.g. sleep) consolidation. In this fMRI study, we empirically tested the predictions derived from this framework. We predicted that reactivation during retrieval allows memories to become embedded in neocortex, creating an additional route to access the memory trace and rendering it less hippocampus-dependent. Participants encoded scene-object pairs and either retrieved or restudied the objects over two sessions, two days apart. We analysed univariate and multivariate changes in brain activity specific to retrieval but not restudy, and tested whether the predicted changes occur rapidly within a session, or evolve slowly, across the two days. Results showed that medial prefrontal cortex activation increased across retrieval trials within one session, consistent with a fast consolidation account. Hippocampal activity decreased across sessions, suggesting a slower mechanism. Moreover, Representational Similarity Analyses (RSA) showed that consecutive retrieval attempts strengthen both higher-level semantic and episode-specific information in parietal areas, both across but not within sessions. Our findings suggest that retrieval supports the online creation of a neocortical trace, which becomes increasingly relevant at long delays when hippocampus-dependent episodic details would otherwise have faded. Significance statement Repeated remembering strengthens memories much more so than repeated learning. The aim of this study was to shed light onto the poorly understood neurocognitive underpinnings of retrieval-mediated learning. We tested a novel framework proposing that a memory’s stabilization via retrieval relies on mechanisms akin to those involved in offline systems consolidation. Observing the retrieval-induced neural pattern changes across different timescales, we find that retrieval stabilizes semantic and episodic aspects of the original memories, and produces increases in prefrontal activity and decreases in hippocampal activity that are consistent with the consolidation view, but not necessarily with a fast acting mechanism. Our findings inform cognitive theories of the testing effect, suggesting that retrieval produces its benefits by interacting with hippocampal-neocortical consolidation mechanisms.
The ability to stop actions and thoughts is essential for goal-directed behaviour. Neuroimaging research has revealed that stopping actions and thoughts engage similar cortical mechanisms, including the ventro- and dorso-lateral prefrontal cortex. However, whether and how these abilities require similar subcortical mechanisms remains unexplored. Specifically of interest are the basal ganglia, subcortical structures long-known for their motor functions, but less so for their role in cognition. To investigate the potential common mechanisms in the basal ganglia underlying action and thought stopping, we conducted meta-analyses using fMRI data from the Go/No-Go, Stop-signal, and Think/No-Think tasks. All three tasks require active stopping of prepotent actions or thoughts. To localise basal ganglia activations, we performed high-resolution manual segmentations of striatal subregions. We found that all three tasks recovered clusters in the basal ganglia, although the specific localisation of these clusters differed. Although the Go/No-Go and Stop-signal tasks are often interchangeably used for measuring action stopping, their cluster locations in the basal ganglia did not significantly overlap. These different localised clusters suggest that the Go/No-Go and Stop-signal tasks may recruit distinct basal ganglia stopping processes, and therefore should not be treated equivalently. More importantly, the basal ganglia cluster recovered from the Think/No-Think task largely co-localised with that from the Stop-signal task, but not the Go/No-Go task, possibly indicating that the Think/No-Think and Stop-signal tasks share a common striatal circuitry involved in the cancellation of unwanted thoughts and actions. The greater similarity of the Think/No-Think task to the Stop-Signal rather than Go/No-Go task also was echoed at the cortical level, which revealed highly overlapping and largely right lateralized set of regions including the anterior DLPFC, VLPFC, Pre-SMA and ACC. Overall, we provide novel evidence suggesting not only that the basal ganglia are critical for thought stopping, but also that they are involved in specific stopping subprocesses that can be engaged by tasks in different domains. These findings raise the possibility that the basal ganglia may be part of a supramodal network responsible for stopping unwanted processes more broadly.
Intrusive memories, images, and hallucinations are hallmark symptoms of psychiatric disorders. Although often attributed to deficient inhibitory control by the prefrontal cortex, difficulty in controlling intrusive thoughts is also associated with hippocampal hyperactivity, arising from dysfunctional GABAergic interneurons. How hippocampal GABA contributes to stopping unwanted thoughts is unknown. Here we show that GABAergic inhibition of hippocampal retrieval activity forms a key link in a fronto-hippocampal inhibitory control pathway underlying thought suppression. Subjects viewed reminders of unwanted thoughts and tried to suppress retrieval while being scanned with functional magnetic resonance imaging. Suppression reduced hippocampal activity and memory for suppressed content. 1 H magnetic resonance spectroscopy revealed that greater resting concentrations of hippocampal GABA predicted better mnemonic control. Higher hippocampal, but not prefrontal GABA, predicted stronger fronto-hippocampal coupling during suppression, suggesting that interneurons local to the hippocampus implement control over intrusive thoughts. Stopping actions did not engage this pathway. These findings specify a multi-level mechanistic model of how the content of awareness is voluntarily controlled.
Retrieval-mediated learning is a powerful way to make memories last, but its neurocognitive mechanisms remain unclear. We propose that retrieval acts as a rapid consolidation event, supporting the creation of adaptive hippocampal-neocortical representations via the 'online' reactivation of associative information. We describe parallels between online retrieval and offline consolidation and offer testable predictions for future research.
Background/Study Context: Aging has traditionally been related to impairments in proper name retrieval. This study analyzed the possible role of the Inhibitory Deficit Hypothesis in explaining face naming impairments during aging. The dynamics of inhibition have been thoroughly studied by the retrieval-practice paradigm (Anderson, Bjork, & Bjork, 1994, Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 1063-1087) and its aftereffect, the retrieval-induced forgetting effect. Methods: A version of the retrieval-practice paradigm was employed: younger-old (YO; mean age = 66.40, SD = 3.94) and older-old (OO; mean age = 80.94, SD = 4.53) adults were asked to repeatedly name faces of categorically related famous people. Results: Retrieval-induced forgetting for names was observed in the YO group but not in the OO group. Conclusion: These findings indicate that whereas the YO adults had enough resources to inhibit intrusive names, OO adults were not able to suppress competing names, supporting the proposal of the Inhibitory Deficit Hypothesis at older ages.
Memory retrieval is often challenged by other irrelevant competing memories that cause interference. This phenomenon is typically studied with the retrieval practice paradigm in which a category cue e.g., Fruits is presented together with an item-specific cue e.g., Or::. Presentation of the category cue usually induces interference by reactivating competing memories e.g., Banana, Apple, etc., which is thought to be solved by means of inhibition, leading to retrieval-induced forgetting of these competing memories. Previous studies associated interference with an increase in medial prefrontal theta band 4-8 Hz oscillations, but these studies could not disentangle the interference from the inhibition processes. We here used a retrieval practice procedure in which the category cue was presented before the item-specific cue to disentangle the interference from the inhibition signal. Furthermore, a competitive retrieval condition was contrasted with a noncompetitive condition. At a behavioral level, retrieval-induced forgetting was found in the competitive but not in the noncompetitive condition. At a neural level, presentation of the category cue elicited higher levels of theta power in the competitive condition, when compared with the noncompetitive retrieval condition. Importantly, this difference was localized to the ACC, which has been associated with the detection and mediation of interference. Additionally, theta power decreased upon presentation of the item-specific cue, and this difference was related to later forgetting. Our results therefore disentangle, for the first time, interference and inhibition in episodic memory retrieval and suggest that theta oscillations track the fine-grained temporal dynamics of interference during competitive memory retrieval.
Selective retrieval is a rather difficult task, and especially so when one attempts to retrieve personal representations such as faces or names. Retrieval of memories under strong competition conditions is pervasive in human memory and some have suggested that inhibitory control is used to overcome interference between competing stimuli. In the present study, we used the retrieval practice paradigm to investigate if competition among personal representations (such as facial features and names) is also resolved by inhibitory mechanisms. This question is theoretically relevant, since personal representations have been said to have a special status on cognition. Moreover, some models of face recognition assume that interference can arise between different representations, but that this interference would be automatically and rapidly solved, with no need for a controlled inhibitory mechanism to act. In two experiments we showed RIF for facial features and familiar names, but only when participants had to actively retrieve some information. This suggests that personal information is subject to mechanisms of inhibitory control, which could help explain everyday life difficulties in processes such as face feature recognition or name retrieval.