In a dynamic environment, organisms must continuously update learned action-outcome associations. Central to this flexibility is the prefrontal cortex, whose computations are finely tuned by neuromodulatory inputs. Yet, the temporal dynamics and circuit specificity of this regulation remain unclear. Here, we investigate the contribution of orbitofrontal noradrenaline (OFC-NA) to flexible updating in rats performing an instrumental reversal learning task. Using fiber photometry, we observe transient increases in OFC-NA release following reward deliveries on reversal day, and we find that the magnitude of these responses predicts the speed of behavioral adaptation. Chemogenetic and optogenetic manipulations of NA projections from the locus coeruleus (LC) to the OFC show that perturbing these signals delays reversal learning in a graded, mode-dependent manner, with chemogenetic inhibition having the strongest impact. Together, our findings establish OFC-NA as a temporally precise neuromodulatory mechanism, gating flexible adaptation to changing environmental contingencies.

Executive control, the ability to organize thoughts and action plans in real time, is a defining feature of higher cognition. Classical theories have emphasized cortical contributions to this process, but recent studies have reinvigorated interest in the role of the thalamus. Although it is well established that local thalamic damage diminishes cognitive capacity, such observations have been difficult to inform functional models. Recent progress in experimental techniques is beginning to enrich our understanding of the anatomical, physiological, and computational substrates underlying thalamic engagement in executive control. In this review, we discuss this progress and particularly focus on the mediodorsal thalamus, which regulates the activity within and across frontal cortical areas. We end with a synthesis that highlights frontal thalamocortical interactions in cognitive computations and discusses its functional implications in normal and pathological conditions.

A dynamic environment, such as the one we inhabit, requires organisms to continuously update their knowledge of the setting. While the prefrontal cortex is recognized for its pivotal role in regulating such adaptive behavior, the specific contributions of each prefrontal area remain elusive. In the current work, we investigated the direct involvement of two major prefrontal subregions, the medial prefrontal cortex (mPFC, A32D+A32V) and the orbitofrontal cortex (OFC, VO+LO), in updating Pavlovian stimulus-outcome (S-O) associations following contingency degradation in male rats. Specifically, animals had to learn that a particular cue, previously fully predicting the delivery of a specific reward, was no longer a reliable predictor. First, we found that chemogenetic inhibition of mPFC, but not of OFC, neurons altered the rats’ ability to adaptively respond to degraded and non-degraded cues. Next, given the growing evidence pointing at noradrenaline (NA) as a main neuromodulator of adaptive behavior, we decided to investigate the possible involvement of NA projections to the two subregions in this higher-order cognitive process. Employing a pair of novel retrograde vectors, we traced NA projections from the locus coeruleus (LC) to both structures and observed an equivalent yet relatively segregated amount of inputs. Then, we showed that chemogenetic inhibition of NA projections to the mPFC, but not to the OFC, also impaired the rats’ ability to adaptively respond to the degradation procedure. Altogether, our findings provide important evidence of functional parcellation within the prefrontal cortex and point at mPFC-NA as key for updating Pavlovian S-O associations.Significant statementThe ability to update stimulus-outcome (S-O) associations is a key adaptive behavior, essential for surviving and thriving in an ever-changing environment. The prefrontal cortex is well-known for playing a key role in this process. The discrete contribution of each prefrontal subregion and of different neurotransmitters, however, remains unclear. In the current study, we show that inhibiting medial prefrontal (mPFC), but not orbitofrontal cortex (OFC), neurons impairs rats’ ability to update S-O associations following contingency degradation. Moreover, we demonstrate that discrete noradrenergic projections to the two subregions exist and that inhibiting the ones projecting to the mPFC, but not to the OFC, once again impairs the animals’ behavior, thereby implying a substantial contribution of noradrenaline in orchestrating this higher-order cognitive process.

Extinction is a specific example of learning where a previously reinforced stimulus or response is no longer reinforced, and the previously learned behaviour is no longer necessary and must be modified. Current theories suggest extinction is not the erasure of the original learning but involves new learning that acts to suppress the original behaviour. Evidence for this can be found when the original behaviour recovers following the passage of time (spontaneous recovery), or reintroduction of the reinforcement (i.e., reinstatement). Recent studies have shown that pharmacological manipulation of noradrenaline (NA) or its receptors can influence appetitive extinction, however, the role and source of endogenous NA in these effects is unknown. Here, we examined the role of the locus coeruleus (LC) in appetitive extinction. Specifically, we tested whether optogenetic stimulation of LC neurons during extinction of a food-seeking behaviour would enhance extinction evidenced by reduced spontaneous recovery in future tests. LC stimulation during extinction trials did not change the rate of extinction but did serve to reduce subsequent spontaneous recovery suggesting that stimulation of the LC can augment reward-related extinction. Optogenetic inhibition of the LC during extinction trials reduced responding during the trials where it was applied, but no long-lasting changes in the retention of extinction were observed. Since not all LC cells expressed halorhodopisn, is possible that more complete LC inhibition or pathway-specific targeting would be more effective at suppressing extinction learning. These results provide further insight into the neural basis of appetitive extinction, and in particular the role of the LC. A deeper understanding of the physiological bases of extinction can aid development of more effective extinction-based therapies.

Abstract Thalamic nuclei have been increasingly scrutinized over the past few years in various fields ranging from sensory-motor to cognitive functions. An emerging aspect of their functional contribution is that they appear to play highly integrative roles in largely distributed neural circuits. This chapter aims to document the contribution of the thalamus to flexible and adaptive behaviors that are integral to decision-making. These so-called goal-directed behaviors can be conveniently examined in animal models in the laboratory to examine their neural underpinnings. Multiple thalamic nuclei appear to support goal-directed behaviors with specific and complementary contributions. In particular, thalamic nuclei interact with both prefrontal areas and basal ganglia to initiate adaptive actions, attend to relevant environmental signals, and ultimately shape mental representations. Integrating computational approaches with a systematic input-output mapping of thalamic nuclei may be key to reveal the functional principles that govern thalamic functions. This is most important to advance conceptual and mechanical understanding of multiple mental conditions associated with brain-wide dysconnectivity.

In a constantly changing environment, organisms must track the current relationship between actions and their specific consequences and use this information to guide decision-making. Such goal-directed behaviour relies on circuits involving cortical and subcortical structures. Notably, a functional heterogeneity exists within the medial prefrontal, insular, and orbitofrontal cortices (OFC) in rodents. The role of the latter in goal-directed behaviour has been debated, but recent data indicate that the ventral and lateral subregions of the OFC are needed to integrate changes in the relationships between actions and their outcomes. Neuromodulatory agents are also crucial components of prefrontal functions and behavioural flexibility might depend upon the noradrenergic modulation of the prefrontal cortex. Therefore, we assessed whether noradrenergic innervation of the OFC plays a role in updating action-outcome relationships in male rats. We used an identity-based reversal task and found that depletion or chemogenetic silencing of noradrenergic inputs within the OFC rendered rats unable to associate new outcomes with previously acquired actions. Silencing of noradrenergic inputs in the prelimbic cortex or depletion of dopaminergic inputs in the OFC did not reproduce this deficit. Together, our results suggest that noradrenergic projections to the OFC are required to update goal-directed actions.

The ability to engage into flexible behaviors is crucial in dynamic environments. We recently showed that in addition to the well described role of the orbitofrontal cortex (OFC), its thalamic input from the submedius thalamic nucleus (Sub) also contributes to adaptive responding during Pavlovian degradation. In the present study, we examined the role of the mediodorsal thalamus (MD) which is the other main thalamic input to the OFC. To this end, we assessed the effect of both pre- and post-training MD lesions in rats performing a Pavlovian contingency degradation task. Pre-training lesions mildly impeded the establishment of stimulus-outcome associations during the initial training of Pavlovian conditioning without interfering with Pavlovian degradation training when the sensory feedback provided by the outcome rewards were available to animals. However, we found that both pre- and post-training MD lesions produced a selective impairment during a test conducted under extinction conditions, during which only current mental representation could guide behavior. Altogether, these data suggest a role for the MD in the successful encoding and representation of Pavlovian associations.

SUMMARYIn a constantly changing environment, organisms must track the current relationship between actions and their specific consequences and use this information to guide decision-making. Such goal-directed behavior relies on circuits involving cortical and subcortical structures. Notably, a functional heterogeneity exists within the medial prefrontal, insular, and orbitofrontal cortices (OFC) in rodents. The role of the latter in goal-directed behavior has been debated, but recent data indicate that the ventral and lateral subregions of the OFC are needed to integrate changes in the relationships between actions and their outcomes. Neuromodulatory agents are also crucial components of prefrontal functions and behavioral flexibility might depend upon the noradrenergic modulation of prefrontal cortex. Therefore, we assessed whether noradrenergic innervation of the OFC plays a role in updating action-outcome relationships. We used an identity-based reversal task and found that depletion or chemogenetic silencing of noradrenergic inputs within the OFC rendered rats unable to associate new outcomes with previously acquired actions. Silencing of noradrenergic inputs in the medial prefrontal cortex or depletion of dopaminergic inputs in the OFC did not reproduce this deficit. Together, our results indicate that noradrenergic projections to the OFC are required to update goal-directed actions.GRAPHICAL ABSTRACTHIGHLIGHTSRats learn initial action-outcome associations in an instrumental taskNoradrenergic depletion in the OFC prevents the encoding and expression of these associations following reversal learningDopaminergic depletion in the OFC does not result in behavioral deficitsLC:OFC noradrenergic projections are required to update action-outcome associationsIN BRIEFCerpa et al. investigate whether noradrenergic projections from the locus coeruleus (LC) to the orbitofrontal cortex are involved in updating previously established goal-directed actions following environmental change. They find that these LC projections are required to both encode and express reversed action-outcome associations in rats.

The anterior thalamic nuclei (ATN) form a nodal point within a distributed memory network. The conventional view of ATN function describes segregated efferents to different terminal regions. By contrast, we found that bifurcating neurons are common within the anteromedial nucleus (AM) of the ATN. A substantial proportion of AM neurons (∼36% within a region of interest) showed collateral projections when one of two retrograde neurotracers, Cholera Toxin Subunit B (CTB) conjugated to either Alexa Fluor® 488 or 594, was placed in the medial prefrontal cortex (mPFC) or dorsal subiculum (dSub). A marked degree of collateralization (∼20% AM neurons) was also found when neurotracers were placed in mPFC and caudal retrosplenial cortex (cRSC); about 10% showed collaterals when the cRSC was paired with either dSub or vHF; the fewest (6%) was found for mPFC paired with the ventral hippocampal formation (vHF). A generally similar range of percentages of bifurcating neurons was found in the adjacent nucleus reuniens (Re). Evidence that AM neurons project simultaneously to many distantly-located structures provides a new perspective on ATN function. These neurons would facilitate direct coordination among key neural structures to support memory and may explain the strong association between the ATN and diencephalic amnesia.