Reward-dependent instrumental behavior must continuously be re-adjusted according to environmental conditions. Failure to adapt to changes in reward contingencies may incur psychiatric disorders like anxiety and depression. When an expected reward is omitted, behavior undergoes extinction. While extinction involves active re-learning, it is also accompanied by emotional behaviors indicative of frustration, anxiety, and despair (extinction-induced depression). Here, we report evidence for a sphingolipid mechanism in the extinction of behavior. Rapid extinction, indicating efficient re-learning, coincided with a decrease in the activity of the enzyme acid sphingomyelinase (ASM), which catalyzes turnover of sphingomyelin to ceramide, in the dorsal hippocampus of rats. The stronger the decline in ASM activity, the more rapid was the extinction. Sphingolipid-focused lipidomic analysis showed that this results in a decline of local ceramide species in the dorsal hippocampus. Ceramides shape the fluidity of lipid rafts in synaptic membranes and by that way can control neural plasticity. We also found that aging modifies activity of enzymes and ceramide levels in selective brain regions. Aging also changed how the chronic treatment with corticosterone (stress) or intranasal dopamine modified regional enzyme activity and ceramide levels, coinciding with rate of extinction. These data provide first evidence for a functional ASM-ceramide pathway in the brain involved in the extinction of learned behavior. This finding extends the known cellular mechanisms underlying behavioral plasticity to a new class of membrane-located molecules, the sphingolipids, and their regulatory enzymes, and may offer new treatment targets for extinction- and learning-related psychopathological conditions. Sphingolipids are common lipids in the brain which form lipid domains at pre- and postsynaptic membrane compartments. Here we show a decline in dorsal hippocampus ceramide species together with a reduction of acid sphingomyelinase activity during extinction of conditioned behavior in rats. This reduction was associated with expression of re-learning-related behavior, but not with emotional behaviors. Read the Editorial Highlight for this article on page 485.

Withdrawal and avoidance behavior are common symptoms of depression and can appear as a consequence of absence of reward, i.e. extinction-induced depression (EID). This is particularly relevant for the aged organism subjected to pronounced loss of former rewards. Avoidance of the former site of reward and increased withdrawal into a distant compartment accompany extinction of food-rewarded behavior in rodent models. During extinction, behavioral markers for re-learning dissociate from indicators of extinction-induced depression. Here we examined the effect of a chronic treatment with corticosterone (CORT), a well-known inducer of depression-related behavior, on EID in adult and aged rats. Adult (3-4months) and aged (18months) male rats were treated with CORT via drinking water for 3weeks prior to extinction of a cued food-reward task. CORT treatment increased the distance from the site of reward and decreased goal tracking behavior during extinction, especially in the aged rats. Plasma hormone levels measured before and after restraint stress showed a decline in basal ACTH- and CORT-levels after chronic CORT treatment in aged animals. The treatment significantly impaired the HPA-axis activation after acute stress in both, adult and aged animals, alike. Altogether, these findings show an enhancement of EID after chronic CORT treatment in the aged organism, which may be mediated by an impaired HPA-axis sensitivity. These findings may have special relevance for the investigation of human geriatric depression.

Microdialysis studies in rat have generally shown that appetitive stimuli release dopamine (DA) in the nucleus accumbens (NAc) shell and core. Here we examined the release of DA in the NAc during delivery of reward (food) and during extinction of food reward in the freely moving animal by use of in vivo microdialysis and HPLC. Fifty-two male Wistar rats were trained to receive food reward associated with appearance of cue-lights in a Skinner-box during in vivo microdialysis. Different behavioral protocols were used to assess the effects of extinction on DA and its metabolites.Results Exp. 1: (a) During a 20-min period of cued reward delivery, DA increased significantly in the NAc core, but not shell subregion; (b) for the next 60 min period half of the rats underwent immediate extinction (with the CS light presented during non-reward) and the other half did not undergo extinction to the cue lights (CS was not presented during non-reward). DA remained significantly increased in both groups, providing no evidence for a decrease in DA during extinction in either NAc core or shell regions. (c) In half of the animals of the group that was not subjected to extinction, the cue lights were turned on for 30 min, thus, initiating extinction to cue CS at a 1 h delay from the period of reward. In this group DA in the NAc core, but not shell, significantly decreased. Behavioral analysis showed that while grooming is an indicator of extinction-induced behavior, glances toward the cue-lights (sign tracking) are an index of resistance to extinction.Results Exp. 2: (a) As in Exp. 1, during a 30-min period of cued reward delivery, DA levels again increased significantly in the NAc core but not in the NAc shell. (b) When extinction (the absence of reward with the cue lights presented) was administered 24 h after the last reward session, DA again significantly decreased in the NAc core, but not in the NAc shell.Conclusions: (a) These results confirm the importance of DA release in the NAc for reward-related states, with DA increasing in the core, but not shell subregion. (b) They provide first evidence that during the withholding of expected reward, DA decreases in the NAc core, but not shell region. (c) This decrease in DA appears only after a delay between delivery of reward and extinction likely due to it being masked by persisting DA release. We hypothesize the decrease in extinction-induced release of DA in the NAc core to be a marker for the despair/depression that is known to accompany the failure to obtain expected rewards/reinforcers. (C) 2015 Elsevier Inc. All rights reserved.

Conditioned place preference (CPP) is a learned behavior shown in many vertebrates, including humans. CPP occurs when a subject comes to prefer one place more than others because the preferred location has been paired previously with rewarding events. The CPP paradigm is widely used to explore the reinforcing effects of natural and pharmacological stimuli, including drugs of addiction. There is a general assumption that an acquired place preference is based on classical conditioning derived 'incentive motivation'. However, this may be an oversimplification of the multiple learning processes involved. We argue that although CPP may appear as an incentive-driven behavior related to secondary reinforcers, it may also be a result of operant conditioning of behavior prevailing at the conditioning site, as well as a result of conditioned treatment effects. Here, we outline alternative explanations for an observed CPP, which may fundamentally affect the interpretation of results with this paradigm in its use as a screening tool for rewarding properties of treatments.

The absence or loss of rewards or reinforcers holds a major role in the development of depression in humans. In spite of the prevalence of extinction-induced depression (EID) in humans, few attempts have been made to establish animal models thereof. Here we present the concept of extinction-related depression and summarize the results of two sets of studies in our attempt to create animal models of EID, one set based on extinction after positive reinforcement in the Skinner-box, the other on extinction after negative reinforcement - escape from water. We found various behaviors emitted during the extinction trials that responded to treatment with antidepressant drugs: Accordingly, the important behavioral marker for EID during extinction of escape from the water was immobility. During extinction after positive reinforcement the important indices for extinction-induced depression are the withdrawal from the former site of reward, biting behavior and rearing up on the hind legs. Avoidance behavior and biting may model aspects of human depressive behavior, which may include withdrawal or avoidance as well as aggressive-like behaviors.

Disturbed proteostasis as a particular phenotype of the aging organism has been advanced in C. elegans experiments and is also conceived to underlie neurodegenerative diseases in humans. Here, we investigated whether particular changes in non-disease related proteostasis can be identified in the aged mammalian brain, and whether a particular signature of aberrant proteostasis is related to behavioral performance of learning and memory. Young (adult, n = 30) and aged (2 years, n = 50) Wistar rats were tested in the Morris Water Maze (MWM) to distinguish superior and inferior performers. For both young and old rats, the best and worst performers in the MWM were selected and the insoluble proteome, termed aggregome, was purified from the hippocampus as evidence for aberrant proteostasis. Quantitative proteomics (iTRAQ) was performed. The aged inferior performers were considered as a model for spontaneous, age-associated cognitive impairment. Whereas variability of the insoluble proteome increased with age, absolute changes in the levels of insoluble proteins were small compared to the findings in the whole C. elegans insoluble proteome. However, we identified proteins with aberrant proteostasis in aging. For the cognitively impaired rats, we identified a changed molecular circuitry of proteins selectively involved in F-actin remodeling, synapse building and long-term depression: actin related protein 3 (ARP3), neurabin II (NEB2) and IQ motif and SEC7 domain-containing protein 1 (BRAG2). We demonstrate that aberrant proteostasis is a specific phenotype of brain aging in mammals. We identify a distinct molecular circuitry where changes in proteostasis are characteristic for poor learning and memory performance in the wild type, aged rat. Our findings 1. establish the search for aberrant proteostasis as a successful strategy to identify neuronal dysfunction in deficient cognitive behavior, 2. reveal a previously unknown functional network of proteins (ARP3, NEB2, BRAG2) involved in age-associated cognitive dysfunction.

Loss of reward is one of the etiological factors leading to affective disorders, such as major depression. We have proposed several variants of an animal model of depression based on extinction of reinforced behavior of rats. A number of behaviors emitted during extinction trials were found to be attenuated by antidepressant treatment and, thus, qualified as indices of extinction-induced "despair". These include increases in immobility in the Morris water maze and withdrawal from the former source of reward as well as biting behavior in operant chambers. Here, we assess the effects of reward omission on behaviors after learning of (a) a cued free-reward delivery in an operant chamber and (b) food-reinforced runway behavior. Sixty adult male Wistar rats were either trained to receive food reinforcement every 90 s (s) after a 5 s lasting cue light (FI 90), or to traverse an alley to gain food reward. Daily drug treatment with either the selective serotonin reuptake inhibitor citalopram or the tricyclic antidepressant imipramine (each 10 mg/kg) or vehicle was begun either 25 days (operant chamber) or 3 days (runway) prior to extinction. The antidepressants suppressed rearing behavior in both paradigms specifically during the extinction trials, which indicates this measure as a useful marker of depression-related behavior, possibly indicating vertical withdrawal. In the operant chamber, only marginal effects on operant learning responses during extinction were found. In the runway, the operant learned responses run time and distance to the goal, as well as total distance moved, grooming and quiescence were also influenced by the antidepressants, providing a potential set of markers for extinction-induced "depression" in the runway. Both paradigms differ substantially with respect to the anticipation of reward, behaviors that are learned and that accompany extinction. Accordingly, antidepressant treatment influenced different sets of behaviors in these two learning tasks.

The withholding of expected rewards results in extinction of behavior and, hypothetically, to depression-like symptoms. In a test of this hypothesis, we examined the effects of extinction of food-reinforced lever-pressing on collateral behaviors that might be indices of depression. Operant extinction is known to be aversive to the organism and results in avoidance behavior. We hypothesized that avoidance of, or withdrawal from, the former source of reward may serve as a marker for “despair.” Adult male Wistar rats (n=6–7 animals per group) were exposed to a Skinner box attached to a second compartment of the same size, providing opportunity for the animals to leave the operant chamber and to enter the “withdrawal” compartment. The animals spent a portion of the time during the extinction trials in this second chamber. To assess the predictive validity of this behavior as a potential marker of “despair,” we tested the effects of chronic administration of two common antidepressant drugs on this measure. The tricyclic antidepressant imipramine (20 mg/kg) as well as the selective serotonin reuptake inhibitor citalopram (20 mg/kg) reduced the number of entries and time spent in the withdrawal compartment. We propose that entries into and time spent in the withdrawal compartment may operationalize “avoidance,” a core symptom of major depression. Rearing as well as biting behaviors during the extinction trials were also attenuated by the antidepressant treatment. These results lend support to the hypothesis that extinction of positively reinforced operants evokes behaviors that reflect elements of “despair/depression” because these behaviors are modulated by antidepressant treatment. The avoidance of the operant chamber as a consequence of extinction, together with rearing and biting behaviors, may serve as useful measures for the testing of antidepressant treatments.

Despair-related withdrawal behaviors are common symptoms of major depression (MD) and can be ascribed to a loss or absence of former rewarding events. Extinction of negatively reinforced escape behavior in the Morris Water Maze has been shown to induce despair-like behavior. A new animal model of depressive-like behavior is based on the extinction of positively reinforced behavior, which was shown to induce spatial avoidance of the former source of reward and biting of the operandum. Treatment with antidepressants attenuated these extinction-induced behaviors, suggesting that they reflect a depressive-like state. Here we present a methodological variation of this depression model. We employed an elongated operant chamber rather than a two-compartment procedure with the intent to establish a flowing gradient of withdrawal from the source of reward, rather than an all-or-none binary measure. Furthermore, instead of employing extinction of lever-pressing behavior, we applied a cued fixed-time food-delivery schedule. Sixty adult male Wistar rats (n=12/group) were trained to receive a food reward after appearance of a cue-light (fixed interval 90s) in an elongated Skinner-box of 72cm length. Prior to extinction, the animals were treated for 9days with either 7.5 or 10mg/kg of the tricyclic antidepressant clomipramine, 7.5 or 10mg/kg of the selective serotonin reuptake inhibitor (SSRI) citalopram or vehicle. Subsequent testing in an open field was carried out to investigate potential effects of the antidepressants on locomotor- and anxiety-like behavior. An overall increase in distance from the feeder and biting behavior was found over the course of the extinction trials. Both, citalopram and clomipramine decreased the distance from the pellet feeder during the initial extinction trials compared to the vehicle-treated group. The attenuation of withdrawal behavior by the antidepressants supports the hypothesis that avoidance/withdrawal behavior during extinction trials can serve as a marker for extinction-induced depression and suggests the utility of this paradigm as a rodent model of depression.

Neurokinin-3 receptors (NK3-R) are localized in brain regions which have been implicated in processes governing learning and memory as well as emotionality. The effects of acute subcutaneous (s.c.) senktide (0.2 and 0.4 mg/kg), a NK3-R agonist, were tested in aged (23–25 month old) Wistar rats: (a) in an episodic-like memory test, using an object discrimination task (this is the first study to test for deficits in episodic-like memory in aged rats, since appropriate tests have only recently became available); (b) on parameters of anxiety in an open field test, (c) on indices of depression in the forced swimming test and (d) on the activity of cholinergic neurons of the basal forebrain, using in vivo microdialysis and HPLC. Neither the saline-, nor senktide-treated aged animals, exhibited episodic-like memory. However, the senktide-, but not the vehicle-treated group, exhibited object memory for spatial displacement, a component of episodic memory. Senktide injection also had anxiolytic- and antidepressant-like effects. Furthermore, the active doses of senktide on behavior increased ACh levels in the frontal cortex, amygdala and hippocampus, suggesting a relationship between its cholinergic and behavioral actions. The results indicate cholinergic modulation by the NK3-R in conjunction with a role in the processing of memory and emotional responses in the aged rat.

Due to its lipophobic properties, dopamine is unable to cross the blood-brain barrier following systemic application. However, recently it has been demonstrated that, when applied directly via the nasal passages in the rat, dopamine exerts neurochemical and behavioural action, including increases of dopamine in striatal subregions, antidepressive-like action, and increased behavioral activity. These effects could potentially be mediated by exogenous dopamine acting as a direct agonist at postsynaptic dopamine receptors. However, it is also possible that intranasally applied dopamine acts indirectly via the modulation of the activity of dopaminergic cell bodies. To approach this question, the present study used rats with unilateral 6-hydroxydopamine (6-OHDA) lesions of the nigrostriatal tract, as these lesions lead to pharmacologically stimulated behavioural asymmetries which are specific for direct and indirect dopamine agonists. We found that 7 days of repeated treatment with intranasal dopamine induced a sensitization of the turning response to amphetamine, but not to apomorphine. Furthermore, intranasal dopamine dose-dependently increased the use of the forepaw ipsilateral to the 6-OHDA-lesioned side of the brain. These results suggest that intranasally administered dopamine acts via an indirect mechanism of action, putatively by increasing the release of endogenous dopamine in the brain.

The androgenic steroid testosterone is well known for its function in reproduction, sexual differentiation and sexual behavior. A growing number of human and animal studies suggest a modulatory role of testosterone in the regulation of emotionality and associated psychiatric disorders, including depressive-like disorders. However, most of the studies have been carried out in subjects deficient in androgenic steroid levels. Here, we tested potential beneficial effects of subcutaneously applied testosterone on emotionality and depressive-like behavior in healthy male rats. For this purpose, male Wistar rats (3–4 months) received either vehicle or testosterone (1.0, 2.0, 4.0 mg/kg) subcutaneously and were tested for potential effects on motor activity and anxiety-like behavior in a novel open field and elevated plus-maze. The forced swim test was used for assessing potential beneficial effects of testosterone on depressive-like behavior. The results show, that, while subcutaneous application of testosterone failed to influence spontaneous motor activity as well as anxiety-like behavior in the open field, a trend for an increase in the time spent on the open arms in the elevated plus-maze with the highest dose was found. Furthermore, in the forced swim test, testosterone application induced a dose-dependent reduction of immobility behavior, indicating antidepressant-like action of testosterone in healthy animals.

Based on findings of a profound action of intranasally applied dopamine (DA) on dopamine release in the striatum, we examined the possibility that intranasal application of DA would influence indices of attention and activity in juvenile male rats of the Naples High Excitability line. This rat model features the main aspects of Attention Deficit/Hyperactivity Disorder (ADHD). Juvenile NHE rats received an intranasal application of either DA (0.075 mg/kg, 0.15 mg/kg and 0.3 mg/kg) or vehicle into both nostrils daily for 15 days. On day 14, 1 h after treatment, they were tested in the Làt maze, and one day later, in the eight arm radial maze. Activity in the Làt maze: The highest dose of DA (0.3 mg/kg) decreased horizontal (HA) and vertical (VA) activity during the first 10 min of the test. No effect was found for rearing duration (RD), which indexes non-selective attention (NSA). Activity in the radial maze: No treatment effects were found for HA and VA components, and for RD. Attention indices: The intermediate dose of DA (0.15 mg/kg) significantly improved the number of arms visited before the first repetitive arm entry in the radial maze, an index of selective spatial attention (SSA). In conclusion, intranasal application of DA reduced hyperactivity at the highest dose used, whereas the intermediate dose improved attention in an animal model of ADHD. These results suggest the potential of employing intranasal DA for therapeutic purposes.

Behaviors that are under the control of positive or negative reinforcers undergo extinction when the anticipated reward/reinforcer is withheld. Despair, an important symptom of environmentally determined depression in humans, can be generated by extinction, or the failure of expected reward to accrue. Although well known to clinicians dealing with depressive patients, an animal model has not been available for extinction-induced depression. We have made a beginning towards validating such a model, based on the extinction of negatively reinforced behavior in the rat, i.e., upon removal of the possibility to escape onto a safety platform in the water maze. As a marker for despair, we employed behavioral immobility, i.e., the cessation of swimming in the attempt to find safety from the water, presumably, a type of learned helplessness. This measure was sensitive to antidepressants and correlated with neurotransmitter contents, neurotrophins and hypothalamus-pituitary adrenal axis markers in selected sites of the brain. Given that some cases of depression in the elderly may be biologically distinct from others and from early-onset depression, and since particularly the aged are prone to experience extinction-induced despair, we compared aged (ca. 24 months old) animals with adults in most of our studies. We found a number of distinct differences in behavioral and biological measures, indicative of differences in propensity to, as well as response to, extinction-induced despair between aged and adults. Our results add to the body of evidence for differences in the neurobiological substrates of depressive disorders between aged and adults, with the implication for the requirement of different treatment strategies in these two populations.

We evaluated the effects of intranasal administration of progesterone (PROG) on the activity of dopaminergic neurons in the brain of anesthetized rats by means of microdialysis. Male Wistar rats were implanted with guide cannulae in the basolateral amygdala and neostriatum. Three to 5 days later, they were anesthetized with urethane, and dialysis probes were inserted. After a stabilization period of 2 h, four 30-min samples were collected. Thereafter, the treatment (0.5, 1.0 or 2.0 mg/kg of PROG dissolved in a viscous castor oil mixture, or vehicle) was applied into the nose in a volume of 10 μl (5 μl in each nostril). In other animals, an s.c. injection of PROG (1.0, 2.0 or 4.0 mg/kg) or vehicle was given. Samples of both application ways were collected at 30-min interval for 4 h after the treatment and immediately analyzed with high performance liquid chromatography and electrochemical detection. Intranasal administration of 2 mg/kg of PROG led to an immediate (within 30 min after the treatment) significant increase in the basolateral amygdala dopamine levels. In the neostriatum, the 2 mg/kg dose led to a delayed significant increase in dopamine. S.c. administration of 4 mg/kg of PROG was followed by a delayed significant increase in dopamine, both, in the basolateral amygdala and neostriatum, but smaller in magnitude in comparison to the intranasal treatment. This is the first study to demonstrate dopamine-enhancing effects of PROG, not only in the neostriatum, but also in the basolateral amygdala. Our results indicate that the intranasal route of administration of PROG is a more efficacious way for targeting the brain than the s.c. route.

President of the IPEG and of the Scientific Program Committee Gé S.F. Ruigt, Oss (The Netherlands) President of the Local Organizing Committee Rémy Luthringer, Rouffach (France)

In the search for animal models of human geriatric depression, we found that operant extinction of escape from water results in the expression of immobility in different age groups, indicative of behavioral "despair", which was also associated with the resistance-to-extinction (RTE) expressed by these animals. With respect to the neurotrophin hypothesis of depression, nerve-growth factor (NGF), brain-derived neurotrophic factor (BDNF) and neurotrophin-3 (NT-3) protein levels in frontal cortex (FC) and hippocampus (HP) were examined and related to behavioral immobility and RTE in the water maze in aged and adult Wistar rats. Age-related increases in levels of NGF were found in HP and of NT-3 in FC. Indices of immobility showed relationships in the aged with NGF and, in adults, with BDNF, pointing to a dissociation of neurotrophic involvement in extinction trial-induced "despair" in aged and adult rats. The present results support the hypothesis, that extinction-induced immobility in the water maze reflects a state akin to behavioral despair and point to age-related differences of neurotrophic involvement in depressive-like symptoms. The concept of extinction-induced behavioral "despair" in the aged subsumes several aspects of human geriatric depression, such as co-morbidity of learning impairment and anxiety, and, thus could represent a useful paradigm to examine the neuronal mechanisms underlying depression, especially in aged rodents.