Abstract It is widely believed that starvation favours the processing of food-related cues, a notion here called the ’adaptive specificity hypothesis’. Indeed, in Drosophila melanogaster starvation is required for appetitive odour-sugar but not for aversive odour-shock memory. Results from Gruber et al. (2013) and Meschi et al. (2024), however, suggest that starvation improves aversive short-term memory, too, challenging this hypothesis. We survey how starvation affects Drosophila associative olfactory short-term memory across 26 learning tasks. These tasks differ in the reinforcers and the amount of training, the life stage of the animals, in the predictive structure and associative timing of the task, in whether memory is expressed as an increase or decrease in odour preference, and in whether the learned behaviour is motivated by obtaining reward or avoiding/ escaping punishment. In adult flies, an improvement was observed for appetitive odour-sugar memories, whereas all tasks yielding aversive memory were unaffected. Strikingly, ’appetitive’ tasks that are not sugar-related, namely odour-shock extinction learning and punishment-relief associations, were either unaffected or even impaired, supporting the ’adaptive specificity hypothesis’. In contrast, in 5-day-old larvae sugar-related appetitive associations were compromised, and the same was observed, to varying degrees, in larvae starved one day earlier and for aversive quinine associations, challenging the ’adaptive specificity hypothesis’. Furthermore, we observed starvation-induced changes in locomotion and preference for a subset of the cues used in our study. Our results defy a simplistic interpretation in terms of the ’adaptive specificity hypothesis’ and call for case-by-case analyses of how starvation affects learning and behaviour.

Cognitive deficits are a major contributor to disability in numerous neuropsychiatric and neurodegenerative disorders, yet effective pharmacological treatments remain limited. Ferulic acid eicosyl ester (FAE-20), a natural constituent of the plant Rhodiola rosea, has previously been identified as an enhancer of simple forms of Pavlovian conditioning in flies, bees, and mice. Here, we investigated whether FAE-20 has further potential to enhance cognitive flexibility, working memory, or spatial learning in mice, and explored potential neurobiological mechanisms underlying such enhancement. Cognitive flexibility was assessed using the attentional set-shifting task (ASST). Subchronic FAE-20 treatment significantly improved ASST performance in both male and female young adult mice, indicating enhanced cognitive flexibility. In contrast, no effects were observed on spatial working memory, assessed by spontaneous alternations in the Y-maze, or on spatial learning in the Barnes maze in either young or aged mice. Notably, FAE-20 enabled spatial learning in the Barnes maze in a subgroup of aged mice that failed to learn the task under vehicle treatment. Histological analyses using c-Fos immunohistochemistry as a marker of neural activity and doublecortin expression and spine density as markers of hippocampal plasticity revealed sex-specific effects on components of the ascending arousal system. FAE-20 increased the activation of orexinergic neurons in the lateral hypothalamus of male mice, whereas it reduced the activity of cholinergic neurons in the laterodorsal tegmental nucleus of females. No effects were detected on hippocampal neurogenesis or dendritic spine density. These findings suggest that the cognitive effects of FAE-20 are selective, depending on the cognitive demands of the task and the baseline cognitive abilities of the animals, and may be mediated, at least in part, by modulation of arousal-related neural circuits.

It was classically suggested that behaviour can cause emotions (Darwin 1872). For example, smiling can make us feel happier, and in rodents the induced patterns of cardiac activity and breathing that are indicative of fear can in turn evoke it (Coles et al. 2022, Hsueh et al. 2023, Jhang et al. 2024). However, the adaptive significance of such feedback is unclear. We show that inducing backward movement, an element of avoidance behaviour in Drosophila, engages negative valence signals in these animals, and reveal the neuronal mechanisms and adaptive significance of this effect. We develop a paradigm with odours as conditioned stimuli paired with optogenetically induced backward movement instead of a punishing unconditioned stimulus, and combined these experiments with pharmacology, high-resolution video tracking, functional imaging, connectome analyses, and modelling. Our results show that backward movement engages dopaminergic punishment neurons and supports aversive memories. Such avoidance-to-punishment feedback counterbalances extinction learning and maintains learned avoidance, reducing the risk of further punishment. This can explain the long-standing "avoidance paradox", the observation that avoidance adaptively persists even when it is successful and no punishment is received (Bolles 1972). Our results provide a neurobiologically grounded argument for an integrated view of behaviour organization and valence processing.

For a proper representation of the causal structure of the world, it is adaptive to consider both evidence for and evidence against causality. To take punishment as an example, the causality of a stimulus is unlikely if there is a temporal gap before punishment is received, but causality is credible if the stimulus immediately precedes punishment. In contrast, causality can be ruled out if the punishment occurred first. At the behavioral level, this is reflected in the associative principle of timing-dependent valence reversal: aversive memories are formed when a stimulus occurs before the punishment, whereas memories of appetitive valence are formed when a stimulus is presented upon the relieving termination of punishment. We map the temporal profile of memories induced by optogenetic activation of the PPL1-01 neuron in the fly Drosophila melanogaster (of either sex) and find that compromising tyrosine hydroxylase function, either acutely by pharmacological methods or by cell-specific RNAi, extends and blunts this profile. Specifically, it (1) enhances learning with a time gap between the stimulus and PPL1-01 punishment (better trace conditioning), (2) impairs learning when the stimulus immediately precedes PPL1-01 punishment (worse delay conditioning), and (3) prevents learning about a stimulus presented after PPL1-01 punishment has ceased (worse relief conditioning). Under conditions of low dopamine, we furthermore observe a role for serotonin that is pronounced in trace conditioning, weaker in delay conditioning, and absent in relief conditioning. We discuss the psychiatric implications if related alterations in the temporal profile of reinforcement were to occur in humans.

Drosophilalarvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larvalDrosophilafor their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning inDrosophilalarvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larvalDrosophila.

For a proper representation of the causal structure of the world, one must consider both evidence for and evidence against causality. To take punishment as an example, the causality of a stimulus is reasonable if the stimulus precedes punishment, whereas causality can be ruled out if the punishment occurred first. This is reflected in the associative principle of timing-dependent valence reversal: aversive memories are formed when a stimulus occurs before the punishment, whereas memories of appetitive valence are observed when a stimulus is presented upon its relieving termination. We map the temporal profile of punishment induced by optogenetic activation of the PPL1-01 neuron in the fly Drosophila melanogaster , and find that impairment of tyrosine hydroxylase function, either acutely by pharmacological methods or by cell-specific RNAi, i) enhances learning with a time gap between stimulus and PPL1-01 punishment (trace conditioning), ii) impairs learning when the stimulus immediately precedes PPL1-01 punishment (delay conditioning), and iii) prevents learning about a stimulus presented after PPL1-01 punishment has ceased (relief conditioning). This implies a delusion-like state in which causality is attributed to cues that do not merit it (better trace conditioning), whereas both credible evidence for and credible evidence against causality is not properly appreciated (worse delay and relief conditioning). Under conditions of low dopamine, we furthermore observe a compensatory role for serotonin that is pronounced in trace conditioning, weaker in delay conditioning, and absent in relief conditioning. We discuss a disturbed dopamine-serotonin balance as an endophenotype for the positive and cognitive symptoms in schizophrenia. ### Competing Interest Statement The authors have declared no competing interest.

The way neurons in the brain rewire in larvae as they turn to adult fruit flies sheds light on how complete metamorphosis was 'invented' over the course of evolution.

Neuronally orchestrated muscular movement and locomotion are defining faculties of multicellular animals. Due to its simple brain and genetic accessibility, the larva of the fruit fly Drosophila melanogaster allows one to study these processes at tractable levels of complexity. However, although the faculty of locomotion clearly pertains to the individual, most studies of locomotion in larvae use measurements aggregated across animals, or animals tested one by one, an extravagance for larger-scale analyses. This prevents grasping the inter- and intra-individual variability in locomotion and its neurogenetic determinants. Here, we present the IMBA (individual maggot behaviour analyser) for analysing the behaviour of individual larvae within groups, reliably resolving individual identity across collisions. We use the IMBA to systematically describe the inter- and intra-individual variability in locomotion of wild-type animals, and how the variability is reduced by associative learning. We then report a novel locomotion phenotype of an adhesion GPCR mutant. We further investigated the modulation of locomotion across repeated activations of dopamine neurons in individual animals, and the transient backward locomotion induced by brief optogenetic activation of the brain-descending ‘mooncrawler’ neurons. In summary, the IMBA is an easy-to-use toolbox allowing an unprecedentedly rich view of the behaviour and its variability of individual larvae, with utility in multiple biomedical research contexts.

Larvae of the fruit fly Drosophila melanogaster are a powerful study case for understanding the neural circuits underlying behavior. Indeed, the numerical simplicity of the larval brain has permitted the reconstruction of its synaptic connectome, and genetic tools for manipulating single, identified neurons allow neural circuit function to be investigated with relative ease and precision. We focus on one of the most complex neurons in the brain of the larva (of either sex), the GABAergic anterior paired lateral neuron (APL). Using behavioral and connectomic analyses, optogenetics, Ca2+ imaging, and pharmacology, we study how APL affects associative olfactory memory. We first provide a detailed account of the structure, regional polarity, connectivity, and metamorphic development of APL, and further confirm that optogenetic activation of APL has an inhibiting effect on its main targets, the mushroom body Kenyon cells. All these findings are consistent with the previously identified function of APL in the sparsening of sensory representations. To our surprise, however, we found that optogenetically activating APL can also have a strong rewarding effect. Specifically, APL activation together with odor presentation establishes an odor-specific, appetitive, associative short-term memory, whereas naive olfactory behavior remains unaffected. An acute, systemic inhibition of dopamine synthesis as well as an ablation of the dopaminergic pPAM neurons impair reward learning through APL activation. Our findings provide a study case of complex circuit function in a numerically simple brain, and suggest a previously unrecognized capacity of central-brain GABAergic neurons to engage in dopaminergic reinforcement.SIGNIFICANCE STATEMENT The single, identified giant anterior paired lateral (APL) neuron is one of the most complex neurons in the insect brain. It is GABAergic and contributes to the sparsening of neuronal activity in the mushroom body, the memory center of insects. We provide the most detailed account yet of the structure of APL in larval Drosophila as a neurogenetically accessible study case. We further reveal that, contrary to expectations, the experimental activation of APL can exert a rewarding effect, likely via dopaminergic reward pathways. The present study both provides an example of unexpected circuit complexity in a numerically simple brain, and reports an unexpected effect of activity in central-brain GABAergic circuits.

Excel file with source data, as well as precise sample sizes and results of statistical tests, of all figures and supplementary figures of this study. Each tab includes the data of one figure. Within each tab, the data are organised according to subfigures, with the data to the left and the sample sizes and statistical results to the right.

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

ABSTRACTMemory scores are dynamic across developmental stages. In particular, memory scores typically decrease from late adolescence into old age, reflecting complex changes in mnemonic and sensory-motor faculties, metabolic and motivational changes, and changes in cognitive strategy as well. In Drosophila melanogaster, such age-related decreases in memory scores have been studied intensely for the association of odours with electric shock punishment. We report that odour-sucrose reward memory scores likewise decrease as the flies age. This was observed after one-trial and after two-trial conditioning, and for both immediate testing and for recall tests one day later. This decrease was already particularly pronounced in relatively young animals, in the first 2-3 weeks after adult hatching, and was more pronounced in female than in male flies.

AbstractNeuronally orchestrated muscular movement and locomotion are defining faculties of multicellular animals. Due to its numerically simple brain and neuromuscular system and its genetic accessibility, the larva of the fruit flyDrosophila melanogasteris an established model to study these processes at tractable levels of complexity. However, although the faculty of locomotion clearly pertains to the individual animal, present studies of locomotion in larvalDrosophilamostly use group assays and measurements aggregated across individual animals. The alternative is to measure animals one at a time, an extravagance for larger-scale analyses. In principle or in practice, this in particular rules out grasping the inter- and intra-individual variability in locomotion and its genetic and neuronal determinants. Here we present the IMBA (Individual Maggot Behaviour Analyser) for tracking and analysing the behaviour of individual larvae within groups. Using a combination of computational modelling and statistical approaches, the IMBA reliably resolves individual identity across collisions. It does not require specific hardware and can therefore be used in non-expert labs. We take advantage of the IMBA first to systematically describe the inter- and intra-individual variability in free, unconstrained locomotion in wild-type animals. We then report the discovery of a novel, complex locomotion phenotype of a mutant lacking an adhesion-type GPCR. The IMBA further allows us to determine, at the level of individual animals, the modulation of locomotion across repeated activations of dopamine neurons. Strikingly, IMBA can also be used to analyse ‘silly walks’, that is patterns of locomotion it was not originally designed to investigate. This is shown for the transient backward locomotion induced by brief optogenetic activation of the brain-descending ‘mooncrawler’ neurons, and the variability in this behaviour. Thus, the IMBA is an easy-to-use toolbox allowing an unprecedentedly rich view of the behaviour and behavioural variability of individualDrosophilalarvae, with utility in multiple biomedical research contexts.

ABSTRACT Animals, including humans, form oppositely valenced memories for stimuli that predict the occurrence versus the termination of a reward: appetitive ‘reward’ memory for stimuli associated with the occurrence of a reward and aversive ‘frustration’ memory for stimuli that are associated with its termination. We characterized these memories in larval Drosophila melanogaster using a combination of Pavlovian conditioning, optogenetic activation of the dopaminergic central-brain DAN-i1864 neuron, and high-resolution video-tracking. This reveals their dependency on the number of training trials and the duration of DAN-i1864 activation, their temporal stability, and the parameters of locomotion that are modulated during memory expression. Together with previous results on ‘punishment’ versus ‘relief’ learning by DAN-f1 neuron activation, this reveals a 2×2 matrix of timing-dependent memory valence for the occurrence/termination of reward/punishment. These findings should aid the understanding and modelling of how brains decipher the predictive, causal structure of events around a target reinforcing occurrence.

Dopamine serves many functions, and dopamine neurons are correspondingly diverse. We use a combination of optogenetics, behavioral experiments, and high-resolution video-tracking to probe for the functional capacities of two single, identified dopamine neurons in larval Drosophila. The DAN-f1 and the DAN-d1 neuron were recently found to carry aversive teaching signals during Pavlovian olfactory learning. We enquire into a fundamental feature of these teaching signals, namely their temporal "fingerprint". That is, receiving punishment feels bad, whereas being relieved from it feels good, and animals and humans alike learn with opposite valence about the occurrence and the termination of punishment (the same principle applies in the appetitive domain, with opposite sign). We find that DAN-f1 but not DAN-d1 can mediate such timing-dependent valence reversal: presenting an odor before DAN-f1 activation leads to learned avoidance of the odor (punishment memory), whereas presenting the odor upon termination of DAN-f1 activation leads to learned approach (relief memory). In contrast, DAN-d1 confers punishment memory only. These effects are further characterized in terms of the impact of the duration of optogenetic activation, the temporal stability of the memories thus established, and the specific microbehavioral patterns of locomotion through which they are expressed. Together with recent findings in the appetitive domain and from adult Drosophila, our results suggest that heterogeneity in the temporal fingerprint of teaching signals might be a more general principle of reinforcement processing through dopamine neurons.

Larval Drosophila are used as a genetically accessible study case in many areas of biological research. Here we report a fast, robust and user-friendly procedure for the whole-body multi-fluorescence imaging of Drosophila larvae; the protocol has been optimized specifically for larvae by systematically tackling the pitfalls associated with clearing this small but cuticularized organism. Tests on various fluorescent proteins reveal that the recently introduced monomeric infrared fluorescent protein (mIFP) is particularly suitable for our approach. This approach comprises an effective, low-cost clearing protocol with minimal handling time and reduced toxicity in the reagents employed. It combines a success rate high enough to allow for small-scale screening approaches and a resolution sufficient for cellular-level analyses with light sheet and confocal microscopy. Given that publications and database documentations typically specify expression patterns of transgenic driver lines only within a given organ system of interest, the present procedure should be versatile enough to extend such documentation systematically to the whole body. As examples, the expression patterns of transgenic driver lines covering the majority of neurons, or subsets of chemosensory, central brain or motor neurons, are documented in the context of whole larval body volumes (using nsyb-Gal4, IR76b-Gal4, APL-Gal4 and mushroom body Kenyon cells, or OK371-Gal4, respectively). Notably, the presented protocol allows for triple-color fluorescence imaging with near-infrared, red and yellow fluorescent proteins.

An adaptive transition from exploring the environment in search of vital resources to exploiting these resources once the search was successful is important to all animals. Here we study the neuronal circuitry that allows larval Drosophila melanogaster of either sex to negotiate this exploration-exploitation transition. We do so by combining Pavlovian conditioning with high-resolution behavioral tracking, optogenetic manipulation of individually identified neurons, and EM data-based analyses of synaptic organization. We find that optogenetic activation of the dopaminergic neuron DAN-i1 can both establish memory during training and acutely terminate learned search behavior in a subsequent recall test. Its activation leaves innate behavior unaffected, however. Specifically, DAN-i1 activation can establish associative memories of opposite valence after paired and unpaired training with odor, and its activation during the recall test can terminate the search behavior resulting from either of these memories. Our results further suggest that in its behavioral significance DAN-i1 activation resembles, but does not equal, sugar reward. Dendrogram analyses of all the synaptic connections between DAN-i1 and its two main targets, the Kenyon cells and the mushroom body output neuron MBON-i1, further suggest that the DAN-i1 signals during training and during the recall test could be delivered to the Kenyon cells and to MBON-i1, respectively, within previously unrecognized, locally confined branching structures. This would provide an elegant circuit motif to terminate search on its successful completion. SIGNIFICANCE STATEMENT In the struggle for survival, animals have to explore their environment in search of food. Once food is found, however, it is adaptive to prioritize exploiting it over continuing a search that would now be as pointless as searching for the glasses you are wearing. This exploration-exploitation trade-off is important for animals and humans, as well as for technical search devices. We investigate which of the only 10,000 neurons of a fruit fly larva can tip the balance in this trade-off, and identify a single dopamine neuron called DAN-i1 that can do so. Given the similarities in dopamine neuron function across the animal kingdom, this may reflect a general principle of how search is terminated once it is successful.

This special issue is dedicated to ‘Future Perspectives of Neurogenetics’ in honor of Troy D. Zars (1967–2018). It is intended to offer insight and inspiration for our understanding of how adaptive...

Dopaminergic neurons (DANs) drive learning across the animal kingdom, but the upstream circuits that regulate their activity and thereby learning remain poorly understood. We provide a synaptic-resolution connectome of the circuitry upstream of all DANs in a learning center, the mushroom body of Drosophila larva. We discover afferent sensory pathways and a large population of neurons that provide feedback from mushroom body output neurons and link distinct memory systems (aversive and appetitive). We combine this with functional studies of DANs and their presynaptic partners and with comprehensive circuit modeling. We find that DANs compare convergent feedback from aversive and appetitive systems, which enables the computation of integrated predictions that may improve future learning. Computational modeling reveals that the discovered feedback motifs increase model flexibility and performance on learning tasks. Our study provides the most detailed view to date of biological circuit motifs that support associative learning.