Active Inference is a recently developed framework for modeling decision processes under uncertainty. Over the last several years, empirical and theoretical work has begun to evaluate the strengths and weaknesses of this approach and how it might be extended and improved. One recent extension is the "sophisticated inference" (SI) algorithm, which improves performance on multi-step planning problems through a recursive decision tree search. However, little work to date has been done to compare SI to other established planning algorithms in reinforcement learning (RL). In addition, SI was developed with a focus on inference as opposed to learning. The present paper therefore has two aims. First, we compare performance of SI to Bayesian RL schemes designed to solve similar problems. Second, we present and compare an extension of SI - sophisticated learning (SL) - that more fully incorporates active learning during planning. SL maintains beliefs about how model parameters would change under the future observations expected under each policy. This allows a form of counterfactual retrospective inference in which the agent considers what could be learned from current or past observations given different future observations. To accomplish these aims, we make use of a novel, biologically inspired environment that requires an optimal balance between goal-seeking and active learning, and which was designed to highlight the problem structure for which SL offers a unique solution. This setup requires an agent to continually search an open environment for available (but changing) resources in the presence of competing affordances for information gain. Our simulations demonstrate that SL outperforms all other algorithms in this context - most notably, Bayes-adaptive RL and upper confidence bound (UCB) algorithms, which aim to solve multi-step planning problems using similar principles (i.e., directed exploration and counterfactual reasoning about belief updates given different possible actions/observations). These results provide added support for the utility of Active Inference in solving this class of biologically-relevant problems and offer added tools for testing hypotheses about human cognition.
The neuropsychological disorder of anosognosia for hemiplegia (AHP) can offer unique insights into the neurocognitive processes of body consciousness and representation. Previous studies have found associations between selective social cognition deficits and anosognosia. In this study, we examine how such social cognition deficits may directly interact with representations of one’s body as disabled in AHP. To this end, we modified a set of previously validated Theory of Mind stories to create content that was related to post-stroke paralysis and to investigate differences between right hemisphere damage patients with (n = 19) and without (n = 19) AHP. We expected AHP patients to perform worse than controls when trying to infer paralysis-related mental states, and explored whether such differences further depended on the kind of inference patients were asked to perform (e.g. from a first versus a third person perspective). Using an advanced structural neuroimaging technique, we expected selective social cognitive deficits to be associated with posterior parietal cortex lesions, and the difficulty to associate self -beliefs with paralysis during mentalising to be associated with frontoparietal disconnections. Group and individual level results revealed that AHP patients performed worse than HP controls when trying to infer paralysis-related mental states, possibly driven by both social cognition deficits per se and more specific difficulties to take the perspective of paralysed individual. Lesion analyses results were significant only at exploratory levels, revealing some of the hypothesised lesions but also unexpected white matter disconnections in the posterior body and splenium of the corpus collosum as related to deficits-related self-referent perspective taking. The study has implications for the multi-layered nature of body awareness, including abstract, social perspectives and beliefs about the body.
Traditionally, emotions in dreams have been assessed using subjective ratings by human raters (e.g., external raters or dreamers themselves). These methods have extensive support and utility in dream science, yet they have certain innate limitations due to the subjective nature of the rating methodologies. Attempting to circumvent several of these limitations, we aimed to develop a novel method for objectively classifying and quantifying sequential (word-for-word) emotion within a dream report. We investigated whether sentiment analysis, a branch of natural language processing, could be used to generate continuous positive and negative valence ratings across a dream. In this pilot, proof-of-concept study, we used 14 dream reports collected upon awakening following overnight polysomnography. We also collected pre- and post-sleep affective data and personality metrics. Our objectives included demonstrating that (1) valence ratings derived from sentiment analysis (Valence Aware Dictionary for sEntiment Reasoning [VADER]) could be used to visualize (plot) positive and negative emotion fluctuations within a dream, (2) how the visual properties of emotion fluctuations within a dream (peaks and troughs, area under the curve) can be used to generate novel “emotion indicators” as proxies for emotion regulation throughout a dream, and (3) these emotion indicators correlate with sleep, affective, and personality variables known to be associated with dreaming and emotion regulation. We describe 6 novel, objective dream emotion indicators: Total number of Peaks, total number of Troughs, Positive, Negative, and Overall Emotion Intensity (composites from an “area under the curve” method using the trapezoid rule applied to the peaks and troughs), and the Emotion Gradient (a polynomial trendline fitted to the emotion fluctuations in the dream chart). The latter signifies the overall direction of sequential emotion changes within a dream. Results also showed that ⅚ emotion indicators correlated significantly with at least one existing sleep, affective, or personality variable known to be associated with dreaming and emotion regulation. We propose that the novel emotion indicators potentially serve as proxies for emotion regulation processes unfolding within a dream. These preliminary findings provide a methodological foundation for future studies to test and refine the method in larger and more diverse samples.
Traditionally, adult and neonatal cerebral perfusion have been presumed to be symmetrical. Contrary to this, our adult work shows that supra-aortic cerebral supply is systematically biased towards the left, in terms of both vessel geometry and blood flow volumes. Although this asymmetry is meaningfully related to hand preference, the developmental origins of this association remain unknown. Our detailed investigations of the cerebral vasculature confirm analogous asymmetries in term neonates. Specifically, we demonstrate that the structure and flow of neonatal middle cerebral vessels are consistently asymmetric and predominantly left-dominant. Building on our work from the same cohort, we now report further analyses of these new-found asymmetries. Namely, exploring for the first time, the relationship between arterial lateral biases and the neonatal head-turning response—a reliable early behavioural precursor of handedness that shows a systematic rightward bias in the population. Here, we demonstrate a contralateral relationship between vessel morphology and primitive expressions of lateralisation that predate the establishment of definitive handedness in the course of postnatal development. This relationship mimics patterns observed in adults and suggests that lateralising trends in angiogenesis may ultimately influence the emergence of human lateral preferences.
Here we build on recent findings which show that greater alignment between our subjective experiences (how we feel) and physiological states (measurable changes in our body) plays a pivotal role in the overall psychological well-being. Specifically, we propose that the alignment or 'coherence' between affective arousal (e.g. how excited we 'feel') and autonomic arousal (e.g. heart rate or pupil dilation) may be key for maintaining up-to-date uncertainty representations in dynamic environments. Drawing on recent advances in interoceptive and affective inference, we also propose that arousal coherence reflects interoceptive integration, facilitates adaptive belief updating, and impacts our capacity to adapt to changes in uncertainty, with downstream consequences to well-being. We also highlight the role of meta-awareness of arousal, a third level of inference, which may permit conscious awareness, learning about, and intentional regulation of lower-order sources of arousal. Practices emphasizing meta-awareness of arousal (like meditation) may therefore elicit some of their known benefits via improved arousal coherence. We suggest that arousal coherence is also likely to be associated with markers of adaptive functioning (like emotional awareness and self-regulatory capacities) and discuss mind-body practices that may increase coherence.
Patients view their negative emotions as troublesome and they expect psychiatrists to deal with them, often wanting them taken away. We present a neuropsychoanalytical understanding of the essential biological function of emotion and how it influences behaviour. Through a vignette, we demonstrate how this understanding can contribute to the psychiatrist's management of the clinical encounter, in particular regarding the patient's expectations about their emotions and the pressures placed on the clinician.
Active Inference is a recent framework for modeling planning under uncertainty. Empirical and theoretical work have now begun to evaluate the strengths and weaknesses of this approach and how it might be improved. A recent extension - the sophisticated inference (SI) algorithm - improves performance on multi-step planning problems through recursive decision tree search. However, little work to date has been done to compare SI to other established planning algorithms. SI was also developed with a focus on inference as opposed to learning. The present paper has two aims. First, we compare performance of SI to Bayesian reinforcement learning (RL) schemes designed to solve similar problems. Second, we present an extension of SI - sophisticated learning (SL) - that more fully incorporates active learning during planning. SL maintains beliefs about how model parameters would change under the future observations expected under each policy. This allows a form of counterfactual retrospective inference in which the agent considers what could be learned from current or past observations given different future observations. To accomplish these aims, we make use of a novel, biologically inspired environment designed to highlight the problem structure for which SL offers a unique solution. Here, an agent must continually search for available (but changing) resources in the presence of competing affordances for information gain. Our simulations show that SL outperforms all other algorithms in this context - most notably, Bayes-adaptive RL and upper confidence bound algorithms, which aim to solve multi-step planning problems using similar principles (i.e., directed exploration and counterfactual reasoning). These results provide added support for the utility of Active Inference in solving this class of biologically-relevant problems and offer added tools for testing hypotheses about human cognition.
This paper aims to assess whether the recently proposed "inner screen model" of consciousness that follows from the free-energy principle (FEP) can be regarded as a minimal unifying model (MUM) of consciousness, thereby providing a common foundational model for consciousness studies, and integrating approaches to consciousness based on the FEP. We first present the inner screen model, which follows from applying the quantum information theoretic version of the FEP to the known sparse (nested and hierarchical) neuroanatomy of the brain. We then review models of consciousness that are premised on the FEP. Specifically, we review Bayesian versions of the global workspace and attention schema theories, theories premised on world-models and self-models, and models formalizing the computational structure and properties of time-consciousness. We then discuss how extant FEP-theoretic models of consciousness can be situated with respect to the candidate MUM.
Binocular rivalry is the perceptual dominance of one visual stimulus over another. Conventionally, binocular rivalry is induced using a mirror-stereoscope—a setup involving mirrors oriented at an angle to a display. The respective mirror planes fuse competing visual stimuli in the observer’s visual field by projecting the stimuli through the stereoscope to the observed visual field. Since virtual-reality head-mounted displays fuse dichoptic vision in a similar way, and since virtual-reality head-mounted displays are more versatile and more readily available than mirror stereoscopes, this study investigated the efficacy of using a virtual-reality headset (Oculus Rift-S) as an alternative to using a mirror stereoscope to study binocular rivalry. To evaluate the validity of using virtual-reality headsets to induce visual dominance/suppression, two identical experimental sequences—one using a conventional mirror stereoscope and one using a virtual-reality headset—were compared and evaluated. The study used Gabor patches at different orientations to induce binocular rivalry and to evaluate the efficacy of the two experiments. Participants were asked to record all instances of perceptual dominance (complete suppression) and non-dominance (incomplete suppression). Independent sample t-tests confirmed that binocular rivalry with stable vergence was successfully induced for the mirror-stereoscope experiment (t = −4.86; p ≤ 0.0001) and the virtual-reality experiment (t = −9.41; p ≤ 0.0001). Using ANOVA to compare Gabor patch pairs of gratings at +45°/−45° orientations presented in both visual fields, gratings at 0°/90° orientations presented in both visual fields, and mixed gratings (i.e., unconventional grating pairs) presented in both visual fields, the performance of the two experiments was evaluated by comparing observation duration in seconds (F = 0.12; p = 0.91) and the alternation rate per trial (F = 8.1; p = 0.0005). The differences between the stimulus groups were not statistically significant for the observation duration but were significantly different based on the alternation rates per trial. Moreover, ANOVA also showed that the dominance durations (F = 114.1; p < 0.0001) and the alternation rates (F = 91.6; p < 0.0001) per trial were significantly different between the mirror-stereoscope and the virtual-reality experiments, with the virtual-reality experiment showing an increase in alternation rate and a decrease in observation duration. The study was able to show that a virtual-reality head-mounted display can be used as an effective and novel alternative to induce binocular rivalry, but there were some differences in visual bi-stability between the two methods. This paper discusses the experimental measures taken to minimise piecemeal rivalry and to evaluate perceptual dominance between the two experimental designs.
AbstractBackgroundCognitive impairment is reported as a common complication in adult tuberculous meningitis (TBM), yet few studies have systematically assessed the frequency and nature of impairment. Moreover, the impact of impairment on functioning and medication adherence has not been described.MethodsA cognitive test battery (10 measures assessing 7 cognitive domains) was administered to 34 participants with human immunodeficiency virus (HIV)–associated TBM 6 months after diagnosis. Cognitive performance was compared with that a comparator group of 66 people with HIV without a history of tuberculosis. A secondary comparison was made between participants with TBM and 26 participants with HIV 6 months after diagnosis of tuberculosis outside the central nervous system (CNS). Impact on functioning was evaluated, including through assessment of medication adherence.ResultsOf 34 participants with TBM, 16 (47%) had low performance on cognitive testing. Cognition was impaired across all domains. Global cognitive performance was significantly lower in participants with TBM than in people with HIV (mean T score, 41 vs 48, respectively; P < .001). These participants also had lower global cognition scores than those with non-CNS tuberculosis (mean global T score, 41 vs 46; P = .02). Functional outcomes were not significantly correlated with cognitive performance in the subgroup of participants in whom this was assessed (n = 19).ConclusionsLow cognitive performance following HIV-associated TBM is common. This effect is independent of, and additional to, effects of HIV and non-CNS tuberculosis disease. Further studies are needed to understand longer-term outcomes, clarify the association with treatment adherence, a key predictor of outcome in TBM, and develop context-specific tools to identify individuals with cognitive difficulties in order to improve outcomes in TBM.
Neonatal and adult strokes are more common in the left than in the right cerebral hemisphere in the middle cerebral arterial territory, and adult extracranial and intracranial vessels are systematically left-dominant. The aim of the research reported here was to determine whether the asymmetric vascular ground plan found in adults was present in healthy term neonates (n = 97). A new transcranial Doppler ultrasonography dual-view scanning protocol, with concurrent B-flow and pulsed wave imaging, acquired multivariate data on the neonatal middle cerebral arterial structure and function. This study documents for the first-time systematic asymmetries in the middle cerebral artery origin and distal trunk of healthy term neonates and identifies commensurately asymmetric hemodynamic vulnerabilities. A systematic leftward arterial dominance was found in the arterial caliber and cortically directed blood flow. The endothelial wall shear stress was also asymmetric across the midline and varied according to vessels’ geometry. We conclude that the arterial structure and blood supply in the brain are laterally asymmetric in newborns. Unfavorable shearing forces, which are a by-product of the arterial asymmetries described here, might contribute to a greater risk of cerebrovascular pathology in the left hemisphere.
This chapter takes a neuropsychoanalytic approach to the 'hard problem' of consciousness. The starting point is Sigmund Freud's assertion that, although cognition is mostly unconscious, affect is intrinsically conscious. A feeling wouldn't be a feeling if you didn't feel it. This crucial difference between cognition and affect casts new light on David Chalmers's claim that consciousness cannot be explained mechanistically. If affect (unlike cognition) is indeed intrinsically conscious, then surely its mechanism must account for how and why it feels like something?
In recent decades, the research traditions of (first-person) embodied cognition and of (third-person) social cognition have approached the study of self-awareness with relative independence. However, neurological disorders of self-awareness offer a unifying perspective to empirically investigate the contribution of embodiment and social cognition to self-awareness. This study focused on a neuropsychological disorder of bodily selfawareness following right-hemisphere damage, namely anosognosia for hemiplegia (AHP). A previous neuropsychological study has shown AHP patients, relative to neurological controls, to have a specific deficit in thirdperson perspective taking and allocentric stance (the other unrelated to the self) in higher order mentalizing tasks. However, no study has tested if verbal awareness of motor deficits is influenced by perspective-taking and centrism and identified the related anatomical correlates. Accordingly, two novel experiments were conducted with right-hemisphere stroke patients with (n = 17) and without AHP (n = 17) that targeted either their own (egocentric, experiment 1) or another stooge patients (allocentric, experiment 2) motor abilities from a first-orthird person perspective. In both experiments, neurological controls showed no significant difference in perspective-taking, suggesting that social cognition is not a necessary consequence of right-hemisphere damage. More specifically, experiment 1 found AHP patients more aware of their own motor paralysis (egocentric stance) when asked from a third compared to a first-person perspective, using both group level and individual level analysis. In experiment 2, AHP patients were less accurate than controls in making allocentric judgements about the stooge patient, but with only a trend towards significance and with no difference between perspectives. As predicted, deficits in egocentric and allocentric third-person perspective taking were associated with lesions in the middle frontal gyrus, superior temporal and supramarginal gyri, and white matter disconnections were more prominent with deficits in allocentricity. Behavioural and neuroimaging results demonstrate the intersecting relationship between bodily self-awareness and self-and-other-directed metacognition or mentalisation.