The quantification of cognitive powers rests on identifying a behavioural task that depends on them. Such dependence cannot be assured, for the powers a task invokes cannot be experimentally controlled or constrained a priori, resulting in unknown vulnerability to failure of specificity and generalisability. Evaluating a compact version of Raven's Advanced Progressive Matrices (RAPM), a widely used clinical test of fluid intelligence, we show that LaMa, a self-supervised artificial neural network trained solely on the completion of partially masked images of natural environmental scenes, achieves representative human-level test scores a prima vista, without any task-specific inductive bias or training. Compared with cohorts of healthy and focally lesioned participants, LaMa exhibits human-like variation with item difficulty, and produces errors characteristic of right frontal lobe damage under degradation of its ability to integrate global spatial patterns. LaMa's narrow training and limited capacity suggest matrix-style tests may be open to computationally simple solutions that need not necessarily invoke the substrates of reasoning.
Influential theories of complex behaviour invoke the notion of cognitive control modulated by conflict between counterfactual actions. Medial frontal cortex, notably the anterior cingulate cortex, has been variously posited as critical to such conflict detection, resolution, or monitoring, largely based on correlative data from functional imaging. Examining performance on the most widely used "conflict" task-Stroop-in a large cohort of patients with focal brain injury (N = 176), we compare anatomical patterns of lesion-inferred neural substrate dependence to those derived from functional imaging, meta-analytically summarised. Our results show that whereas performance is sensitive to the integrity of left lateral frontal regions implicated by functional imaging, it does not depend on medial frontal cortex, despite sampling adequate to reveal robust medial effects in the context of phonemic fluency. We suggest that medial frontal cortex is not critically invoked by Stroop and proceed to review the conceptual grounds for rejecting the core notion of conflict-driven cognitive control.
Fluid intelligence is arguably the defining feature of human cognition. Yet the nature of its relationship with the brain remains a contentious topic. Influential proposals drawing primarily on functional imaging data have implicated “multiple demand” frontoparietal and more widely distributed cortical networks, but extant lesion-deficit studies with greater causal power are almost all small, methodologically constrained, and inconclusive. The task demands large samples of patients, comprehensive investigation of performance, fine-grained anatomical mapping, and robust lesion-deficit inference, yet to be brought to bear on it. We assessed 165 healthy controls and 227 frontal or non-frontal patients with unilateral brain lesions on the best-established test of fluid intelligence, Raven’s Advanced Progressive Matrices, employing an array of lesion-deficit inferential models responsive to the potentially distributed nature of fluid intelligence. Non-parametric Bayesian stochastic block models were used to reveal the community structure of lesion deficit networks, disentangling functional from confounding pathological distributed effects. Impaired performance was confined to patients with frontal lesions ( F (2,387) = 18.491; p < .001; frontal worse than non-frontal and healthy participants p < .01; p <.001), more marked on the right than left ( F (4,385) = 12.237; p < .001; right worse than left and healthy participants p <.01; p <.001). Patients with non-frontal lesions were indistinguishable from controls and showed no modulation by laterality. Neither the presence nor the extent of multiple demand network involvement affected performance. Both conventional network-based statistics and non-parametric Bayesian stochastic block modelling heavily implicated the right frontal lobe. Crucially, this localisation was confirmed on explicitly disentangling functional from pathology-driven effects within a layered stochastic block model, prominently highlighting a right frontal network involving middle and inferior frontal gyrus, pre- and post-central gyri, with a weak contribution from right superior parietal lobule. Similar results were obtained with standard lesion-deficit analyses. Our study represents the first large-scale investigation of the distributed neural substrates of fluid intelligence in the focally injured brain. Combining novel graph-based lesion-deficit mapping with detailed investigation of cognitive performance in a large sample of patients provides crucial information about the neural basis of intelligence. Our findings indicate that a set of predominantly right frontal regions, rather than a more widely distributed network, is critical to the high-level functions involved in fluid intelligence. Further they suggest that Raven’s Advanced Progressive Matrices is a useful clinical index of fluid intelligence and a sensitive marker of right frontal lobe dysfunction.
Raven's Advanced Progressive Matrices (APM) Set I is a validated and brief test of fluid intelligence, ideal for use in busy clinical settings. However, there is a dearth of normative data allowing an accurate interpretation of APM scores. To address this, we present normative data from across the adult lifespan (18-89 years) for the APM Set I. Data are presented in five age cohorts (total N = 352), including two older adult cohorts (65-79 years and 80-89 years), which allows age-standardized assessment. We also present data from a validated measure of premorbid intellectual ability, which was absent from previous standardizations of longer forms of the APM. In line with previous findings, a striking age-related decline was noted, beginning relatively early in adulthood and most marked amongst lower-scoring individuals. Older adults did not demonstrate difficulty with specific test items or make an increased proportion of specific errors. Sex was not a significant predictor of performance. The data set is of particular use in the neuropsychological assessment of older adults, given the known susceptibility of fluid intelligence to both the effects of normal ageing and acquired brain injury in older age. The results are discussed in light of theories of neurological ageing.
Abstract Though phonemic fluency tasks are traditionally indexed by the number of correct responses, the underlying disorder may shape the specific choice of words—both correct and erroneous. We report the first comprehensive qualitative analysis of incorrect and correct words generated on the phonemic (‘S’) fluency test, in a large sample of patients (n = 239) with focal, unilateral frontal or posterior lesions and healthy controls (n = 136). We conducted detailed qualitative analyses of the single words generated in the phonemic fluency task using categorical descriptions for different types of errors, low-frequency words and clustering/switching. We further analysed patients’ and healthy controls’ entire sequences of words by employing stochastic block modelling of Generative Pretrained Transformer 3–based deep language representations. We conducted predictive modelling to investigate whether deep language representations of word sequences improved the accuracy of detecting the presence of frontal lesions using the phonemic fluency test. Our qualitative analyses of the single words generated revealed several novel findings. For the different types of errors analysed, we found a non-lateralized frontal effect for profanities, left frontal effects for proper nouns and permutations and a left posterior effect for perseverations. For correct words, we found a left frontal effect for low-frequency words. Our novel large language model–based approach found five distinct communities whose varied word selection patterns reflected characteristic demographic and clinical features. Predictive modelling showed that a model based on Generative Pretrained Transformer 3–derived word sequence representations predicted the presence of frontal lesions with greater fidelity than models of native features. Our study reveals a characteristic pattern of phonemic fluency responses produced by patients with frontal lesions. These findings demonstrate the significant inferential and diagnostic value of characterizing qualitative features of phonemic fluency performance with large language models and stochastic block modelling.
Barriers to healthcare access are widespread in elderly populations, with a major consequence that older people are not benefiting from the latest technologies to diagnose disease. Recent advances in the automated analysis of speech show promising results in the identification of cognitive decline associated with Alzheimer's disease (AD), as well as its purported pre-clinical stage. We utilized automated methods to analyze speech recorded over the telephone in 91 community-dwelling older adults diagnosed with mild AD, amnestic mild cognitive impairment (aMCI) or cognitively healthy. We asked whether natural language processing (NLP) and machine learning could more accurately identify groups than traditional screening tools and be sensitive to subtle differences in speech between the groups. Despite variable recording quality, NLP methods differentiated the three groups with greater accuracy than two traditional dementia screeners and a clinician who read transcripts of their speech. Imperfect speech data collected via a telephone is of sufficient quality to be examined with the latest speech technologies. Critically, these data reveal significant differences in speech that closely match the clinical diagnoses of AD, aMCI and healthy control.
The voluntary generation of non-overlearned responses is usually assessed with phonemic fluency. Like most frontal tasks, it draws upon different complex processes and systems whose precise nature is still incompletely understood. Many claimed aspects regarding the pattern of phonemic fluency performance and its underlying anatomy remain controversial. Major limitations of past investigations include small sample size, scant analysis of phonemic output and methodologically insufficient lesion analysis approaches. We investigated a large number of patients with focal unilateral right or left frontal (n = 110) or posterior (n = 100) or subcortical (n = 65) lesions imaged with magnetic resonance or computed tomography and compared their performance on the number of overall responses, words produced over time, extremely infrequent/unknown words and inappropriate words generated. We also employed, for the first time parcel-based lesion-symptom mapping, tract-wise statistical analysis as well as Bayesian multi-variate analysis based on meta-analytically defined functional region of interest, including their interactions. We found that left frontal damage was associated with greater impairment than right frontal or posterior damage on overall fluency performance, suggesting that phonemic fluency shows specificity to frontal lesions. We also found that subcorticals, similar to frontals, performed significantly worse than posteriors on overall performance suggesting that subcortical regions are also involved. However, only frontal effects were found for words produced over time, extremely infrequent/unknown and inappropriate words. Parcel-based lesion-symptom mapping analysis found that worse fluency performance was associated with damage to the posterior segment of the left frontal middle and superior gyrus, the left dorsal anterior cingulate gyrus and caudate nucleus. Tract-wise statistical analysis revealed that disconnections of left frontal tracts are critical. Bayesian multi-variate models of lesions and disconnectome maps implicated left middle and inferior frontal and left dorsomedial frontal regions. Our study suggests that a set of well localized left frontal areas together with subcortical regions and several left frontal tracts are critical for word generation. We speculate that a left lateralized network exists. It involves medial, frontal regions supporting the process of 'energization' , which sustains activation for the duration of the task and middle and inferior frontal regions concerned with 'selection', required due to the competition produced by associated stored words, respectively. The methodology adopted represents a promising and empirically robust approach in furthering our understanding of the neurocognitive architecture underpinning executive processes.