The multimodal approach where cognition is embodied in language, perceptual, motor, and emotional systems is a widely agreed theoretical framework for conceptual representations. However, the lack of work supporting this view of cognition in healthy and pathological aging stands in stark contrast with the ongoing need to understand the factors that uncover semantic degradation in brain pathologies. The aim of this study is to explore the impact of perceptual strength (PS) - i.e., the extent to which a word can be experienced by multiple sensory modalities - in visual word recognition in Alzheimer's disease (AD). Thirty-six healthy participants, 22 participants in the mild stage of AD (AD1) and 20 in the moderate stage (AD2) took part in a lexical decision task with two conditions: words with high vs low PS words. Results showed an interaction effect only between healthy controls and AD1 individuals, revealing that the latter were faster in processing high PS words in contrast to low PS words, while this was not the case for healthy individuals. Furthermore, it was specifically the ratings of the neuropsychological executive and lexical-semantic assessments that predicted these results. However, no results were observed for AD2 participants, suggesting that lexical-semantic degradation was too severe to reveal a PS effect. This study demonstrates the importance of considering the perceptual dimension when examining the conceptual system and opens up new avenues in the exploration of semantic impairment in AD.
Embodied approach postulates that knowledge and conceptual representations are grounded in action and perception. In order to investigate the involvement of sensorimotor information in conceptual and cognitive processing, researchers have collected various norms in young adults. For instance, the perceptual strength (PS) assesses perceptual experience (i.e. visual, auditory, haptic, gustatory, olfactory) associated with a concept and the body-object-interaction (BOI) assesses the ease with which a human body can interact with the referent of a word. The importance of both BOI and PS in the multimodal composition of word meaning is today well recognized. However, given the sensorimotor development of the individual from childhood to later life, it is likely that different age periods are associated with different perceptual experience and capacity to interact with objects. The purpose of this research is to investigate exploratory the effect of age on PS and BOI by comparing the evaluation of 270 French language words by young adults and healthy older people. The results showed that older adults presented similar or even higher PS for some modalities (e.g. gustatory and olfactory) and in particular for certain categories of words, while the BOI decreases. In addition to the importance of adjusting the verbal stimuli used in aging studies when dealing with multimodal representations, our results will lead us to discuss the evolution of sensorimotor representations with age.
Brain Computer Interfaces (BCIs) consist of an interaction between humans and computers with a specific mean of communication, such as voice, gestures, or even brain signals that are usually recorded by an Electroencephalogram (EEG). To ensure an optimal interaction, the BCI algorithm typically involves the classification of the input signals into predefined task-specific categories. However, a recurrent problem is that the classifier can easily be biased by uncontrolled experimental conditions, namely covariates, that are unbalanced across the categories. This issue led to the current solution of forcing the balance of these covariates across the different categories which is time consuming and drastically decreases the dataset diversity. The purpose of this research is to evaluate the need for this forced balance in BCI experiments involving EEG data. A typical design of neural BCIs involves repeated experimental trials using visual stimuli to trigger the so-called Event-Related Potential (ERP). The classifier is expected to learn spatio-temporal patterns specific to categories rather than patterns related to uncontrolled stimulus properties, such as psycho-linguistic variables (e.g., phoneme number, familiarity, and age of acquisition) and image properties (e.g., contrast, compactness, and homogeneity). The challenges are then to know how biased the decision is, which features affect the classification the most, which part of the signal is impacted, and what is the probability to perform neural categorization per se. To address these problems, this research has two main objectives: (1) modeling and quantifying the covariate effects to identify spatio-temporal regions of the EEG allowing maximal classification performance while minimizing the biasing effect, and (2) evaluating the need to balance the covariates across categories when studying brain mechanisms. To solve the modeling problem, we propose using a linear parametric analysis applied to some observable and commonly studied covariates to them. The biasing effect is quantified by comparing the regions highly influenced by the covariates with the regions of high categorical contrast, i.e., parts of the ERP allowing a reliable classification. The need to balance the stimulus's inner properties across categories is evaluated by assessing the separability between category-related and covariate-related evoked responses. The procedure is applied to a visual priming experiment where the images represent items belonging to living or non-living entities. The observed covariates are the commonly controlled psycho-linguistic variables and some visual features of the images. As a result, we identified that the category of the stimulus mostly affects the late evoked response. The covariates, when not modeled, have a biasing effect on the classification, essentially in the early evoked response. This effect increases with the diversity of the dataset and the complexity of the algorithm used. As the effects of both psycho-linguistic variables and image features appear outside of the spatio-temporal regions of significant categorical contrast, the proper selection of the region of interest makes the classification reliable. Having proved that the covariate effects can be separated from the categorical effect, our framework can be further used to isolate the category-dependent evoked response from the rest of the EEG to study neural processes involved when seeing living vs. non-living entities.
Perceptual experience through the five modalities (i.e., vision, hearing, touch, taste, and smell) has demonstrated its key role in semantics. Researchers also highlighted the role of interoceptive information in the grounded representation of concepts. However, to this day, there is no available data across these modalities in the French language. Therefore, the aim of this study was to circumvent this caveat. Participants aged between 18 and 50 completed an online survey in which we recorded scores of perceptual strength (PS), interoceptive information, imageability, concreteness, conceptual familiarity, and age of acquisition of 270 words of the French language. We also analysed the relationships between perceptual modalities and psycholinguistic variables. Results showed that vast majority of concepts were visually-dominant. Correlation analyses revealed that the five PS variables were strongly correlated with imageability, concreteness, and conceptual familiarity and highlight that PS variables index one aspect of the semantic representations of a word. On the other hand, high interoceptive scores were highlighted only for the less imageable and less concrete words, emphasizing their importance for the grounding of abstract concepts. Future research could use these norms in the investigation of the role of perceptual experience in the representation of concepts and their impact on word processing.
Bibliographie -Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & Van Ijzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychological bulletin, 133(1), 1. Batty, M., & Taylor, M. J. (2006). The development of emotional face processing during childhood. Developmental science, 9(2), 207-220. Cisler, J. M., & Koster, E. H. (2010). Mechanisms of attentional biases towards threat in anxiety disorders: An integrative review. Clinical psychology review, 30(2), 203-216. Eimer, M., & Holmes, A. (2007). Event-related brain potential correlates of emotional face processing. Neuropsychologia, 45(1), 15-31. Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: attentional control theory. Emotion, 7(2), 336. Lonigan, C. J., & Phillips, B. M. (2001). Temperamental influences on the development of anxiety disorders. Rossignol, M., Philippot, P., Douilliez, C., Crommelinck, M., & Campanella, S. (2005). The perception of fearful and happy facial expression is modulated by anxiety: an event-related potential study. Neuroscience letters, 377(2), 115-120. Waters, A. M., Henry, J., Mogg, K., Bradley, B. P., & Pine, D. S. (2010). Attentional bias towards angry faces in childhood anxiety disorders. Journal of Behavior Therapy and Experimental Psychiatry, 41(2), 158-164. Waters, A. M., Mogg, K., Bradley, B. P., & Pine, D. S. (2008). Attentional bias for emotional faces in children with generalized anxiety disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 47(4), 435-442.