: EEG measures have become prominent with the increasing popularity of non-invasive, portable EEG sensors for neuro-physiological measures to assess cognitive load. In this paper, utilizing a four-channel wearable EEG device, the brain activity data from eleven participants were recorded while watching a relaxation video and performing three cognitive load tasks. The data was pre-processed using outlier rejection based on a movement filter, spectral filtering, common average referencing, and normalization. Four frequency-domain feature sets were extracted from 30-second windows encompassing the power of δ , θ , α , β and γ frequency bands, the respective ratios, and the asymmetry features of each band. A personalized and generalized model was built for the binary classification between the relaxation and cognitive load tasks and self-reported labels. The asymmetry feature set outperformed the band ratio feature sets with a mean classification accuracy of 81.7% for the personalized model and 78% for the generalized model. A similar result for the models from the self-reported labels necessitates utilizing asymmetry features for cognitive load classification. Extracting high-level features from asymmetry features in the future may surpass the performance. Moreover, the better performance of the personalized model leads to future work to update pre-trained generalized models on personal data.

Multiple sclerosis (MS) is a neuroinflammatory disease that affects millions of people worldwide. Since dysarthria is prominent in people with MS (pwMS), this paper aims to identify acoustic features that differ between people with MS and healthy controls (HC). Additionally, we develop automatic classification methods to distinguish between pwMS and HC. In this work, we present a new dataset of a German-speaking cohort which contains 39 patients with low disability of relapsing MS and 16 HC. Findings suggest that certain interpretable speech features could be useful in diagnosing MS, and that machine learning methods could potentially support fast and unobtrusive screening in clinical practice. The study emphasises the importance of analysing free speech compared to read speech

Psychology and nutritional science research has highlighted the impact of negative emotions and cognitive load on calorie consumption behaviour using subjective questionnaires. Isolated studies in other domains objectively assess cognitive load without considering its effects on eating behaviour. This study aims to explore the potential for developing an integrated eating behaviour assistant system that incorporates cognitive load factors. Two experimental sessions were conducted using custom-developed experimentation software to induce different stimuli. During these sessions, we collected 30 h of physiological, food consumption, and affective states questionnaires data to automatically detect cognitive load and analyse its effect on food choice. Utilising grid search optimisation and leave-one-subject-out cross-validation, a support vector machine model achieved a mean classification accuracy of 85.12% for the two cognitive load tasks using eight relevant features. Statistical analysis was performed on calorie consumption and questionnaire data. Furthermore, 75% of the subjects with higher negative affect significantly increased consumption of specific foods after high-cognitive-load tasks. These findings offer insights into the intricate relationship between cognitive load, affective states, and food choice, paving the way for an eating behaviour assistant system to manage food choices during cognitive load. Future research should enhance system capabilities and explore real-world applications.

Quantifying neurological disorders from voice is a rapidly growing field of research and holds promise for unobtrusive and large-scale disorder monitoring. The data recording setup and data analysis pipelines are both crucial aspects to effectively obtain relevant information from participants. Therefore, we performed a systematic review to provide a high-level overview of practices across various neurological disorders and highlight emerging trends. PRISMA-based literature searches were conducted through PubMed, Web of Science, and IEEE Xplore to identify publications in which original (i.e., newly recorded) datasets were collected. Disorders of interest were psychiatric as well as neurodegenerative disorders, such as bipolar disorder, depression, and stress, as well as amyotrophic lateral sclerosis amyotrophic lateral sclerosis, Alzheimer's, and Parkinson's disease, and speech impairments (aphasia, dysarthria, and dysphonia). Of the 43 retrieved studies, Parkinson's disease is represented most prominently with 19 discovered datasets. Free speech and read speech tasks are most commonly used across disorders. Besides popular feature extraction toolkits, many studies utilise custom-built feature sets. Correlations of acoustic features with psychiatric and neurodegenerative disorders are presented. In terms of analysis, statistical analysis for significance of individual features is commonly used, as well as predictive modeling approaches, especially with support vector machines and a small number of artificial neural networks. An emerging trend and recommendation for future studies is to collect data in everyday life to facilitate longitudinal data collection and to capture the behavior of participants more naturally. Another emerging trend is to record additional modalities to voice, which can potentially increase analytical performance.

Cognitive load is frequently induced in laboratory setups to measure responses to stress, and its impact on voice has been studied in the field of computational paralinguistics. One dataset on this topic was provided in the Computational Paralinguistics Challenge (ComParE) 2014, and therefore offers great comparability. Recently, transformer-based deep learning architectures established a new state-of-the-art and are finding their way gradually into the audio domain. In this context, we investigate the performance of popular transformer architectures in the audio domain on the ComParE 2014 dataset, and the impact of different pre-training and fine-tuning setups on these models. Further, we recorded a small custom dataset, designed to be comparable with the ComParE 2014 one, to assess cross-corpus model generalisability. We find that the transformer models outperform the challenge baseline, the challenge winner, and more recent deep learning approaches. Models based on the ‘large’ architecture perform well on the task at hand, while models based on the ‘base’ architecture perform at chance level. Fine-tuning on related domains (such as ASR or emotion), before fine-tuning on the targets, yields no higher performance compared to models pre-trained only in a self-supervised manner. The generalisability of the models between datasets is more intricate than expected, as seen in an unexpected low performance on the small custom dataset, and we discuss potential ‘hidden’ underlying discrepancies between the datasets. In summary, transformer-based architectures outperform previous attempts to quantify cognitive load from voice. This is promising, in particular for healthcare-related problems in computational paralinguistics applications, since datasets are sparse in that realm.

With the COVID-19 pandemic, several research teams have reported successful advances in automated recognition of COVID-19 by voice. Resulting voice-based screening tools for COVID-19 could support large-scale testing efforts. While capabilities of machines on this task are progressing, we approach the so far unexplored aspect whether human raters can distinguish COVID-19 positive and negative tested speakers from voice samples, and compare their performance to a machine learning baseline. To account for the challenging symptom similarity between COVID-19 and other respiratory diseases, we use a carefully balanced dataset of voice samples, in which COVID-19 positive and negative tested speakers are matched by their symptoms alongside COVID-19 negative speakers without symptoms. Both human raters and the machine struggle to reliably identify COVID-19 positive speakers in our dataset. These results indicate that particular attention should be paid to the distribution of symptoms across all speakers of a dataset when assessing the capabilities of existing systems. The identification of acoustic aspects of COVID-19-related symptom manifestations might be the key for a reliable voice-based COVID-19 detection in the future by both trained human raters and machine learning models. Copyright ©2021 ISCA.

INTRODUCTION: Dementia is a syndrome characterised by a decline in memory, language, and problem-solving thataffects the ability of patients to perform everyday activities. Patients with dementia tend to experience episodes of anxietyand remain for extended periods, which affects their quality of life.OBJECTIVES: To design AnxiDetector, a system capable of detecting patterns of sounds associated before and during themanifestation of anxiety in patients with dementia.METHODS: We conducted a non-participatory observation of 70 diagnosed patients in-situ, and conducted semi-structuredinterviews with four caregivers at a residential centre. Using the findings from our observation and caregiver interviews, wedeveloped the AnxiDetector prototype and tested this in an experimental setting where we defined nine classes of audio torepresent two groups of sounds: (i) Disturbance which includes audio files that characterise sounds that trigger anxiety inpatients with dementia, and (ii) Expression which includes audio files that characterise sounds expressed by the patientsduring episodes of anxiety. We conducted two experimental classifications of sounds using (i) a Neural Network modeltrained and (ii) a Support Vector Machine model. The first evaluation consists of a binary discriminating between the twogroups of sounds; the second evaluation discriminates the nine classes of audio. The audio resources were retrieved frompublicly available datasets.RESULTS: The qualitative results present the views of the caregivers on the adoption of AnxiDetector. The quantitativeresults from our binary discrimination show a classification accuracy of 98.1% and 99.2% for the Deep Neural Network andSupport Vector Machine models, respectively. When classifying the nine classes of sound, our model shows a classificationaccuracy of 92.2%. Whereas, the Support Vector Machine model yielded an overall classification accuracy of 93.0%.CONCLUSION: In this paper, we presented the outcomes from an observational study in-site at a residential care centre,qualitative findings from interviews with caregivers, the design of AnxiDetector, and preliminary qualitative results of amethodology devised to detect relevant acoustic events associated with anxiety in patients with dementia. We conclude bysignalling future plans to conduct in-situ validation of the effectiveness of AnxiDetector for anxiety detection.