Speech analysis can provide a potential non-invasive and objective means of assessing and monitoring an individual’s mental health. Most studies to date have focused on cross-sectional analysis and have not explored the benefits of speech analysis as a longitudinal monitoring tool that can assist in the management of chronic conditions such as major depressive disorder (MDD). Objectively monitoring for shifts in depression symptom severity levels over time presents a notable challenge, which we address through an automated approach using longitudinal English and Spanish speech samples collected from a clinical population. We employ time–frequency representations and linguistic embeddings to enhance the early recognition of alterations in depression levels in individuals with MDD. We investigate the suitability of using siamese-based training for modeling these changes, intending to enable personalized and adaptive interventions.
Background Cognitive symptoms are common during and following episodes of depression. Little is known about the persistence of self-reported and performance-based cognition with depression and functional outcomes. Methods This is a secondary analysis of a prospective naturalistic observational clinical cohort study of individuals with recurrent major depressive disorder (MDD; N = 623). Participants completed app-based self-reported and performance-based cognitive function assessments alongside validated measures of depression, functional disability, and self-esteem every 3 months. Participants were followed-up for a maximum of 2-years. Multilevel hierarchically nested modelling was employed to explore between- and within-participant variation over time to identify whether persistent cognitive difficulties are related to levels of depression and functional impairment during follow-up. Results 508 individuals (81.5%) provided data (mean age: 46.6, s.d. : 15.6; 76.2% female). Increasing persistence of self-reported cognitive difficulty was associated with higher levels of depression and functional impairment throughout the follow-up. In comparison to low persistence of objective cognitive difficulty (<25% of timepoints), those with high persistence (>75% of timepoints) reported significantly higher levels of depression ( B = 5.17, s.e. = 2.21, p = 0.019) and functional impairment ( B = 4.82, s.e. = 1.79, p = 0.002) over time. Examination of the individual cognitive modules shows that persistently impaired executive function is associated with worse functioning, and poor processing speed is particularly important for worsened depressive symptoms. Conclusions We replicated previous findings of greater persistence of cognitive difficulty with increasing severity of depression and further demonstrate that these cognitive difficulties are associated with pervasive functional disability. Difficulties with cognition may be an indicator and target for further treatment input.
Background: In time, we may be able to detect the early onset of symptoms of depression and even predict relapse using behavioural data gathered through mobile technologies. However, barriers to adoption exist and under-standing the importance of these factors to users is vital to ensure maximum adoption.Method: In a discrete choice experiment, people with a history of depression (N = 171) were asked to select their preferred technology from a series of vignettes containing four characteristics: privacy, clinical support, estab-lished benefit and device accuracy (i.e., ability to detect symptoms), with different levels. Mixed logit models were used to establish what was most likely to affect adoption. Sub-group analyses explored effects of age, gender, education, technology acceptance and familiarity, and nationality.Results: Higher level of privacy, greater clinical support, increased perceived benefit and better device accuracy were important. Accuracy was the most important, with only modest compromises willing to be made to increase other factors such as privacy. Established benefit was the least valued of the attributes with participants happy with technology that had possible but unknown benefits. Preferences were moderated by technology acceptance, age, nationality, and educational background.Conclusion: For people with a history of depression, adoption of technology may be driven by the desire for accurate detection of symptoms. However, people with lower technology acceptance and educational attain-ment, those who were younger, and specific nationalities may be willing to compromise on some accuracy for more privacy and clinical support. These preferences should help shape design of mHealth tools.
There is an urgent need for new methods that improve the management and treatment of Major Depressive Disorder (MDD). Speech has long been regarded as a promising digital marker in this regard, with many works highlighting that speech changes associated with MDD can be captured through machine learning models. Typically, findings are based on cross-sectional data, with little work exploring the advantages of personalization in building more robust and reliable models. This work assesses the strengths of different combinations of speech representations and machine learning models, in personalized and generalized settings in a two-class depression severity classification paradigm. Key results on a longitudinal dataset highlight the benefits of personalization. Our strongest performing model set-up utilized self-supervised learning features and convolutional neural network (CNN) and long short-term memory (LSTM) back-end.
BACKGROUND:Speech contains neuromuscular, physiological and cognitive components, and so is a potential biomarker of mental disorders. Previous studies indicate that speaking rate and pausing are associated with major depressive disorder (MDD). However, results are inconclusive as many studies are small and underpowered and do not include clinical samples. These studies have also been unilingual and use speech collected in controlled settings. If speech markers are to help understand the onset and progress of MDD, we need to uncover markers that are robust to language and establish the strength of associations in real-world data. METHODS:We collected speech data in 585 participants with a history of MDD in the United Kingdom, Spain, and Netherlands as part of the RADAR-MDD study. Participants recorded their speech via smartphones every two weeks for 18 months. Linear mixed models were used to estimate the strength of specific markers of depression from a set of 28 speech features. RESULTS:Increased depressive symptoms were associated with speech rate, articulation rate and intensity of speech elicited from a scripted task. These features had consistently stronger effect sizes than pauses. LIMITATIONS:Our findings are derived at the cohort level so may have limited impact on identifying intra-individual speech changes associated with changes in symptom severity. The analysis of features averaged over the entire recording may have underestimated the importance of some features. CONCLUSIONS:Participants with more severe depressive symptoms spoke more slowly and quietly. Our findings are from a real-world, multilingual, clinical dataset so represent a step-change in the usefulness of speech as a digital phenotype of MDD.
Introduction Major Depressive Disorder (MDD) is prevalent, often chronic, and requires ongoing monitoring of symptoms to track response to treatment and identify early indicators of relapse. Remote Measurement Technologies (RMT) provide an exciting opportunity to transform the measurement and management of MDD, via data collected from inbuilt smartphone sensors and wearable devices alongside app-based questionnaires and tasks. Objectives To describe the amount of data collected during a multimodal longitudinal RMT study, in an MDD population. Methods RADAR-MDD is a multi-centre, prospective observational cohort study. People with a history of MDD were provided with a wrist-worn wearable, and several apps designed to: a) collect data from smartphone sensors; and b) deliver questionnaires, speech tasks and cognitive assessments and followed-up for a maximum of 2 years. Results A total of 623 individuals with a history of MDD were enrolled in the study with 80% completion rates for primary outcome assessments across all timepoints. 79.8% of people participated for the maximum amount of time available and 20.2% withdrew prematurely. Data availability across all RMT data types varied depending on the source of data and the participant-burden for each data type. We found no evidence of an association between the severity of depression symptoms at baseline and the availability of data. 110 participants had > 50% data available across all data types, and thus able to contribute to multiparametric analyses. Conclusions RADAR-MDD is the largest multimodal RMT study in the field of mental health. Here, we have shown that collecting RMT data from a clinical population is feasible. Disclosure No significant relationships.
BACKGROUND Remote measurement technologies (RMT) such as mobile health devices and apps are increasingly used by those living with chronic neurological and mental health conditions. RMT enables real-world data collection and regular feedback, providing users with insights about their own conditions. Data visualizations are an integral part of RMT, although little is known about visualization design preferences from the perspectives of those living with chronic conditions. OBJECTIVE The aim of this review was to explore the experiences and preferences of individuals with chronic neurological and mental health conditions on data visualizations derived from RMT to manage health. METHODS In this systematic review, we searched peer-reviewed literature and conference proceedings (PubMed, IEEE Xplore, EMBASE, Web of Science, Association for Computing Machinery Computer-Human Interface proceedings, and the Cochrane Library) for original papers published between January 2007 and September 2021 that reported perspectives on data visualization of people living with chronic neurological and mental health conditions. Two reviewers independently screened each abstract and full-text article, with disagreements resolved through discussion. Studies were critically appraised, and extracted data underwent thematic synthesis. RESULTS We identified 35 eligible publications from 31 studies representing 12 conditions. Coded data coalesced into 3 themes: desire for data visualization, impact of visualizations on condition management, and visualization design considerations. Data visualizations were viewed as an integral part of users’ experiences with RMT, impacting satisfaction and engagement. However, user preferences were diverse and often conflicting both between and within conditions. CONCLUSIONS When used effectively, data visualizations are valuable, engaging components of RMT. They can provide structure and insight, allowing individuals to manage their own health more effectively. However, visualizations are not “one-size-fits-all,” and it is important to engage with potential users during visualization design to understand when, how, and with whom the visualizations will be used to manage health.
Background The mobility of an individual measured by phone-collected location data has been found to be associated with depression; however, the longitudinal relationships (the temporal direction of relationships) between depressive symptom severity and phone-measured mobility have yet to be fully explored. Objective We aimed to explore the relationships and the direction of the relationships between depressive symptom severity and phone-measured mobility over time. Methods Data used in this paper came from a major EU program, called the Remote Assessment of Disease and Relapse–Major Depressive Disorder, which was conducted in 3 European countries. Depressive symptom severity was measured with the 8-item Patient Health Questionnaire (PHQ-8) through mobile phones every 2 weeks. Participants’ location data were recorded by GPS and network sensors in mobile phones every 10 minutes, and 11 mobility features were extracted from location data for the 2 weeks prior to the PHQ-8 assessment. Dynamic structural equation modeling was used to explore the longitudinal relationships between depressive symptom severity and phone-measured mobility. Results This study included 2341 PHQ-8 records and corresponding phone-collected location data from 290 participants (age: median 50.0 IQR 34.0, 59.0) years; of whom 215 (74.1%) were female, and 149 (51.4%) were employed. Significant negative correlations were found between depressive symptom severity and phone-measured mobility, and these correlations were more significant at the within-individual level than the between-individual level. For the direction of relationships over time, Homestay (time at home) (φ=0.09, P=.01), Location Entropy (time distribution on different locations) (φ=−0.04, P=.02), and Residential Location Count (reflecting traveling) (φ=0.05, P=.02) were significantly correlated with the subsequent changes in the PHQ-8 score, while changes in the PHQ-8 score significantly affected (φ=−0.07, P<.001) the subsequent periodicity of mobility. Conclusions Several phone-derived mobility features have the potential to predict future depression, which may provide support for future clinical applications, relapse prevention, and remote mental health monitoring practices in real-world settings.
The ease of in-the-wild speech recording using smartphones has sparked considerable interest in the combined application of speech, remote measurement technology (RMT) and advanced analytics as a research and healthcare tool.For this to be realised, the acceptability of remote speech collection to the user must be established, in addition to feasibility from an analytical perspective.To understand the acceptance, facilitators, and barriers of smartphone-based speech recording, we invited 384 individuals with major depressive disorder (MDD) from the Remote Assessment of Disease and Relapse -Central Nervous System (RADAR-CNS) research programme in Spain and the UK to complete a survey on their experiences recording their speech.In this analysis, we demonstrate that study participants were more comfortable completing a scripted speech task than a free speech task.For both speech tasks, we found depression severity and country to be significant predictors of comfort.Not seeing smartphone notifications of the scheduled speech tasks, low mood and forgetfulness were the most commonly reported obstacles to providing speech recordings.
BACKGROUND:Epilepsy, multiple sclerosis (MS), and depression are chronic conditions where technology holds potential in clinical monitoring and self-management. Over 5 years, the Remote Assessment of Disease and Relapse - Central Nervous System (RADAR-CNS) consortium has explored the application of remote measurement technology (RMT) to the management and self-management of patients in these clinical areas. The consortium is large and includes clinical and nonclinical researchers as well as a patient advisory board. OBJECTIVE:This formative development study aimed to understand how consortium members viewed the potential of RMT in epilepsy, MS, and depression. METHODS:In this qualitative survey study, we developed a methodological tool, universal points of care (UPOC), to gather views on the potential use, acceptance, and value of a novel RMT platform across 3 chronic conditions (MS, epilepsy, and depression). UPOC builds upon use case scenario methodology, using expert elicitation and analysis of care pathways to develop scenarios applicable across multiple conditions. After developing scenarios, we elicited views on the potential of RMT in these different scenarios through a survey administered to 28 subject matter experts, consisting of 16 health care practitioners; 5 health care services researchers; and 7 people with lived experience of MS, epilepsy, or depression. Survey results were analyzed thematically and using an existing framework of factors describing links between design and context. RESULTS:The survey elicited potential beneficial applications of the RADAR-CNS RMT system as well as patient, clinical, and nonclinical requirements of RMT across the 3 conditions of interest. Potential applications included recognition of early warning signs of relapse from subclinical signals for MS, seizure precipitant signals for epilepsy, and behavior change in depression. RMT was also thought to have the potential to overcome the problem of underreporting, which is especially problematic in epilepsy, and to allow the capture of secondary symptoms that are not generally collected in MS, such as mood. CONCLUSIONS:Respondents suggested novel and unanticipated uses of RMT, including the use of RMT to detect emerging side effects of treatment, enable behavior change for sleep regulation and activity, and offer a way to include family and other carers in a care network, which could assist with goal setting. These suggestions, together with others from this and related work, will inform the development of the system for its eventual application in research and clinical practice. The UPOC methodology was effective in directing respondents to consider the value of health care technologies in condition-specific experiences of everyday life and working practice.
Unintentional weight loss and Undernutrition are major problems among older people living in Long-Term Care Facilities (LTCF). Undernutrition manifests in LTCF particularly as weight loss and low Body Mass Index (BMI) and is associated with increased morbidity and mortality as well as with functional decline. There are many factors associated with poor nutritional status and affecting protein-energy intake and/or energy expenditure. These include age of 85 years or older, low nutrient intake, loss of ability to eat independently, swallowing and chewing difficulties, becoming bed-ridden, pressure ulcers, history of hip fracture, dementia, depressive symptoms and suffering from two or more chronic illnesses. Nutritional evaluation is an essential part of the Comprehensive Geriatric Assessment (CGA). This evaluation ranges from methods such as BMI to several validated tools such as Mini-Nutritional Assessment (MNA). After diagnosis, the management of undernutrition in LTCF requires a multidisciplinary approach which may involve dietary and environmental improvements and managing multiple co-morbidities, while avoiding polypharmacy as far as possible. Finally, the need for supplementation or artificial (tube) feeding may be considered taking into account the CGA and individual needs. This document presents a succinct review and recommendations of evaluation and treatment of undernutrition.