Background:Multiple sclerosis (MS), epilepsy, and depression are chronic central nervous system conditions in which remote measurement technology (RMT) may offer benefits compared with usual assessment. We previously worked with clinicians, patients, and researchers to develop 13 use cases for RMT: 5 in epilepsy (seizure alert, seizure counting, risk scoring, triage support, and trend analysis), 3 in MS (detecting silent progression, detecting depression in MS, and donating data to a biobank), and 5 in depression (detecting trends, reviewing treatment, self-management, comorbid monitoring, and carer alert). Objective:In this study, we aimed to evaluate the use cases and related implementation issues with an expert panel of clinicians external to our project consortium. Methods:We used a Delphi exercise to validate the use cases and suggest a prioritization among them and to ascertain the importance of a variety of implementation issues related to RMT. The expert panel included clinicians from across Europe who were external to the project consortium. The study had 2 survey rounds (n=23 and n=17) and a follow-up interview round (n=9). Data were analyzed for consensus between participants and for stability between survey rounds. The interviews explored the reasons for answers given in the survey. Results:The findings showed high stability between rounds on questions related to specific use cases but lower stability on questions relating to wider issues around the implementation of RMT. Overall, questions on wider issues also had less consensus. All 5 use cases for epilepsy (seizure alert, seizure counting, risk scoring, triage support, and trend analysis) were considered beneficial, with consensus among participants above the a priori threshold for most questions, although use case 3 (risk scoring) was considered less likely to facilitate or catalyze care. There was very little consensus on the benefits of the use cases in MS, although this may have resulted from a higher dropout rate of MS clinicians (50%). Participants agreed that there would be benefits for all 5 of the depression use cases, although fewer questions on use case 4 (triage support) reached consensus agreement than for depression use cases 1 (detecting trends), 2 (reviewing treatment), 3 (self-management), and 5 (carer alert). The qualitative analysis revealed further insights into each use case and generated 8 themes on practical issues related to implementation. Conclusions:Overall, these findings inform the prioritization of use cases for RMT that could be developed in future work, which may include clinical trials, cost-effectiveness studies, and the commercial development of RMT products and services. Priorities for further development include the use of RMT to provide more accurate records of symptoms and treatment response than is currently possible and to provide data that could help inform patient triage and generate timely alerts for patients and carers.
Focal onset epileptic seizures are highly heterogeneous in their clinical manifestations, and a robust seizure detection across patient cohorts has to date not been achieved. Here, we assess and discuss the potential of supervised machine learning models for the detection of focal onset motor seizures by means of a wrist-worn wearable device, both in a personalized context as well as across patients. Wearable data were recorded in-hospital from patients with epilepsy at two epilepsy centers. Accelerometry, electrodermal activity, and blood volume pulse data were processed and features for each of the biosignal modalities were calculated. Following a leave-one-out approach, a gradient tree boosting machine learning model was optimized and tested in an intra-subject and inter-subject evaluation. In total, 20 seizures from 9 patients were included and we report sensitivities of 67% to 100% and false alarm rates of down to 0.85 per 24 h in the individualized assessment. Conversely, for an inter-subject seizure detection methodology tested on an out-of-sample data set, an optimized model could only achieve a sensitivity of 75% at a false alarm rate of 13.4 per 24 h. We demonstrate that robustly detecting focal onset motor seizures with tonic or clonic movements from wearable data may be possible for individuals, depending on specific seizure manifestations.
Background There is increasing interest in the potential uses of mobile health (mHealth) technologies, such as wearable biosensors, as supplements for the care of people with neurological conditions. However, adherence is low, especially over long periods. If people are to benefit from these resources, we need a better long-term understanding of what influences patient engagement. Previous research suggests that engagement is moderated by several barriers and facilitators, but their relative importance is unknown. Objective To determine preferences and the relative importance of user-generated factors influencing engagement with mHealth technologies for 2 common neurological conditions with a relapsing-remitting course: multiple sclerosis (MS) and epilepsy. Methods In a discrete choice experiment, people with a diagnosis of MS (n=141) or epilepsy (n=175) were asked to select their preferred technology from a series of 8 vignettes with 4 characteristics: privacy, clinical support, established benefit, and device accuracy; each of these characteristics was greater or lower in each vignette. These characteristics had previously been emphasized by people with MS and or epilepsy as influencing engagement with technology. Mixed multinomial logistic regression models were used to establish which characteristics were most likely to affect engagement. Subgroup analyses explored the effects of demographic factors (such as age, gender, and education), acceptance of and familiarity with mobile technology, neurological diagnosis (MS or epilepsy), and symptoms that could influence motivation (such as depression). Results Analysis of the responses to the discrete choice experiment validated previous qualitative findings that a higher level of privacy, greater clinical support, increased perceived benefit, and better device accuracy are important to people with a neurological condition. Accuracy was perceived as the most important factor, followed by privacy. Clinical support was the least valued of the attributes. People were prepared to trade a modest amount of accuracy to achieve an improvement in privacy, but less likely to make this compromise for other factors. The type of neurological condition (epilepsy or MS) did not influence these preferences, nor did the age, gender, or mental health status of the participants. Those who were less accepting of technology were the most concerned about privacy and those with a lower level of education were prepared to trade accuracy for more clinical support. Conclusions For people with neurological conditions such as epilepsy and MS, accuracy (ie, the ability to detect symptoms) is of the greatest interest. However, there are individual differences, and people who are less accepting of technology may need far greater reassurance about data privacy. People with lower levels of education value greater clinician involvement. These patient preferences should be considered when designing mHealth technologies.
BACKGROUND:Video electroencephalography recordings, routinely used in epilepsy monitoring units, are the gold standard for monitoring epileptic seizures. However, monitoring is also needed in the day-to-day lives of people with epilepsy, where video electroencephalography is not feasible. Wearables could fill this gap by providing patients with an accurate log of their seizures.OBJECTIVE:Although there are already systems available that provide promising results for the detection of tonic-clonic seizures (TCSs), research in this area is often limited to detection from 1 biosignal modality or only during the night when the patient is in bed. The aim of this study is to provide evidence that supervised machine learning can detect TCSs from multimodal data in a new data set during daytime and nighttime.METHODS:An extensive data set of biosignals from a multimodal watch worn by people with epilepsy was recorded during their stay in the epilepsy monitoring unit at 2 European clinical sites. From a larger data set of 243 enrolled participants, those who had data recorded during TCSs were selected, amounting to 10 participants with 21 TCSs. Accelerometry and electrodermal activity recorded by the wearable device were used for analysis, and seizure manifestation was annotated in detail by clinical experts. Ten accelerometry and 3 electrodermal activity features were calculated for sliding windows of variable size across the data. A gradient tree boosting algorithm was used for seizure detection, and the optimal parameter combination was determined in a leave-one-participant-out cross-validation on a training set of 10 seizures from 8 participants. The model was then evaluated on an out-of-sample test set of 11 seizures from the remaining 2 participants. To assess specificity, we additionally analyzed data from up to 29 participants without TCSs during the model evaluation.RESULTS:In the leave-one-participant-out cross-validation, the model optimized for sensitivity could detect all 10 seizures with a false alarm rate of 0.46 per day in 17.3 days of data. In a test set of 11 out-of-sample TCSs, amounting to 8.3 days of data, the model could detect 10 seizures and produced no false positives. Increasing the test set to include data from 28 more participants without additional TCSs resulted in a false alarm rate of 0.19 per day in 78 days of wearable data.CONCLUSIONS:We show that a gradient tree boosting machine can robustly detect TCSs from multimodal wearable data in an original data set and that even with very limited training data, supervised machine learning can achieve a high sensitivity and low false-positive rate. This methodology may offer a promising way to approach wearable-based nonconvulsive seizure detection.
Background In recent years, a growing body of literature has highlighted the role of wearable and mobile remote measurement technology (RMT) applied to seizure detection in hospital settings, whereas more limited evidence has been produced in the community setting. In clinical practice, seizure assessment typically relies on self-report, which is known to be highly unreliable. Moreover, most people with epilepsy self-identify factors that lead to increased seizure likelihood, including mood, behavior, sleep pattern, and cognitive alterations, all of which are amenable to measurement via multiparametric RMT. Objective The primary aim of this multicenter prospective cohort study is to assess the usability, feasibility, and acceptability of RMT in the community setting. In addition, this study aims to determine whether multiparametric RMT collected in populations with epilepsy can prospectively estimate variations in seizure occurrence and other outcomes, including seizure frequency, quality of life, and comorbidities. Methods People with a diagnosis of pharmacoresistant epilepsy will be recruited in London, United Kingdom, and Freiburg, Germany. Participants will be asked to wear a wrist-worn device and download ad hoc apps developed on their smartphones. The apps will be used to collect data related to sleep, physical activity, stress, mood, social interaction, speech patterns, and cognitive function, both passively from existing smartphone sensors (passive remote measurement technology [pRMT]) and actively via questionnaires, tasks, and assessments (active remote measurement technology [aRMT]). Data will be collected continuously for 6 months and streamed to the Remote Assessment of Disease and Relapse-base (RADAR-base) server. Results The RADAR Central Nervous System project received funding in 2015 from the Innovative Medicines Initiative 2 Joint Undertaking under Grant Agreement No. 115902. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and European Federation of Pharmaceutical Industries and Associations. Ethical approval was obtained in London from the Bromley Research Ethics Committee (research ethics committee reference: 19/LO/1884) in January 2020. The first participant was enrolled on September 30, 2020. Data will be collected until September 30, 2021. The results are expected to be published at the beginning of 2022. Conclusions RADAR Epilepsy aims at developing a framework of continuous data collection intended to identify ictal and preictal states through the use of aRMT and pRMT in the real-life environment. The study was specifically designed to evaluate the clinical usefulness of the data collected via new technologies and compliance, technology acceptability, and usability for patients. These are key aspects to successful adoption and implementation of RMT as a new way to measure and manage long-term disorders. International Registered Report Identifier (IRRID) PRR1-10.2196/21840
BACKGROUND:Epilepsy, multiple sclerosis (MS), and depression are chronic conditions where technology holds potential in clinical monitoring and self-management. Over 5 years, the Remote Assessment of Disease and Relapse - Central Nervous System (RADAR-CNS) consortium has explored the application of remote measurement technology (RMT) to the management and self-management of patients in these clinical areas. The consortium is large and includes clinical and nonclinical researchers as well as a patient advisory board. OBJECTIVE:This formative development study aimed to understand how consortium members viewed the potential of RMT in epilepsy, MS, and depression. METHODS:In this qualitative survey study, we developed a methodological tool, universal points of care (UPOC), to gather views on the potential use, acceptance, and value of a novel RMT platform across 3 chronic conditions (MS, epilepsy, and depression). UPOC builds upon use case scenario methodology, using expert elicitation and analysis of care pathways to develop scenarios applicable across multiple conditions. After developing scenarios, we elicited views on the potential of RMT in these different scenarios through a survey administered to 28 subject matter experts, consisting of 16 health care practitioners; 5 health care services researchers; and 7 people with lived experience of MS, epilepsy, or depression. Survey results were analyzed thematically and using an existing framework of factors describing links between design and context. RESULTS:The survey elicited potential beneficial applications of the RADAR-CNS RMT system as well as patient, clinical, and nonclinical requirements of RMT across the 3 conditions of interest. Potential applications included recognition of early warning signs of relapse from subclinical signals for MS, seizure precipitant signals for epilepsy, and behavior change in depression. RMT was also thought to have the potential to overcome the problem of underreporting, which is especially problematic in epilepsy, and to allow the capture of secondary symptoms that are not generally collected in MS, such as mood. CONCLUSIONS:Respondents suggested novel and unanticipated uses of RMT, including the use of RMT to detect emerging side effects of treatment, enable behavior change for sleep regulation and activity, and offer a way to include family and other carers in a care network, which could assist with goal setting. These suggestions, together with others from this and related work, will inform the development of the system for its eventual application in research and clinical practice. The UPOC methodology was effective in directing respondents to consider the value of health care technologies in condition-specific experiences of everyday life and working practice.