Background:: Short narrative reports (SNR) are often recorded immediately after fall events. SNRs have not been used to study falls, most likely because they have unknown structure and consistency. We aimed to investigate SNRs provided alongside verified real world falls, to determine whether they can provide useful insight into the mechanism of falls in two settings: community-dwelling (CD) and geriatric rehabilitation (GR) settings. Methods:: We analysed 270 SNRs of real-world falls, captured immediately after each event. The SNRs included a narrative description from the individual or a bystander, and prompts for specific information (e.g. fall direction, pre-fall activity). We developed a framework to analyse the SNRs and identify core sub-themes that were consistently reported, and then compared key themes (transitions and object interactions) across the CD and GR groups. Results:: We extracted four core sub-themes for the framework: initial status, intended status, interacting object, and fall direction. Of the 270 falls, 211 (78%) were sufficiently detailed to chart complete fall scenarios. Objects were involved in 82% (173/211) of these falls. Falls were frequently reported to occur during transitions between sitting, standing, and walking, and often reported to involve interaction with objects such as static seats, mobility aids, and static furniture. CD participants reported more diverse fall circumstances (47 unique scenarios), often involving standing up from or sitting down on static seats, walking without object involvement, or navigating near static furniture. GR participants reported more walking-related falls involving mobility aids, but fewer varied scenarios (22 scenarios). Conclusions:: The SNRs can provide consistent, and potentially important insights into real-world fall circumstances. Our analysis highlights how specific activities and object interactions may contribute to loss of balance, particularly during common daily transitions; this supports group-specific prevention strategies for CD and GR populations.
The L-test is a performance-based measure to assess balance and mobility. Currently, the primary outcome from this test is the time required to finish it. In this study we present the instrumented L-test (iL-test), an L-test wherein mobility is evaluated by means of a wearable inertial sensor worn at the lower back. We analyzed data from 113 people across seven cohorts: healthy adults, chronic obstructive pulmonary disease, multiple sclerosis, congestive heart failure, Parkinson’s disease, proximal femoral fracture, and transfemoral amputation. The iL-test automatic segmentation was validated using stereophotogrammetry. Univariate and multivariate analyses were performed on 164 kinematic features derived from inertial signals to identify distinct patterns across different cohorts. The iL-test accurately recognized and segmented activities during the L-test for all cohorts (technical validity). A random forest classifier revealed that proximal femoral fracture and transfemoral amputation induced significantly different mobility patterns compared to healthy people with AUC values of 0.89 and 0.99, respectively. Strong correlations were found between kinematic features and clinical scores in multiple sclerosis, congestive heart failure, proximal femoral fracture, and transfemoral amputation, with consistent patterns of decreased movement ranges and smoothness with increasing disease severity. Furthermore, features derived from 90° and 180° turns were found to be important contributors to differentiation amongst cohorts, underscoring the need to evaluate different turn degrees and directions. This study emphasizes the iL-test potential to deliver automated mobility assessment across a wide range of clinical conditions, indicating a prospective avenue for improved mobility assessment and, eventually, more informed healthcare interventions.
BackgroundAlgorithms estimating real-world digital mobility outcomes (DMOs) are increasingly validated in healthy adults and various disease cohorts. However, their accuracy and reliability in older adults after hip fracture, who often walk slowly for short durations, is underexplored. ObjectiveThis study examined DMO accuracy and reliability in a hip fracture cohort considering walking bout (WB) duration, physical function, days since surgery, and walking aid use. MethodsIn total, 19 community-dwelling participants were real-world monitored for 2.5 hours using a lower back wearable device and a reference system combining inertial modules, distance sensors, and pressure insoles. A total of 6 DMO estimates from 164 WBs from 58% (11/19) of the participants (aged 71-90 years; assessed 32-390 days after surgery; Short Physical Performance Battery [SPPB] scores of 3-12; gait speed range 0.39-1.34 m/s) were assessed against the reference system at the WB and participant level. We stratified by WB duration (all WBs, WBs of >10 seconds, WBs of 10-30 seconds, and WBs of >30 seconds) and lower versus higher SPPB scores and observed whether days since surgery and walking aid use affected DMO accuracy and reliability. ResultsAcross WBs, walking speed and distance ranged from 0.25 to 1.29 m/s and from 1.7 to 436.5 m, respectively. Estimation of walking speed, cadence, stride duration, number of steps, and distance stratified by WB duration showed intraclass correlation coefficients (ICCs) ranging from 0.50 to 0.99 and mean relative errors (MREs) from –6.9% to 12.8%. Stride length estimation showed poor reliability, with ICCs ranging from 0.30 to 0.49 and MREs from 6.1% to 13.2%. Walking speed and distance ICCs in the higher–SPPB score group ranged from 0.85 to 0.99, and MREs ranged from –10.1% to –1.7%. In the lower–SPPB score group, walking speed and distance ICCs ranged from 0.17 to 0.99, and MREs ranged from 13.5% to 32.6%. There was no discernible effect of time since surgery or walking aid use. ConclusionsIn total, 5 accurate and reliable real-world DMOs were identified in older adults after hip fracture: walking speed, cadence, stride duration, number of steps, and distance. Accuracy and reliability of most DMOs improved when excluding WBs of <10 seconds and were higher for WBs of >30 seconds than for WBs of 10 to 30 seconds and for participants with higher physical function. DMOs capture daily gait as early as 1 month after surgery also in people using walking aids. However, as most WBs in this cohort were short, there was a trade-off between improving accuracy and reliability by excluding short WBs and losing a substantial amount of data. These results have important implications for establishing the clinical validity of DMOs and evaluating the effects of interventions on daily-life gait, thereby facilitating the design of optimal care pathways.
BackgroundWrist-worn inertial sensors are used in digital health for evaluating mobility in real-world environments. Preceding the estimation of spatiotemporal gait parameters within long-term recordings, gait detection is an important step to identify regions of interest where gait occurs, which requires robust algorithms due to the complexity of arm movements. While algorithms exist for other sensor positions, a comparative validation of algorithms applied to the wrist position on real-world data sets across different disease populations is missing. Furthermore, gait detection performance differences between the wrist and lower back position have not yet been explored but could yield valuable information regarding sensor position choice in clinical studies. ObjectiveThe aim of this study was to validate gait sequence (GS) detection algorithms developed for the wrist position against reference data acquired in a real-world context. In addition, this study aimed to compare the performance of algorithms applied to the wrist position to those applied to lower back–worn inertial sensors. MethodsParticipants with Parkinson disease, multiple sclerosis, proximal femoral fracture (hip fracture recovery), chronic obstructive pulmonary disease, and congestive heart failure and healthy older adults (N=83) were monitored for 2.5 hours in the real-world using inertial sensors on the wrist, lower back, and feet including pressure insoles and infrared distance sensors as reference. In total, 10 algorithms for wrist-based gait detection were validated against a multisensor reference system and compared to gait detection performance using lower back–worn inertial sensors. ResultsThe best-performing GS detection algorithm for the wrist showed a mean (per disease group) sensitivity ranging between 0.55 (SD 0.29) and 0.81 (SD 0.09) and a mean (per disease group) specificity ranging between 0.95 (SD 0.06) and 0.98 (SD 0.02). The mean relative absolute error of estimated walking time ranged between 8.9% (SD 7.1%) and 32.7% (SD 19.2%) per disease group for this algorithm as compared to the reference system. Gait detection performance from the best algorithm applied to the wrist inertial sensors was lower than for the best algorithms applied to the lower back, which yielded mean sensitivity between 0.71 (SD 0.12) and 0.91 (SD 0.04), mean specificity between 0.96 (SD 0.03) and 0.99 (SD 0.01), and a mean relative absolute error of estimated walking time between 6.3% (SD 5.4%) and 23.5% (SD 13%). Performance was lower in disease groups with major gait impairments (eg, patients recovering from hip fracture) and for patients using bilateral walking aids. ConclusionsAlgorithms applied to the wrist position can detect GSs with high performance in real-world environments. Those periods of interest in real-world recordings can facilitate gait parameter extraction and allow the quantification of gait duration distribution in everyday life. Our findings allow taking informed decisions on alternative positions for gait recording in clinical studies and public health. Trial RegistrationISRCTN Registry 12246987; https://www.isrctn.com/ISRCTN12246987 International Registered Report Identifier (IRRID)RR2-10.1136/bmjopen-2021-050785
Algorithms estimating real-world digital mobility outcomes (DMOs) are increasingly validated in healthy adults and various disease cohorts. However, their accuracy and reliability in older adults after hip fractures, who often walk slowly for short durations, is underexplored. The objective of this study was to examine DMO accuracy and reliability in a hip fracture cohort, considering walking bout (WB) duration, physical function, days since surgery, and walking aid usage. Participants were monitored in their natural environment for 2.5 hours using a lower back single wearable device and a reference system combining inertial modules, distance sensors, and pressure insoles. DMO estimates from 164 WBs from 11 participants obtained from the single wearable device were assessed against the reference system on a WB and a participant level, including walking speed, cadence, stride length, stride duration, number of steps and walking distance. We stratified by WB duration (All WBs, WBs >10s, WBs 10-30s, WBs >30s), lower versus higher Short Physical Performance Battery (SPPB) scores, and observed whether days since surgery and walking aid usage affected DMO accuracy and reliability. Walking speed, cadence, stride duration, number of steps, and distance stratified by WB duration showed Intraclass Correlation Coefficients (ICCs) ranging from 0.50-0.99, and mean relative errors (MREs) ranging from –6.9% to 12.8%. Stride length showed poor reliability with ICCs ranging from 0.30-0.49 and MREs from 6.1% to 13.2%. Walking speed and distance ICCs in the higher SPPB score group ranged from 0.85-0.99 and MREs from –10.1% to –1.7%. In the lower SPPB score group, walking speed and distance ICCs ranged from 0.17-0.99 and MREs from 13.5% to 32.6%. We did not observe a discernible effect of time since surgery or walking aid usage on walking speed or distance estimates. Five accurate and reliable real-world DMOs were identified in older adults after hip fractures: walking speed, cadence, stride duration, number of steps, and distance. Accuracy and reliability of most DMOs improved when excluding WBs <10 seconds and were higher in WBs >30 seconds compared to 10-30 seconds WBs and for those with higher physical function. DMOs can capture daily mobility as early as 1 month after surgery, also in people using walking aids. However, as most WBs in this cohort are of short duration, there is a trade-off between more accurate and reliable walking speed and distance estimates when excluding short-duration WBs, and the loss of a substantial amount of data. These results have important implications for future research aiming to establish clinical validity of DMOs, and enable clinicians to evaluate the effects of interventions on daily life mobility in detail, which in turn facilitates the design of optimal care pathways. ISRCTN – 12246987 https://doi.org/10.1186/ISRCTN12246987
This study aimed to validate a wearable device’s walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson’s Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and − 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application. Trial registration: ISRCTN – 12246987.
Background Although digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates. Methods Twenty healthy older adults, 20 people with Parkinson’s disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated. Results We identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture). Algorithms’ performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms. Conclusions Overall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms’ performances. Trial registration ISRCTN – 12246987.
Introduction: Accurately assessing people’s gait, especially in real-world conditions and in case of impaired mobility, is still a challenge due to intrinsic and extrinsic factors resulting in gait complexity. To improve the estimation of gait-related digital mobility outcomes (DMOs) in real-world scenarios, this study presents a wearable multi-sensor system (INDIP), integrating complementary sensing approaches (two plantar pressure insoles, three inertial units and two distance sensors).Methods: The INDIP technical validity was assessed against stereophotogrammetry during a laboratory experimental protocol comprising structured tests (including continuous curvilinear and rectilinear walking and steps) and a simulation of daily-life activities (including intermittent gait and short walking bouts). To evaluate its performance on various gait patterns, data were collected on 128 participants from seven cohorts: healthy young and older adults, patients with Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, congestive heart failure, and proximal femur fracture. Moreover, INDIP usability was evaluated by recording 2.5-h of real-world unsupervised activity.Results and discussion: Excellent absolute agreement (ICC >0.95) and very limited mean absolute errors were observed for all cohorts and digital mobility outcomes (cadence ≤0.61 steps/min, stride length ≤0.02 m, walking speed ≤0.02 m/s) in the structured tests. Larger, but limited, errors were observed during the daily-life simulation (cadence 2.72–4.87 steps/min, stride length 0.04–0.06 m, walking speed 0.03–0.05 m/s). Neither major technical nor usability issues were declared during the 2.5-h acquisitions. Therefore, the INDIP system can be considered a valid and feasible solution to collect reference data for analyzing gait in real-world conditions.
Background This study aimed to explore the acceptability of a wearable device for remotely measuring mobility in the Mobilise-D technical validation study (TVS), and to explore the acceptability of using digital tools to monitor health. Methods Participants ( N = 106) in the TVS wore a waist-worn device (McRoberts Dynaport MM + ) for one week. Following this, acceptability of the device was measured using two questionnaires: The Comfort Rating Scale (CRS) and a previously validated questionnaire. A subset of participants ( n = 36) also completed semi-structured interviews to further determine device acceptability and to explore their opinions of the use of digital tools to monitor their health. Questionnaire results were analysed descriptively and interviews using a content analysis. Results The device was considered both comfortable (median CRS (IQR; min-max) = 0.0 (0.0; 0–20) on a scale from 0–20 where lower scores signify better comfort) and acceptable (5.0 (0.5; 3.0–5.0) on a scale from 1–5 where higher scores signify better acceptability). Interviews showed it was easy to use, did not interfere with daily activities, and was comfortable. The following themes emerged from participants’ as being important to digital technology: altered expectations for themselves, the use of technology, trust, and communication with healthcare professionals. Conclusions Digital tools may bridge existing communication gaps between patients and clinicians and participants are open to this. This work indicates that waist-worn devices are supported, but further work with patient advisors should be undertaken to understand some of the key issues highlighted. This will form part of the ongoing work of the Mobilise-D consortium.
IntroductionThe clinical assessment of mobility, and walking specifically, is still mainly based on functional tests that lack ecological validity. Thanks to inertial measurement units (IMUs), gait analysis is shifting to unsupervised monitoring in naturalistic and unconstrained settings. However, the extraction of clinically relevant gait parameters from IMU data often depends on heuristics-based algorithms that rely on empirically determined thresholds. These were mainly validated on small cohorts in supervised settings.MethodsHere, a deep learning (DL) algorithm was developed and validated for gait event detection in a heterogeneous population of different mobility-limiting disease cohorts and a cohort of healthy adults. Participants wore pressure insoles and IMUs on both feet for 2.5 h in their habitual environment. The raw accelerometer and gyroscope data from both feet were used as input to a deep convolutional neural network, while reference timings for gait events were based on the combined IMU and pressure insoles data.Results and discussionThe results showed a high-detection performance for initial contacts (ICs) (recall: 98%, precision: 96%) and final contacts (FCs) (recall: 99%, precision: 94%) and a maximum median time error of −0.02 s for ICs and 0.03 s for FCs. Subsequently derived temporal gait parameters were in good agreement with a pressure insoles-based reference with a maximum mean difference of 0.07, −0.07, and <0.01 s for stance, swing, and stride time, respectively. Thus, the DL algorithm is considered successful in detecting gait events in ecologically valid environments across different mobility-limiting diseases.
Abstract Background: Estimation of walking speed from wearable devices requires combining a set of algorithms in a single analytical pipeline. The aim of this study was to validate a pipeline for walking speed estimation and assess its performance across different factors (complexity, speed, and walking bout duration) to make recommendations on the use and validity of wearable devices for real-world mobility analysis. Methods: Participants with Parkinson's Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and for 2.5 hours in the real-world, using a wearable device worn on the lower back. Two pipelines for estimating WS were validated across 1298 detected walking bouts, against 1365 walking bouts detected by a multi-sensor reference system. Results: In the laboratory, the mean absolute error (MAE) and mean absolute relative error (MARE) for estimation of walking speed ranged from − 0.06 to 0.04 m/s and 2.1–14.4% respectively, with ICCs ranged between good (0.79) and excellent (0.91). The real-world MAE ranged from − 0.04 to 0.11, and MARE from 1.3–22.7%, where ICCs showed moderate (0.57) to good (0.88) agreement. Errors were lower for cohorts with no major gait impairments, for less complex gait tasks and when considering longer walking bouts. Conclusions: We demonstrated that the analytical pipelines estimated walking speed with good accuracy. Accuracy was dependent upon confounding factors, highlighting the importance of undertaking a robust technical validation of wearable device-derived walking speed before clinical application. Trial registration ISRCTN – 12246987.
Accurately assessing people’s gait, especially in real-world conditions and in case of impaired mobility, is still a challenge due to intrinsic and extrinsic factors resulting in gait complexity. To improve the estimation of gait-related digital mobility outcomes (DMOs) in real-world scenarios, this study presents a wearable multi-sensor system (INDIP), integrating complementary sensing approaches (two plantar pressure insoles, three inertial units and two distance sensors). The INDIP technical validity was assessed against stereophotogrammetry during a laboratory experimental protocol comprising structured tests (including continuous curvilinear and rectilinear walking and steps) and a simulation of daily-life activities (SDA, including intermittent gait and short walking bouts). To evaluate its performance on various gait patterns, data were collected on 128 participants from seven cohorts: healthy young and older adults, patients with Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, congestive heart failure, and proximal femur fracture. Moreover, INDIP usability was evaluated by recording 2.5-hours of real-world unsupervised activity. Excellent absolute agreement (ICC > 0.95) and very limited mean absolute errors were observed for all cohorts and DMOs (cadence ≤ 0.61 steps/min, stride length ≤ 0.02 m, walking speed ≤ 0.02 m/s) in the structured tests. Larger, but limited, errors were observed during the SDA (cadence 2.72–4.87 steps/min, stride length 0.04–0.06 m, walking speed 0.03–0.05 m/s). Neither major technical nor usability issues were declared during the 2.5-hours acquisitions. Therefore, the INDIP system can be considered a valid and feasible solution to collect reference data for analyzing gait in real-world conditions.
There is growing interest in the quantification of gait as part of complex motor tasks. This requires gait events (GEs) to be detected under conditions different from straight walking. This study aimed to propose and validate a new marker-based GE detection method, which is also suitable for curvilinear walking and step negotiation. The method was first tested against existing algorithms using data from healthy young adults (YA, n = 20) and then assessed in data from 10 individuals from the following five cohorts: older adults, chronic obstructive pulmonary disease, multiple sclerosis, Parkinson’s disease, and proximal femur fracture. The propagation of the errors associated with GE detection on the calculation of stride length, duration, speed, and stance/swing durations was investigated. All participants performed a variety of motor tasks including curvilinear walking and step negotiation, while reference GEs were identified using a validated methodology exploiting pressure insole signals. Sensitivity, positive predictive values (PPV), F1-score, bias, precision, and accuracy were calculated. Absolute agreement [intraclass correlation coefficient ( I C C 2,1 )] between marker-based and pressure insole stride parameters was also tested. In the YA cohort, the proposed method outperformed the existing ones, with sensitivity, PPV, and F1 scores ≥ 99% for both GEs and conditions, with a virtually null bias (<10 ms). Overall, temporal inaccuracies minimally impacted stride duration, length, and speed (median absolute errors ≤1%). Similar algorithm performances were obtained for all the other five cohorts in GE detection and propagation to the stride parameters, where an excellent absolute agreement with the pressure insoles was also found ( I C C 2,1 = 0.817 − 0.999 ). In conclusion, the proposed method accurately detects GE from marker data under different walking conditions and for a variety of gait impairments.
Background Measuring mobility in daily life entails dealing with confounding factors arising from multiple sources, including pathological characteristics, patient specific walking strategies, environment/context, and purpose of the task. The primary aim of this study is to propose and validate a protocol for simulating real-world gait accounting for all these factors within a single set of observations, while ensuring minimisation of participant burden and safety. Methods The protocol included eight motor tasks at varying speed, incline/steps, surface, path shape, cognitive demand, and included postures that may abruptly alter the participants’ strategy of walking. It was deployed in a convenience sample of 108 participants recruited from six cohorts that included older healthy adults (HA) and participants with potentially altered mobility due to Parkinson’s disease (PD), multiple sclerosis (MS), proximal femoral fracture (PFF), chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF). A novelty introduced in the protocol was the tiered approach to increase difficulty both within the same task (e.g., by allowing use of aids or armrests) and across tasks. Results The protocol proved to be safe and feasible (all participants could complete it and no adverse events were recorded) and the addition of the more complex tasks allowed a much greater spread in walking speeds to be achieved compared to standard straight walking trials. Furthermore, it allowed a representation of a variety of daily life relevant mobility aspects and can therefore be used for the validation of monitoring devices used in real life. Conclusions The protocol allowed for measuring gait in a variety of pathological conditions suggests that it can also be used to detect changes in gait due to, for example, the onset or progression of a disease, or due to therapy. Trial registration: ISRCTN—12246987.
Background The development of optimal strategies to treat impaired mobility related to ageing and chronic disease requires better ways to detect and measure it. Digital health technology, including body worn sensors, has the potential to directly and accurately capture real-world mobility. Mobilise-D consists of 34 partners from 13 countries who are working together to jointly develop and implement a digital mobility assessment solution to demonstrate that real-world digital mobility outcomes have the potential to provide a better, safer, and quicker way to assess, monitor, and predict the efficacy of new interventions on impaired mobility. The overarching objective of the study is to establish the clinical validity of digital outcomes in patient populations impacted by mobility challenges, and to support engagement with regulatory and health technology agencies towards acceptance of digital mobility assessment in regulatory and health technology assessment decisions Methods/Design The Mobilise-D clinical validation study is a longitudinal observational cohort study that will recruit 2400 participants from four clinical cohorts. The populations of the Innovative Medicine Initiative-Joint Undertaking represent neurodegenerative conditions (Parkinson’s Disease), respiratory disease (Chronic Obstructive Pulmonary Disease), neuro-inflammatory disorder (Multiple Sclerosis), fall- related injuries, osteoporosis, sarcopenia, and frailty (Proximal Femoral Fracture). In total, 17 clinical sites in ten countries will recruit participants who will be evaluated every six months over a period of two years. A wide range of core and cohort specific outcome measures will be collected, spanning patient-reported, observer-reported, and clinician-reported outcomes as well as performance-based outcomes (physical measures and cognitive/mental measures). Daily-living mobility and physical capacity will be assessed directly using a wearable device. These four clinical cohorts were chosen to obtain generalizable clinical findings, including diverse clinical, cultural, geographical, and age representation. The disease cohorts include a broad and heterogeneous range of subject characteristics with varying chronic care needs, and represent different trajectories of mobility disability. Discussion The results of Mobilise-D will provide longitudinal data on the use of digital mobility outcomes to identify, stratify, and monitor disability. This will support the development of widespread, cost- effective access to optimal clinical mobility management through personalised healthcare. Further, Mobilise-D will provide evidence-based, direct measures which can be endorsed by regulatory agencies and health technology assessment bodies to quantify the impact of disease-modifying interventions on mobility. Trial registration ISRCTN12051706
Real-world (RW) gait analysis is becoming increasingly important since in these conditions an individual’s mobility performance can be measured, in addition to what happens in a standardised lab environment, where mobility capacity is assessed. This is even more relevant in the presence of a motor disability, when continuous daily-life monitoring can unveil limitations in movement, better stratify disease progression and the efficacy of medical treatments [1]. Wearable inertial measurement units (IMUs) represent the most valid solution to tackle this challenge, but their validation requires RW gait data from a reliable Gold Standard (GS). This study evaluates the performance of a wearable multi- sensor system (INDIP) which was specifically conceived to be used as a RW GS [2]. In particular, the INDIP performance in estimating digital mobility outcomes (DMOs) was assessed against a stereophotogrammetric (SP) system, on healthy older adults and patients from five different cohorts, following a purposely designed experimental protocol [3]. The INDIP system includes three IMUs (sampling frequency (fs) =100 Hz) positioned on lower back and feet, two pressure insoles (16 sensing elements, fs=100 Hz) and two time-of-flight distance sensors (fs=50 Hz, range=0.2 m) [2]. Experiments were carried out on 107 participants from six different cohorts (Healthy Adults (HA), Parkinson’s Disease (PD), Multiple Sclerosis (MS), Chronic Obstructive Pulmonary Disease (COPD), Congestive Heart Failure (CHF), Proximal Femoral Fracture (PFF)) while performing a complex eleven-task protocol [3]. Walking bouts (WBs) were obtained from the INDIP data, according to the flowchart described in [2]. Then, for each WB, relevant DMOs were computed. Accuracy of the estimated DMOs was evaluated at cohort level in terms of median relative error (%). For sake of brevity, here we only report walking speed results. A total of 103 subjects were considered for the analysis (1234 WBs in total). Results at cohort level for WB walking speed are presented in Table 1. Median relative errors ranged from 2.02% to 2.58%. Results reported for the WB walking speed showed very low median relative errors across all cohorts. For each cohort, the distributions of values from the INDIP and SP were very similar as shown by the means and standard deviations in Table 1. Such low differences are excellent, especially when considering the complexity of the tasks included in the experimental protocol. In conclusion, the INDIP system is an accurate reference system for RW gait analysis.
Physical mobility is essential to health, and patients often rate it as a high-priority clinical outcome. Digital mobility outcomes (DMOs), such as real-world gait speed or step count, show promise as clinical measures in many medical conditions. However, current research is nascent and fragmented by discipline. This scoping review maps existing evidence on the clinical utility of DMOs, identifying commonalities across traditional disciplinary divides. In November 2019, 11 databases were searched for records investigating the validity and responsiveness of 34 DMOs in four diverse medical conditions (Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, hip fracture). Searches yielded 19,672 unique records. After screening, 855 records representing 775 studies were included and charted in systematic maps. Studies frequently investigated gait speed (70.4% of studies), step length (30.7%), cadence (21.4%), and daily step count (20.7%). They studied differences between healthy and pathological gait (36.4%), associations between DMOs and clinical measures (48.8%) or outcomes (4.3%), and responsiveness to interventions (26.8%). Gait speed, step length, cadence, step time and step count exhibited consistent evidence of validity and responsiveness in multiple conditions, although the evidence was inconsistent or lacking for other DMOs. If DMOs are to be adopted as mainstream tools, further work is needed to establish their predictive validity, responsiveness, and ecological validity. Cross-disciplinary efforts to align methodology and validate DMOs may facilitate their adoption into clinical practice.
Gait speed estimation using wearable inertial sensors during daily activities suffers from high complexity and inaccuracies in distance estimation when integrating acceleration signals. The aim of the study was to investigate the agreement between the methods of gait speed estimation using the persons’ walk ratio (step-length/step-frequency relation) or step-frequency (number of steps per minute) and a “gold standard”. For this cross-sectional validation study, 20 healthy community-dwelling older persons (mean age 72.1 years; 70% women) walked at slow, normal, and fast speed over an instrumented walkway (reference measure). Gait speed was calculated using the person’s pre-assessed walk ratio. Furthermore, the duration of walking and number of steps were used for calculation. The agreement between gait speed calculation using the walk ratio or step-frequency (adjusted to body height) and reference was r = 0.98 and r = 0.93, respectively. Absolute and relative mean errors of calculated gait speed using pre-assessed walk ratio ranged between 0.03–0.07 m/s and 1.97–4.17%, respectively. After confirmation in larger cohorts of healthy community-dwelling older adults, the mean gait speed of single walking bouts during activity monitoring can be estimated using the person’s pre-assessed walk ratio. Furthermore, the mean gait speed can be calculated using the step-frequency and body height and can be an additional parameter in stand-alone activity monitoring.
Optoelectronic stereophotogrammetric (SP) systems are widely used in human movement research for clinical diagnostics, interventional applications, and as a reference system for validating alternative technologies. Regardless of the application, SP systems exhibit different random and systematic errors depending on camera specifications, system setup and laboratory environment, which hinders comparing SP data between sessions and across different systems. While many methods have been proposed to quantify and report the errors of SP systems, they are rarely utilized due to their complexity and need for additional equipment. In response, an easy-to-use quality control (QC) check has been designed that can be completed immediately prior to a data collection. This QC check requires minimal training for the operator and no additional equipment. In addition, a custom graphical user interface ensures automatic processing of the errors in an easy-to-read format for immediate interpretation. On initial deployment in a multicentric study, the check (i) proved to be feasible to perform in a short timeframe with minimal burden to the operator, and (ii) quantified the level of random and systematic errors between sessions and systems, ensuring comparability of data in a variety of protocol setups, including repeated measures, longitudinal studies and multicentric studies.
INTRODUCTION:Existing mobility endpoints based on functional performance, physical assessments and patient self-reporting are often affected by lack of sensitivity, limiting their utility in clinical practice. Wearable devices including inertial measurement units (IMUs) can overcome these limitations by quantifying digital mobility outcomes (DMOs) both during supervised structured assessments and in real-world conditions. The validity of IMU-based methods in the real-world, however, is still limited in patient populations. Rigorous validation procedures should cover the device metrological verification, the validation of the algorithms for the DMOs computation specifically for the population of interest and in daily life situations, and the users' perspective on the device.METHODS AND ANALYSIS:This protocol was designed to establish the technical validity and patient acceptability of the approach used to quantify digital mobility in the real world by Mobilise-D, a consortium funded by the European Union (EU) as part of the Innovative Medicine Initiative, aiming at fostering regulatory approval and clinical adoption of DMOs.After defining the procedures for the metrological verification of an IMU-based device, the experimental procedures for the validation of algorithms used to calculate the DMOs are presented. These include laboratory and real-world assessment in 120 participants from five groups: healthy older adults; chronic obstructive pulmonary disease, Parkinson's disease, multiple sclerosis, proximal femoral fracture and congestive heart failure. DMOs extracted from the monitoring device will be compared with those from different reference systems, chosen according to the contexts of observation. Questionnaires and interviews will evaluate the users' perspective on the deployed technology and relevance of the mobility assessment.ETHICS AND DISSEMINATION:The study has been granted ethics approval by the centre's committees (London-Bloomsbury Research Ethics committee; Helsinki Committee, Tel Aviv Sourasky Medical Centre; Medical Faculties of The University of Tübingen and of the University of Kiel). Data and algorithms will be made publicly available.TRIAL REGISTRATION NUMBER:ISRCTN (12246987).