Background Cervical spinal cord injury severely affects grasping ability of its survivors. Fortunately, many individuals with tetraplegia retain residual arm movements that allow them to reach for objects. We propose a wearable technology that utilizes arm movement trajectory information and deep learning methods to determine grasp selection. Furthermore, we combined this approach with neuromuscular stimulation to determine if self-driven functional hand movement could be enabled in spinal cord injury participants. Methods Two cervical SCI participants performed arbitrary and natural reaching movements toward target objects in three-dimensional space, which were recorded using an inertial sensor worn on their wrist. Time series classifiers were trained to recognize the trajectories using either a Dynamic Time Warping (DTW) algorithm or a Long Short-Term Memory (LSTM) recurrent neural network . As an initial proof-of-concept, we demonstrate real-time classification of the arbitrary movements using DTW only (due to its implementation simplicity), which when used in combination with a high density neuromuscular stimulation sleeve with textile electrodes, enabled participants to perform functional grasping. Results Participants were able to consistently perform arbitrary two-dimensional and three-dimensional arm movements which could be classified with high accuracy. Furthermore, it was found that natural reaching trajectories for two different target objects (requiring two different grasp types) were distinct and also discriminable with high accuracy. In offline comparisons, LSTM (mean accuracies 99%) performed significantly better than DTW (mean accuracies 86 and 83%) for both arbitrary and natural reaching movements, respectively. Type I and II errors occurred more frequently for DTW (up to 60 and 15%, respectively), whereas it stayed under 5% for LSTM. Also, DTW achieved online accuracy of 79%. Conclusions We demonstrate the feasibility of utilizing arm trajectory information to determine grasp selection using a wearable inertial sensor along with DTW and deep learning methods. Importantly, this technology can be successfully used to control neuromuscular stimulation and restore functional independence to individuals living with paralysis. Trial registration NCT, NCT03385005 . Registered September 26, 2017
Abstract Background Cervical spinal cord injury severely affects grasping ability of its survivors. Fortunately, many individuals with quadriplegia retain residual arm movements that allow them to reach for objects. We propose a wearable technology that utilizes pattern recognition and deep learning methods to automatically classify arm trajectories and infer grasping intentions. Further, this technology can enable individuals with SCI to grasp objects without assistance via neuromuscular stimulation. Methods Two cervical SCI participants performed various reaching movements and smooth trajectories in space, which were recorded using an inertial sensor worn on their wrist. Time series classifiers were trained to recognize the trajectories using either a Dynamic Time Warping (DTW) algorithm or a Long Short-Term Memory (LSTM) recurrent neural network. Successful trajectory prediction in real-time was demonstrated using DTW, which when used in combination with a high density neuromuscular stimulation sleeve with textile electrodes, enabled participants to perform functional grasps. Results In offline comparisons, LSTM (mean accuracies 98% and 99%) performed significantly better than DTW (mean accuracies 94% and 83%) for both 2D and 3D reaching movements, respectively. Type I and II errors occurred more frequently for DTW (up to 38% and 15%, respectively), whereas it stayed under 3% for LSTM. Also, DTW achieved online accuracy of 79 ± 5%. Conclusions We demonstrate the feasibility of inferring grasping intention from reaching trajectories using wearable sensors. Importantly, this technology can be successfully used to control neuromuscular stimulators and restore functional independence to individuals living with paralysis. Trial registration: NCT, NCT03385005. Registered September 26, 2017, https://clinicaltrials.gov/ct2/show/NCT03385005
Abstract Background: Cervical spinal cord injury severely affects grasping ability of its survivors. Fortunately, many individuals with tetraplegia retain residual arm movements that allow them to reach for objects. We propose a wearable technology that utilizes arm movement trajectory information and deep learning methods to determine grasp selection. Furthermore, we combined this approach with neuromuscular stimulation to determine if self-driven functional hand movement could be enabled in spinal cord injury participants.Methods: Two cervical SCI participants performed arbitrary and natural reaching movements toward target objects in three-dimensional space, which were recorded using an inertial sensor worn on their wrist. Time series classifiers were trained to recognize the trajectories using either a Dynamic Time Warping (DTW) algorithm or a Long Short-Term Memory (LSTM) recurrent neural network. As an initial proof-of-concept, we demonstrate real-time classification of the arbitrary movements using DTW only (due to its implementation simplicity), which when used in combination with a high density neuromuscular stimulation sleeve with textile electrodes, enabled participants to perform functional grasping.Results: Participants were able to consistently perform arbitrary two-dimensional and three-dimensional arm movements which could be classified with high accuracy. Furthermore, it was found that natural reaching trajectories for two different target objects (requiring two different grasp types) were distinct and also discriminable with high accuracy. In offline comparisons, LSTM (mean accuracies 99%) performed significantly better than DTW (mean accuracies 86% and 83%) for both arbitrary and natural reaching movements, respectively. Type I and II errors occurred more frequently for DTW (up to 60% and 15%, respectively), whereas it stayed under 5% for LSTM. Also, DTW achieved online accuracy of 79%. Conclusions: We demonstrate the feasibility of utilizing arm trajectory information to determine grasp selection using a wearable inertial sensor along with DTW and deep learning methods. Importantly, this technology can be successfully used to control neuromuscular stimulation and restore functional independence to individuals living with paralysis.
Background Transcutaneous neuromuscular electrical stimulation is routinely used in physical rehabilitation and more recently in brain-computer interface applications for restoring movement in paralyzed limbs. Due to variable muscle responses to repeated or sustained stimulation, grasp force levels can change significantly over time. Here we develop and assess closed-loop methods to regulate individual finger forces to facilitate functional movement. We combined this approach with custom textile-based electrodes to form a light-weight, wearable device and evaluated in paralyzed study participants. Methods A textile-based electrode sleeve was developed by the study team and Myant, Corp. (Toronto, ON, Canada) and evaluated in a study involving three able-body participants and two participants with quadriplegia. A feedforward-feedback control structure was designed and implemented to accurately maintain finger force levels in a quadriplegic study participant. Results Individual finger flexion and extension movements, along with functional grasping, were evoked during neuromuscular electrical stimulation. Closed-loop control methods allowed accurate steady state performance (< 15% error) with a settling time of 0.67 s (SD = 0.42 s) for individual finger contact force in a participant with quadriplegia. Conclusions Textile-based electrodes were identified to be a feasible alternative to conventional electrodes and facilitated individual finger movement and functional grasping. Furthermore, closed-loop methods demonstrated accurate control of individual finger flexion force. This approach may be a viable solution for enabling grasp force regulation in quadriplegia. Trial registration NCT, NCT03385005 . Registered Dec. 28, 2017