Direct brain control of advanced robotic systems promises substantial improvements in health care, for example, to restore intuitive control of hand movements required for activities of daily living in quadriplegics, like holding a cup and drinking, eating with cutlery, or manipulating different objects. However, such integrated, brain- or neural-controlled robotic systems have yet to enter broader clinical use or daily life environments. We demonstrate full restoration of independent daily living activities, such as eating and drinking, in an everyday life scenario across six paraplegic individuals (five males, 30 ± 14 years) who used a noninvasive, hybrid brain/neural hand exoskeleton (B/NHE) to open and close their paralyzed hand. The results broadly suggest that brain/neural-assistive technology can restore autonomy and independence in quadriplegic individuals’ everyday life.
BACKGROUND:Frontal midline theta (FMT) oscillations (4-8 Hz) are strongly related to cognitive and executive control during mental tasks such as memory processing, arithmetic problem solving or sustained attention. While maintenance of temporal order information during a working memory (WM) task was recently linked to FMT phase, a positive correlation between FMT power, WM demand and WM performance was shown. However, the relationship between these measures is not well understood, and it is unknown whether purposeful FMT phase manipulation during a WM task impacts FMT power and WM performance. Here we present evidence that FMT phase manipulation mediated by transcranial alternating current stimulation (tACS) can block WM demand-related FMT power increase (FMTΔpower) and disrupt normal WM performance. METHODS:Twenty healthy volunteers were assigned to one of two groups (group A, group B) and performed a 2-back task across a baseline block (block 1) and an intervention block (block 2) while 275-sensor magnetoencephalography (MEG) was recorded. After no stimulation was applied during block 1, participants in group A received tACS oscillating at their individual FMT frequency over the prefrontal cortex (PFC) while group B received sham stimulation during block 2. After assessing and mapping phase locking values (PLV) between the tACS signal and brain oscillatory activity across the whole brain, FMT power and WM performance were assessed and compared between blocks and groups. RESULTS:During block 2 of group A but not B, FMT oscillations showed increased PLV across task-related cortical areas underneath the frontal tACS electrode. While WM task-related FMTΔpower and WM performance were comparable across groups in block 1, tACS resulted in lower FMTΔpower and WM performance compared to sham stimulation in block 2. CONCLUSION:tACS-related manipulation of FMT phase can disrupt WM performance and influence WM task-related FMTΔpower. This finding may have important implications for the treatment of brain disorders such as depression and attention deficit disorder associated with abnormal regulation of FMT activity or disorders characterized by dysfunctional coupling of brain activity, e.g., epilepsy, Alzheimer's or Parkinson's disease (AD/PD).
Transcranial direct current stimulation (tDCS) can influence cognitive, affective or motor brain functions. Whereas previous imaging studies demonstrated widespread tDCS effects on brain metabolism, direct impact of tDCS on electric or magnetic source activity in task-related brain areas could not be confirmed due to the difficulty to record such activity simultaneously during tDCS. The aim of this proof-of-principal study was to demonstrate the feasibility of whole-head source localization and reconstruction of neuromagnetic brain activity during tDCS and to confirm the direct effect of tDCS on ongoing neuromagnetic activity in task-related brain areas. Here we show for the first time that tDCS has an immediate impact on slow cortical magnetic fields (SCF, 0-4Hz) of task-related areas that are identical with brain regions previously described in metabolic neuroimaging studies. 14 healthy volunteers performed a choice reaction time (RT) task while whole-head magnetoencephalography (MEG) was recorded. Task-related source-activity of SCFs was calculated using synthetic aperture magnetometry (SAM) in absence of stimulation and while anodal, cathodal or sham tDCS was delivered over the right primary motor cortex (M1). Source reconstruction revealed task-related SCF modulations in brain regions that precisely matched prior metabolic neuroimaging studies. Anodal and cathodal tDCS had a polarity-dependent impact on RT and SCF in primary sensorimotor and medial centro-parietal cortices. Combining tDCS and whole-head MEG is a powerful approach to investigate the direct effects of transcranial electric currents on ongoing neuromagnetic source activity, brain function and behavior.
The ability to modulate brain physiology using non-invasive transcranial electric stimulation (tES), led to a large body of experimental work aiming at identifying causal links between brain structures, physiology and behavior. However, the direct effects of tES on brain oscillatory activity is still not well understood as stimulation-dependent electromagnetic artifacts impede reliable neurophysiological recordings. Recently, we solved this problem using whole-head magnetoencephalography (MEG) and synthetic aperture magnetometry (SAM) beamforming. Here we give an overview of the technical and physical limitations of this new strategy, and present our latest findings on the effects of tES (e.g. transcranial direct current stimulation, tDCS, and transcranial alternating current stimulation, tACS) on brain oscillatory activity. Our studies show that combination of whole-head magnetoencephalography (MEG) and tES is a powerful tool to test some basic hypotheses addressing the link between brain physiology, function and human behavior.
Transcranial alternating current stimulation (tACS), a non-invasive and well-tolerated form of electric brain stimulation, can influence perception, memory, as well as motor and cognitive function. While the exact underlying neurophysiological mechanisms are unknown, the effects of tACS are mainly attributed to frequency-specific entrainment of endogenous brain oscillations in brain areas close to the stimulation electrodes, and modulation of spike timing dependent plasticity reflected in gamma band oscillatory responses. tACS-related electromagnetic stimulator artifacts, however, impede investigation of these neurophysiological mechanisms. Here we introduce a novel approach combining amplitude-modulated tACS during whole-head magnetoencephalography (MEG) allowing for artifact-free source reconstruction and precise mapping of entrained brain oscillations underneath the stimulator electrodes. Using this approach, we show that reliable reconstruction of neuromagnetic low- and high-frequency oscillations including high gamma band activity in stimulated cortical areas is feasible opening a new window to unveil the mechanisms underlying the effects of stimulation protocols that entrain brain oscillatory activity.
Event Abstract Back to Event Home-based hybrid brain-machine interface (BMI) training for neurorehabilitation of stroke Surjo R. Soekadar1, 2*, Matthias Witkowski1, 2, Leonardo G. Cohen3 and Niels Birbaumer2, 4 1 University Hospital Tübingen, Department of Psychiatry and Psychotherapy, Germany 2 University Tübingen, Institute of Medical Psychology and Behavioral Neurobiology, Germany 3 NIH, NINDS, United States 4 Ospedale San Camillo (IRCCS), Italy Paralysis following stroke is among the leading causes of persisting disability in the adulthood worldwide. In more severe cases affecting up to 50% of all stroke survivors, motor recovery is slow or non-existent. Currently, there is no standardized or accepted treatment for these patients. The development of brain-machine interfaces (BMIs) provides two new strategies to overcome stroke-related motor paralysis: First, BMIs could facilitate neuroplasticity, thus enhancing motor learning and motor recovery through brain training (rehabilitative or biofeedback BMI). Second, BMIs can establish continuous brain-control of robotic devices or functional electric stimulation (FES) that assist in performing daily life activities (assistive BMI) [1]. A major challenge in rehabilitative BMIs is to identify, establish and maintain optimal training schedules while fostering generalization of trained skills. In this context, combination of both strategies pursuit in rehabilitative and assistive BMIs seems particularly promising for restoration of normal motor function. Here we introduce a first prototype allowing for home-based hybrid BMI training that meets these criteria. Patients learn to use ipsilesional motor cortical activity and eye movements [2,3] to grasp and manipulate various objects relevant for daily life activities, e.g. a cell phone, holding a fork or a cup. This system may pave the way for investigating the efficacy of hybrid BMIs in the rehabilitation of severe stroke in the home environment of larger patient populations. Acknowledgements Supported by the Deutsche Forschungsgemeinschaft (DFG, SO932-2), the BMBF (Förderkennzeichen 01GQ0831 & 16SV5840) and the European Commission under the project WAY (#288551) and AIDE (#645322) References [1] Soekadar SR, Birbaumer N, Slutzky MW, Cohen LG. Brain-Machine Interfaces In Neurorehabilitation of Stroke. Neurobiol Dis. 2014; doi: 10.1016/j.nbd.2014.11.025 [in press]. [2] Soekadar SR, Witkowski M, Vitiello N, Birbaumer N. An EEG/EOG-based hybrid brain-neural computer interaction (BNCI) system to control an exoskeleton for the paralyzed hand. Biomed Tech (Berl). 2014; doi: 10.1515/bmt-2014-0126 [in press]. [3] Witkowski M, Cortese M, Cempini M, Mellinger J, Vitiello N, Soekadar SR. Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG). Journal of NeuroEngineering and Rehabilitation 2014, 11:165, doi:10.1186/1743-0003-11-165. Keywords: EEG, generalization, brain-machine interface, Hybrid, EOG, daily life Conference: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015), Tokyo, Japan, 13 Mar - 15 Mar, 2015. Presentation Type: Poster 1-1 Topic: Clinical Brain-Machine Interfaces Citation: Soekadar SR, Witkowski M, Cohen LG and Birbaumer N (2015). Home-based hybrid brain-machine interface (BMI) training for neurorehabilitation of stroke. Conference Abstract: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015). doi: 10.3389/conf.fnhum.2015.218.00017 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 23 Apr 2015; Published Online: 29 Apr 2015. * Correspondence: MD. Surjo R Soekadar, University Hospital Tübingen, Department of Psychiatry and Psychotherapy, Tübingen, Ba-Wü, 72076, Germany, surjo.soekadar@uni-tuebingen.de Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Surjo R Soekadar Matthias Witkowski Leonardo G Cohen Niels Birbaumer Google Surjo R Soekadar Matthias Witkowski Leonardo G Cohen Niels Birbaumer Google Scholar Surjo R Soekadar Matthias Witkowski Leonardo G Cohen Niels Birbaumer PubMed Surjo R Soekadar Matthias Witkowski Leonardo G Cohen Niels Birbaumer Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.
Sensorimotor rhythms (SMR, 8-15 Hz) are brain oscillations associated with successful motor performance, imagery, and imitation. Voluntary modulation of SMR can be used to control brain-machine interfaces (BMI) in the absence of any physical movements. The mechanisms underlying acquisition of such skill are unknown. Here, we provide evidence for a causal link between function of the primary motor cortex (M1), active during motor skill learning and retention, and successful acquisition of abstract skills such as control over SMR. Thirty healthy participants were trained on 5 consecutive days to control SMR oscillations. Each participant was randomly assigned to one of 3 groups that received either 20 min of anodal, cathodal, or sham transcranial direct current stimulation (tDCS) over M1. Learning SMR control across training days was superior in the anodal tDCS group relative to the other 2. Cathodal tDCS blocked the beneficial effects of training, as evidenced with sham tDCS. One month later, the newly acquired skill remained superior in the anodal tDCS group. Thus, application of weak electric currents of opposite polarities over M1 differentially modulates learning SMR control, pointing to this primary cortical region as a common substrate for acquisition of physical motor skills and learning to control brain oscillatory activity.
BACKGROUND:Brain-machine interfaces (BMIs) allow direct translation of electric, magnetic or metabolic brain signals into control commands of external devices such as robots, prostheses or exoskeletons. However, non-stationarity of brain signals and susceptibility to biological or environmental artifacts impede reliable control and safety of BMIs, particularly in daily life environments. Here we introduce and tested a novel hybrid brain-neural computer interaction (BNCI) system fusing electroencephalography (EEG) and electrooculography (EOG) to enhance reliability and safety of continuous hand exoskeleton-driven grasping motions.FINDINGS:12 healthy volunteers (8 male, mean age 28.1 ± 3.63y) used EEG (condition #1) and hybrid EEG/EOG (condition #2) signals to control a hand exoskeleton. Motor imagery-related brain activity was translated into exoskeleton-driven hand closing motions. Unintended motions could be interrupted by eye movement-related EOG signals. In order to evaluate BNCI control and safety, participants were instructed to follow a visual cue indicating either to move or not to move the hand exoskeleton in a random order. Movements exceeding 25% of a full grasping motion when the device was not supposed to be moved were defined as safety violation. While participants reached comparable control under both conditions, safety was frequently violated under condition #1 (EEG), but not under condition #2 (EEG/EOG).CONCLUSION:EEG/EOG biosignal fusion can substantially enhance safety of assistive BNCI systems improving their applicability in daily life environments.
The loss of hand function can result in severe physical and psychosocial impairment. Thus, compensation of a lost hand function using assistive robotics that can be operated in daily life is very desirable. However, versatile, intuitive, and reliable control of assistive robotics is still an unsolved challenge. Here, we introduce a novel brain/neural-computer interaction (BNCI) system that integrates electroencephalography (EEG) and electrooculography (EOG) to improve control of assistive robotics in daily life environments. To evaluate the applicability and performance of this hybrid approach, five healthy volunteers (HV) (four men, average age 26.5 ± 3.8 years) and a 34-year-old patient with complete finger paralysis due to a brachial plexus injury (BPI) used EEG (condition 1) and EEG/EOG (condition 2) to control grasping motions of a hand exoskeleton. All participants were able to control the BNCI system (BNCI control performance HV: 70.24 ± 16.71%, BPI: 65.93 ± 24.27%), but inclusion of EOG significantly improved performance across all participants (HV: 80.65 ± 11.28, BPI: 76.03 ± 18.32%). This suggests that hybrid BNCI systems can achieve substantially better control over assistive devices, e.g., a hand exoskeleton, than systems using brain signals alone and thus may increase applicability of brain-controlled assistive devices in daily life environments.
Objective: Transcranial direct current stimulation (tDCS) improves motor learning and can affect emotional processing and attention. However, it is unclear whether learned electroencephalography (EEG)-based brain-machine interface (BMI) control during tDCS is feasible, how application of transcranial electric currents during BMI control would interfere with feature-extraction of physiological brain signals and how it affects brain control performance. Here we tested this combination and evaluated stimulation-dependent artifacts across different EEG frequencies and stability of motor imagery-based BMI control.Approach: Ten healthy volunteers were invited to two BMI-sessions, each comprising two 60-trial blocks. During the trials, learned desynchronization of mu-rhythms (8-15 Hz) associated with motor imagery (MI) recorded over C4 was translated into online cursor movements on a computer screen. During block 2, either sham (session A) or anodal tDCS (session B) was applied at 1 mA with the stimulation electrode placed 1 cm anterior of C4.Main results: tDCS was associated with a significant signal power increase in the lower frequencies most evident in the signal spectrum of the EEG channel closest to the stimulation electrode. Stimulation-dependent signal power increase exhibited a decay of 12 dB per decade, leaving frequencies above 9 Hz unaffected. Analysis of BMI control performance did not indicate a difference between blocks and tDCS conditions.Conclusion: Application of tDCS during learned EEG-based self-regulation of brain oscillations above 9 Hz is feasible and safe, and might improve applicability of BMI systems.
Brain oscillations reflect pattern formation of cell assemblies' activity, which is often disturbed in neurological and psychiatric diseases like depression, schizophrenia and stroke. In the neurobiological analysis and treatment of these conditions, transcranial electric currents applied to the brain proved beneficial. However, the direct effects of these currents on brain oscillations have remained an enigma because of the inability to record them simultaneously. Here we report a novel strategy that resolves this problem. We describe accurate reconstructed localization of dipolar sources and changes of brain oscillatory activity associated with motor actions in primary cortical brain regions undergoing transcranial electric stimulation. This new method allows for the first time direct measurement of the effects of non-invasive electrical brain stimulation on brain oscillatory activity and behavior.
The extent to which humans can interact with machines significantly enhanced through inclusion of speech, gestures, and eye movements. However, these communication channels depend on a functional motor system. As many people suffer from severe damage of the motor system resulting in paralysis and inability to communicate, the development of brain-machine interfaces (BMI) that translate electric or metabolic brain activity into control signals of external devices promises to overcome this dependence. People with complete paralysis can learn to use their brain waves to control prosthetic devices or exoskeletons. However, information transfer rates of currently available noninvasive BMI systems are still very limited and do not allow versatile control and interaction with assistive machines. Thus, using brain waves in combination with other biosignals might significantly enhance the ability of people with a compromised motor system to interact with assistive machines. Here, we give an overview of the current state of assistive, noninvasive BMI research and propose to integrate brain waves and other biosignals for improved control and applicability of assistive machines in paralysis. Beside introducing an example of such a system, potential future developments are being discussed.
Over the last years, clinical trials indicated that brain-computer or brain-machine interface (BCI/BMI) training coupled with behavioral physiotherapy can facilitate motor recovery after severe stroke. However, results were heterogeneous and training required weeks of daily sessions. Here we introduce a novel BMI-based rehabilitation regime that promises to improve specificity and effectiveness of such training by incorporating the latest methodological advancements, such as area-specific (source-based) real-time reconstruction of brain activity and simultaneous electric brain stimulation during BMI-training to facilitate learning.
The extent to which humans can interact with machines significantly enhanced through inclusion of speech, gestures, and eye movements. However, these communication channels depend on a functional motor system. As many people suffer from severe damage of the motor system resulting in paralysis and inability to communicate, the development of brain-machine interfaces (BMI) that translate electric or metabolic brain activity into control signals of external devices promises to overcome this dependence. People with complete paralysis can learn to use their brain waves to control prosthetic devices or exoskeletons. However, information transfer rates of currently available noninvasive BMI systems are still very limited and do not allow versatile control and interaction with assistive machines. Thus, using brain waves in combination with other biosignals might significantly enhance the ability of people with a compromised motor system to interact with assistive machines. Here, we give an overview of the current state of assistive, noninvasive BMI research and propose to integrate brain waves and other biosignals for improved control and applicability of assistive machines in paralysis. Beside introducing an example of such a system, potential future developments are being discussed.
Event-related desynchronization (ERD) of sensori-motor rhythms (SMR) can be used for online brain-machine interface (BMI) control, but yields challenges related to the stability of ERD and feedback strategy to optimize BMI learning. Here, we compared two approaches to this challenge in 20 right-handed healthy subjects (HS, five sessions each, S1-S5) and four stroke patients (SP, 15 sessions each, S1-S15). ERD was recorded from a 275-sensor MEG system. During daily training, motor imagery-induced ERD led to visual and proprioceptive feedback delivered through an orthotic device attached to the subjects' hand and fingers. Group A trained with a heterogeneous reference value (RV) for ERD detection with binary feedback and Group B with a homogenous RV and graded feedback (10 HS and 2 SP in each group). HS in Group B showed better BMI performance than Group A ( p <; 0.001) and improved BMI control from S1 to S5 ( p =0.012) while Group A did not. In spite of the small n, SP in Group B showed a trend for a higher BMI performance ( p =0.06) and learning was significantly better ( p <; 0.05). Using a homogeneous RV and graded feedback led to improved modulation of ipsilesional activity resulting in superior BMI learning relative to use of a heterogeneous RV and binary feedback.