Inertial measurement unit (IMU)-based gait analysis systems have become popular in clinical environments because of their low cost and quantitative measurement capability. When a shank is selected as the IMU mounting position, an inverted pendulum model (IPM) can accurately estimate its spatial gait parameters. However, the stride-by-stride estimation of gait parameters using one IMU on each shank and the IPMs has not been validated. This study validated a spatial gait parameter estimation method using a shank-based IMU system. Spatial parameters were estimated via the double integration of the linear acceleration transformed by the IMU orientation information. To reduce the integral drift error, an IPM, applied with a linear error model, was introduced at the mid-stance to estimate the update velocity. the gait data of 16 healthy participants that walked normally and slowly were used. The results were validated by comparison with those extracted from an optical motion-capture system; the results showed strong correlation ( $$r>0.9$$ ) and good agreement with the gait metrics (stride length, stride velocity, and shank vertical displacement). In addition, the biases of the stride length and stride velocity extracted using the motion capture system were smaller in the IPM than those in the previous method using the zero-velocity-update. The error variabilities of the gait metrics were smaller in the IPM than those in the previous method. These results indicated that the reconstructed shank trajectory achieved a greater accuracy and precision than that of previous methods. This was attributed to the IPM, which demonstrates that shank-based IMU systems with IPMs can accurately reflect many spatial gait parameters including stride velocity.
The self is built as an entity independent from the external world using the human ability to experience the senses of agency and ownership. Humans usually experience these senses during movement. Nevertheless, researchers recently reported that another person’s synchronous mirror-symmetrical movements elicited both agency and ownership in research participants. However, it is unclear whether this elicitation was caused by the synchronicity or the mirror symmetry of the movements. To address this question, we investigated the effect of interpersonal synchronization on the self-reported sense of agency and ownership in two conditions, using movements with and without mirror symmetry. Participants performed rhythmic hand movements while viewing the experimenter’s synchronous or random hand movements, and then reported their perceptions of agency and ownership in a questionnaire. We observed that agency and ownership were significantly elicited by the experimenter’s synchronous hand movements in both conditions. The results suggested that the synchronous movements of another person—rather than mirror- or non-mirror-symmetrical movements—appear to elicit the experience of a sense of agency and ownership. The results also suggested that people could experience these senses not only from their own movements but also from another person’s synchronous movements.
Researchers investigating virtual/augmented reality have shown humans' marked adaptability, especially regarding our sense of body ownership; their cumulative findings have expanded the concept of what it means to have a body. Herein, we report the hand ownership illusion during "two views merged in." In our experiment, participants were presented two first-person perspective views of their arm overlapped, one was the live feed from a camera and the other was a playback video of the same situation, slightly shifted toward one side. The relative visibility of these two views and synchrony of tactile stimulation were manipulated. Participants' level of embodiment was evaluated using a questionnaire and proprioceptive drift. The results show that the likelihood of embodying the virtual hand is affected by the relative visibility of the two views and synchrony of the tactile events. We observed especially strong hand ownership of the virtual hand in the context of high virtual hand visibility with synchronous tactile stimulation.
In a meeting, two or more individuals come together to verbally share information. However, discrepancies in perceptions often occur in complicated discussions. Therefore, whether the information transfer succeeded must be reconfirmed. This problem is typically resolved through ex-post measures such as meeting minutes. Our previous results indicated that the degree of information transfer can be predicted using head movement synchrony. In this study, we propose an information transfer estimation method based on head movement synchrony during a conversation evaluated by an omnidirectional camera that can easily obtain body movements. These body movements were quantified using Motion Energy Analysis, which is commonly used in clinical psychology, with additional processes used to reduce noise caused by lighting in the room and resulting from large accidental movements. By these processes, body movement synchrony was quantified. We confirmed that this synchrony occurred between actually interacting pairs and tested whether it was related to the degree of information transfer. In the experimental evaluation, body movement synchrony was found to be high for interacting pairs, and a positive correlation was observed between synchrony and degree of information transfer. Therefore, our proposed method may detect the synchrony and estimate the degree of information transfer using an omnidirectional camera.
This study aimed to investigate whether using a wearable robot applying interactive rhythmic stimulation on the upper limbs of patients with Parkinson's disease (PD) could affect their gait. The wearable robot presented tactile stimuli on the patients' upper limbs, which was mutually synchronized with the swing of their upper limbs. We conducted an evaluation experiment with PD patients (n = 30, Modified Hoehn-Yahr = 1–3, on-state) to investigate the assistance effect by the robot and the immediate after-effect of intervention. The participants were instructed to walk 30 m under four different conditions: (1) not wearing the robot before the intervention (Pre-condition), (2) wearing the robot without the rhythm assistance (RwoA condition), (3) wearing the robot with rhythm assistance (RwA condition), and (4) not wearing the robot immediately after the intervention (Post-condition). These conditions were conducted in this order over a single day. The third condition was performed three times and the others, once. The arm swing amplitude, stride length, and velocity were increased in the RwA condition compared to the RwoA condition. The coefficient of variance (CV) of the stride duration was decreased in the RwA condition compared to the RwoA condition. These results revealed that the assistance by the robot increased the gait performance of PD patients. In addition, the stride length and velocity were increased and the stride duration CV was decreased in the Post-condition compared to the Pre-condition. These results show that the effect of robot assistance on the patient's gait remained immediately after the intervention. These findings suggest that synchronized rhythmic stimulation on the upper limbs could influence the gait of PD patients and that the robot may assist with gait rehabilitation in these patients.
Gait analysis is used widely in clinical practice to evaluate abnormal gait caused by disease. Conventionally, medical professionals use motion capture systems or make visual observations to evaluate a patient's gait. Recent biomedical engineering studies have proposed easy-to-use gait analysis methods employing wearable sensors with inertial measurement units (IMUs). IMUs placed on the shanks just above the ankles allow for long-term gait monitoring because the participant can walk with or without shoes during the analysis. To the knowledge of the authors, no IMU-based gait analysis method has been reported that estimates stride length, gait speed, stride duration, stance duration, and swing duration simultaneously. In the present study, we tested a proposed gait analysis method that uses IMUs attached on the shanks to estimate foot trajectory and temporal gait parameters. Our proposed method comprises two steps: stepwise dissociation of continuous gait data into multiple steps and three-dimensional trajectory estimation from data obtained from accelerometers and gyroscopes. We evaluated this proposed method by analyzing the gait of 19 able-bodied participants (mean age 23.9 years, 9 men and 10 women). Wearable sensors were attached on the participants' shanks, and we measured three-axis acceleration and three-axis angular velocity with the sensors to estimate foot trajectory during walking. We compared gait parameters estimated from the foot trajectory obtained with the proposed method and those measured with a motion capture system. Mean accuracy (± standard deviation) was 0.054 ± 0.031 m for stride length, 0.034 ± 0.039 m/s for gait speed, 0.002 ± 0.020 s for stride duration, 0.000 ± 0.017 s for stance duration, and 0.002 ± 0.024 s for swing duration. These results suggest that the proposed method is suitable for gait analysis, whereas there is a room for improvement of its accuracy and further development of this IMU-based gait analysis method will enable us to use such systems for clinical gait analysis.
Human interaction has two principle functions: building and maintaining relationships with others and exchanging information. The function of building and maintaining relationships with others relates to interpersonal coordination; this behavior pattern is expected to predict the outcome of social relationships, such as between therapists and patients. It is unclear, however, whether the exchange of information is associated with interpersonal coordination. In the present study, we tested a hypothesis of whether body movement synchrony occurs in a natural conversation and whether this synchrony has a positive correlation with the degree of information exchange. Fifty participants were engaged in a conversation task; each had different roles in the conversation. We measured their body movements during this conversation using an optical motion capture system. Similar to methods that can be found in previous research, we calculated body movements and quantified their synchrony applying the methods previously reported that automatically quantified their body movements. Moreover, we determined the participants’ degree of information exchange concerning the conversation using a questionnaire. We observed that the body movement synchrony of pairs who talked with each other was significantly higher than that of pairs who did not talk with each other, and that this synchrony was positively associated with the degree of information exchange. These results suggest that body movement synchrony predicted information exchange.
An error-related potential (ErrP) is a form of event-related potential that occurs when an error-related stimulus is encountered during a task. The decoding of ErrP has the potential to apply for Brain Computer System (BCI). Although various methods have been applied to the decoding of ErrPs, existing classification methods have room for improvement. Using a deep convolutional neural network (DCNN) is a viable approach to ErrP classification but its performance can be compromised by insufficient training data being available. Using a form of generative adversarial network (GAN) enables data augmentation, which has offered significant performance improvement in a variety of fields such as signal processing, robotics, and unmanned vehicles. We therefore propose a novel approach to ErrP classification that combines GAN with DCNN to form a data-augmented DCNN. The proposed method has two main components: a GAN that offers data augmentation and a DCNN that performs the classification. We applied our method to the BNCI2020 dataset 22: Monitoring ErrPs, evaluating the results in terms of classification accuracy in various categories, including single-subject single-session, cross-subject single session, cross-session single-subject, and cross-subject cross-session versions for the entire dataset. The evaluations showed that the classification results had been improved comprehensively in comparison with existing published results. The maximum accuracy of the classification performance for the entire dataset reached 87%, which is 3% above the previous best result.
This paper reports a high-sensitivity inertial sensor module to obtain hidden micro muscular sounds. A microelectromechanical systems (MEMS) accelerometer with a gold proof mass is used to minimize the sensor noise. The sensor module is designed for the measurement of physical vibration. The noise floor of the developed module is found to be around 10 dB lower than that of a commercial one. Experimental results of forefinger vibration measurements confirm that the module has successfully captured the target signal at the frequency range of muscular sounds, which is buried in the noise of conventional measurements.
Behavioral errors may cause serious results. For example, while driving a car, if the intention is to stop and the accelerator pedal is mistaken for the brake pedal, a serious traffic accident may result. If electrophysiological phenomena that involve behavioral errors are identified, we may be able to avoid behavioral errors by detecting the error precursor. We have already revealed a neural sign of behavioral errors in our previous study. In the previous study, we applied a spatiotemporal analysis to high-density electroencephalogram (EEG) signals recorded during a visual discrimination task, a d2 test of attention. We demonstrated that, during trials with error outcomes, positive deviation of scalp amplitude with latency of approx. 30 ms was observed in frontal regions, positive deviation with latency of approx. 125 ms was observed in parietal regions, and then a positive deviation with latency of approx. 160 ms was observed in the occipital region. In this study, we propose a single-trial prediction method of behavioral errors by detecting the electrophysiological sign of behavioral errors.
Gaze-independent brain computer interfaces (BCIs) are a potential communication tool for persons with paralysis. This study applies affective auditory stimuli to investigate their effects using a P300 BCI. Fifteen able-bodied participants operated the P300 BCI, with positive and negative affective sounds (PA: a meowing cat sound, NA: a screaming cat sound). Permuted stimuli of the positive and negative affective sounds (permuted-PA, permuted-NA) were also used for comparison. Electroencephalography data was collected, and offline classification accuracies were compared. We used a visual analog scale (VAS) to measure positive and negative affective feelings in the participants. The mean classification accuracies were 84.7% for PA and 67.3% for permuted-PA, while the VAS scores were 58.5 for PA and −12.1 for permuted-PA. The positive affective stimulus showed significantly higher accuracy and VAS scores than the negative affective stimulus. In contrast, mean classification accuracies were 77.3% for NA and 76.0% for permuted-NA, while the VAS scores were −50.0 for NA and −39.2 for permuted NA, which are not significantly different. We determined that a positive affective stimulus with accompanying positive affective feelings significantly improved BCI accuracy. Additionally, an ALS patient achieved 90% online classification accuracy. These results suggest that affective stimuli may be useful for preparing a practical auditory BCI system for patients with disabilities.
Background: Normal pressure hydrocephalus (NPH) is characterized by three symptoms, disturbance of gait, dementia and urinary incontinence. Especially, disturbance of gait is known as a relatively early symptom. Differential diagnosis of NPH is not easy since many symptoms overlap with other neurological diseases. The cerebrospinal fluid shunting is expected to ameliorate symptoms of NPH. The late detection of disease may limit the treatment effect. Therefore, the early detection of NPH is important. Previous studies have reported that clinical features of the gait abnormality in NPH. These measurements need relatively large instruments, such as motion capture systems.
The unusual configuration of body parts can cause illusions. For example, when tactile stimuli are delivered to crossed arms a reversal of subjective temporal ordering occurs. Our group has previously demonstrated that arm crossing without sensory stimuli causes activity changes in the left posterior parietal cortex (PPC) and an assessment of tactile temporal order judgments (TOJs) revealed a positive association between activity in this area, especially the left intraparietal sulcus (IPS), and the degree of the crossed-hand illusion. Thus, the present study investigated how the IPS actively relates to other cortical areas under arms-crossed and -uncrossed conditions by analyzing the functional connectivity of the IPS. Regions showing connectivity with the IPS overlapped with regions within the default mode network (DMN) but the IPS also showed connectivity with other brain areas, including the frontoparietal control network (FPCN). The right middle/inferior frontal gyrus (MFG/IFG), which is included in the FPCN, showed greater connectivity in the arms-crossed condition than in the arms-uncrossed condition. These findings suggest that there is state-dependent connectivity during arm crossing, and that the left IPS may play an important role during the spatio-temporal updating of arm positions.
Gaze-independent brain-computer interfaces (BCIs) are a possible communication channel for persons with paralysis. We investigated if it is possible to use auditory stimuli to create a BCI for the Japanese Hiragana syllabary, which has 46 Hiragana characters. Additionally, we investigated if training has an effect on accuracy despite the high amount of different stimuli involved. Able-bodied participants (N = 6) were asked to select 25 syllables (out of fifty possible choices) using a two step procedure: First the consonant (ten choices) and then the vowel (five choices). This was repeated on 3 separate days. Additionally, a person with spinal cord injury (SCI) participated in the experiment. Four out of six healthy participants reached Hiragana syllable accuracies above 70% and the information transfer rate increased from 1.7 bits/min in the first session to 3.2 bits/min in the third session. The accuracy of the participant with SCI increased from 12% (0.2 bits/min) to 56% (2 bits/min) in session three. Reliable selections from a 10 × 5 matrix using auditory stimuli were possible and performance is increased by training. We were able to show that auditory P300 BCIs can be used for communication with up to fifty symbols. This enables the use of the technology of auditory P300 BCIs with a variety of applications.
The ownership of one's body parts represents a fundamental aspect of self-consciousness. Accumulating empirical evidence supports the existence of this concept in humans and nonhuman primates, but it is unclear whether nonprimate mammals experience similar feelings. Therefore, the present study used rubber tails to investigate body ownership in rodents. When the real tails and rubber tails were synchronously stroked, the mice responded as if their own tails were touched when the rubber tails were grasped. In contrast, when the stimuli were delivered asynchronously, there was a significantly lower mean response rate when the rubber tail was grasped. These findings suggest that mice may experience body ownership of their tails, suggestive of the rubber hand illusion in humans.SIGNIFICANCE STATEMENT:To explore the manner in which the ownership of body parts is experienced, this study specifically used the rubber hand illusion (RHI), in which self-consciousness can be extended out of one's own body. Accumulating empirical evidence supports the existence of this concept in humans and nonhuman primates, but it remains unclear whether nonprimate mammals experience similar feelings. This study demonstrated for the first time that mice may experience body ownership of their tails, which is suggestive of the RHI in humans and provides evidence that may highlight how humans experience the ownership of body parts.
The simultaneous perception of multimodal sensory information has a crucial role for effective reactions to the external environment. Voluntary movements are known to occasionally affect simultaneous perception of auditory and tactile stimuli presented to the moving body part. However, little is known about spatial limits on the effect of voluntary movements on simultaneous perception, especially when tactile stimuli are presented to a non-moving body part. We examined the effect of voluntary movement on the simultaneous perception of auditory and tactile stimuli presented to the non-moving body part. We considered the possible mechanism using a temporal order judgement task under three experimental conditions: voluntary movement, where participants voluntarily moved their right index finger and judged the temporal order of auditory and tactile stimuli presented to their non-moving left index finger; passive movement; and no movement. During voluntary movement, the auditory stimulus needed to be presented before the tactile stimulus so that they were perceived as occurring simultaneously. This subjective simultaneity differed significantly from the passive movement and no movement conditions. This finding indicates that the effect of voluntary movement on simultaneous perception of auditory and tactile stimuli extends to the non-moving body part.
Event Abstract Back to Event A decoded neurofeedback method for MEG/SSVEF Hiroki Ora1, 2 and Kenji Kansaku1, 2* 1 Research Institute of National Rehabilitation Center for Persons with Disabilities, Department of Rehabilitation for Brain Function, Japan 2 The University of Electro-Communications, Brain Science Inspired Life Support Research Center, Japan Decoded neurofeedback method was recently proposed to lead brain activity to a target state (Shibata, et al., 2011). While researchers utilized functional magnetic resonance imaging in the former studies, little is focused on magnetoencephalography (MEG). Real-time magnetoencephalography (rtMEG) is an emerging neurofeedback technology that could potentially benefit multiple areas of basic and clinical neuroscience, and in this study, we used an rtMEG system to perform decoded neurofeedback training for MEG/steady-state visual evoked field (SSVEF). Five able-bodied participants (age 33.2 years old, 5 females) participated in this study. The visual stimuli were displayed on a screen in front of the participant, and consisted of a circular checkerboard patch on the left and a circular checkerboard patch on the right. The checkerboard patches flickered at 5 (left) or 6 (right) Hz. They were asked to attend to the left, right, or middle of the screen in a SSVEF task. The used MEG scanner was a 306-channel Elekta Neuromag system (Elekta Oy, Helsinki, Finland). We constructed a sparse multinomial logistic regression (SMLR) decoder from MEG signals during the SSVEF task in each participant. We then conducted 3-day MEG neurofeedback training. In a trial, a white fixation cross was turned green for 5 second, then a green solid circle, whose radius indicated a score of the SMLR decoder, was presented. Participants were asked to "somehow regulate your brain activity to make the green solid circle bigger while the fixation cross is green." During the trainings, no flickering visual stimuli were presented. After the trainings, the SSVEF task was used again to evaluate the training effects. Furthermore, we analyzed weights of the SMLR decoders to determine a subset of MEG sensors that contributed to decode the attended orientation. The SMLR decoder was able to classify the MEG signals into 3 attentional directions (left, right or middle) (88.2 %). The participants were able to increase decoder scores through the trainings (p<0.05). In the post-training SSVEF tasks, accuracy for the target orientation was higher than that for the non-target orientation (p<0.05). Analysis of weights of the decoders demonstrated that sensors on the occipital region contributed to decode the attended orientation (p<0.05, Bonferroni corrected). The results suggest that the decoded neurofeedback training was effective for MEG/SSVEF, and the method may enhance robustness of steady-state visual evoked potential (SSVEP)-based Brain-Computer Interface (BCI). Keywords: Magnetic Resonance Imaging, decoded neurofeedback, Magnetoencephalography (MEG), Real-time magnetoencephalography, Steady-state visual evoked field Conference: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015), Tokyo, Japan, 13 Mar - 15 Mar, 2015. Presentation Type: Poster 1-6 Topic: Clinical Brain-Machine Interfaces Citation: Ora H and Kansaku K (2015). A decoded neurofeedback method for MEG/SSVEF. Conference Abstract: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015). doi: 10.3389/conf.fnhum.2015.218.00007 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers' terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 23 Apr 2015; Published Online: 29 Apr 2015. * Correspondence: Dr. Kenji Kansaku, Research Institute of National Rehabilitation Center for Persons with Disabilities, Department of Rehabilitation for Brain Function, Tokorozawa, Saitama, Japan, kansakuk@dokkyomed.ac.jp Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Hiroki Ora Kenji Kansaku Google Hiroki Ora Kenji Kansaku Google Scholar Hiroki Ora Kenji Kansaku PubMed Hiroki Ora Kenji Kansaku Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.