: Deep neural networks (DNN) have great success in solving difficult recognition tasks such as speech and image processing. However, performance depends on the amount of data available for training the network. In BCI, very large datasets are still missing and EEG data are particularly complex and noisy. Nevertheless, it is of interest to investigate whether DNN may prove efficient in this context. We tested 6 different deep learning models to accomplish binary classification of single-trial ERPs and compared them with Riemannian Geometry based classifiers. Each model implements a different architecture and uses two different input formats: an image ( 2D ) or a video ( 3D ). All models were tested on two different datasets, and under three different scenarios: within-subject, cross-subject and cross-experiment classification. Finally, to get insights about the decision process of the most successful DNN, we visualized the learned features using saliency maps. This revealed informative and interpretable differences between the two empirical datasets used for evaluation.
BACKGROUND AND OBJECTIVE:Some neurodegenerative conditions can severely limit patients' capability to communicate because of the loss of muscular control. Brain-computer interfaces may help in the restoration of communication with these patients, bypassing the muscular activity, so that brain signals can be directly interpreted by a computer. There are many studies regarding brain-controlled spellers; however, these systems do not usually leap out of the lab because of technical and economic requirements. As a consequence, the potential end users do not benefit from these scientific advances in their daily life. The objective of this paper is to present a novel brain-controlled speller designed to be used by patients due to its versatility and ease of use. METHODS:The brain-computer interface research group of the University of Málaga (UMA-BCI) has developed a speller application based on the well-known P300 potential which can be easily installed, configured and used. The application supports the common P300 paradigms: the Row-Column Paradigm and the Rapid Serial Visual Presentation Paradigm. The inner core of the application is implemented with a widely used and studied platform, BCI2000, which ensures its reliability and allows other researchers to apply modifications at will in order to test new features. Ten naïve volunteers carried out exercises using the application and completed usability tests for evaluation purposes. RESULTS:New subjects using the application managed to set up and use the proposed speller in less than an hour. The positive results of the evaluation through the usability tests support this application's ease of use. CONCLUSIONS:A new brain-controlled spelling tool has been presented whose aim is to be used by severely paralyzed patients in their daily lives, as well as by researchers to test new spelling features.
Across- and within-recording variabilities in electroencephalographic (EEG) activity is a major limitation in EEG-based brain-computer interfaces (BCIs). Specifically, gradual changes in fatigue and vigilance levels during long EEG recording durations and BCI system usage bring along significant fluctuations in BCI performances even when these systems are calibrated daily. We address this in an experimental offline study from EEG-based BCI speller usage data acquired for one hour duration. As the main part of our methodological approach, we propose the concept of adversarial invariant feature learning for BCIs as a regularization approach on recently expanding EEG deep learning architectures, to learn nuisance-invariant discriminative features. We empirically demonstrate the feasibility of adversarial feature learning on eliminating drowsiness effects from event related EEG activity features, by using temporal recording block ordering as the source of drowsiness variability.
Mental Imagery based Brain-Computer Interfaces (MI-BCI) are a mean to control digital technologies by performing MI tasks alone. Throughout MI-BCI use, human supervision (e.g., experimenter or caregiver) plays a central role. While providing emotional and social feedback, people present BCIs to users and ensure smooth users' progress with BCI use. Though, very little is known about the influence experimenters might have on the results obtained. Such influence is to be expected as social and emotional feedback were shown to influence MI-BCI performances. Furthermore, literature from different fields showed an experimenter effect, and specifically of their gender, on experimental outcome. We assessed the impact of the interaction between experi-menter and participant gender on MI-BCI performances and progress throughout a session. Our results revealed an interaction between participants gender, experimenter gender and progress over runs. It seems to suggest that women experimenters may positively influence partici-pants' progress compared to men experimenters.
There are many technologies being developed to assist individuals with severe disability. Devices based on human machine interface have been used to restore or replace lost movement and communication. Unfortunately, these technologies have not yet been extensively explored in children with severe disability. This paper describes a case study of a 16 year old patient in a locked-in state with virtually no communication. She is unable to move her body and is non-verbal. BCI potential was assessed using the mindBEAGLE system which utilizes auditory and vibro-tactile modalities to evoke a response. Long-term monitoring on clinical EEG characterized the neurophysiology of the patient including nearly continuous generalized discharges. The best classification accuracy for auditory and vibrotactile BCI was 40%. Higher accuracy (54%) was achieved using the motor imagery modality. Clinical neurophysiology measures can inform or to some extend predict the success of BCI performance of different modalities contributing to the user-centered design in BCI development.
