Showing papers by "Gernot Müller-Putz published in 2022"

Feel Your Reach: An EEG-Based Framework to Continuously Detect Goal-Directed Movements and Error Processing to Gate Kinesthetic Feedback Informed Artificial Arm Control

Abstract: Establishing the basic knowledge, methodology, and technology for a framework for the continuous decoding of hand/arm movement intention was the aim of the ERC-funded project “Feel Your Reach”. In this work, we review the studies and methods we performed and implemented in the last 6 years, which build the basis for enabling severely paralyzed people to non-invasively control a robotic arm in real-time from electroencephalogram (EEG). In detail, we investigated goal-directed movement detection, decoding of executed and attempted movement trajectories, grasping correlates, error processing, and kinesthetic feedback. Although we have tested some of our approaches already with the target populations, we still need to transfer the “Feel Your Reach” framework to people with cervical spinal cord injury and evaluate the decoders’ performance while participants attempt to perform upper-limb movements. While on the one hand, we made major progress towards this ambitious goal, we also critically discuss current limitations.

Neural Suppression Elicited During Motor Imagery Following the Observation of Biological Motion From Point-Light Walker Stimuli

Abstract: Introduction: Advantageous effects of biological motion (BM) detection, a low-perceptual mechanism that allows the rapid recognition and understanding of spatiotemporal characteristics of movement via salient kinematics information, can be amplified when combined with motor imagery (MI), i.e., the mental simulation of motor acts. According to Jeannerod’s neurostimulation theory, asynchronous firing and reduction of mu and beta rhythm oscillations, referred to as suppression over the sensorimotor area, are sensitive to both MI and action observation (AO) of BM. Yet, not many studies investigated the use of BM stimuli using combined AO-MI tasks. In this study, we assessed the neural response in the form of event-related synchronization and desynchronization (ERD/S) patterns following the observation of point-light-walkers and concordant MI, as compared to MI alone. Methods: Twenty right-handed healthy participants accomplished the experimental task by observing BM stimuli and subsequently performing the same movement using kinesthetic MI (walking, cycling, and jumping conditions). We recorded an electroencephalogram (EEG) with 32 channels and performed time-frequency analysis on alpha (8–13 Hz) and beta (18–24 Hz) frequency bands during the MI task. A two-way repeated-measures ANOVA was performed to test statistical significance among conditions and electrodes of interest. Results: The results revealed significant ERD/S patterns in the alpha frequency band between conditions and electrode positions. Post hoc comparisons showed significant differences between condition 1 (walking) and condition 3 (jumping) over the left primary motor cortex. For the beta band, a significantly less difference in ERD patterns (p < 0.01) was detected only between condition 3 (jumping) and condition 4 (reference). Discussion: Our results confirmed that the observation of BM combined with MI elicits a neural suppression, although just in the case of jumping. This is in line with previous findings of AO and MI (AOMI) eliciting a neural suppression for simulated whole-body movements. In the last years, increasing evidence started to support the integration of AOMI training as an adjuvant neurorehabilitation tool in Parkinson’s disease (PD). Conclusion: We concluded that using BM stimuli in AOMI training could be promising, as it promotes attention to kinematic features and imitative motor learning.

Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier.

Abstract: The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.

Applying Dimensionality Reduction Techniques in Source-Space Electroencephalography via Template and Magnetic Resonance Imaging-Derived Head Models to Continuously Decode Hand Trajectories

Abstract: Several studies showed evidence supporting the possibility of hand trajectory decoding from low-frequency electroencephalography (EEG). However, the decoding in the source space via source localization is scarcely investigated. In this study, we tried to tackle the problem of collinearity due to the higher number of signals in the source space by two folds: first, we selected signals in predefined regions of interest (ROIs); second, we applied dimensionality reduction techniques to each ROI. The dimensionality reduction techniques were computing the mean (Mean), principal component analysis (PCA), and locality preserving projections (LPP). We also investigated the effect of decoding between utilizing a template head model and a subject-specific head model during the source localization. The results indicated that applying source-space decoding with PCA yielded slightly higher correlations and signal-to-noise (SNR) ratios than the sensor-space approach. We also observed slightly higher correlations and SNRs when applying the subject-specific head model than the template head model. However, the statistical tests revealed no significant differences between the source-space and sensor-space approaches and no significant differences between subject-specific and template head models. The decoder with Mean and PCA utilizes information mainly from precuneus and cuneus to decode the velocity kinematics similarly in the subject-specific and template head models.

Toward passive BCI: asynchronous decoding of neural responses to direction- and angle-specific perturbations during a simulated cockpit scenario

Abstract: Neuroimaging studies have provided proof that loss of balance evokes specific neural transient wave complexes in electroencephalography (EEG), called perturbation evoked potentials (PEPs). Online decoding of balance perturbations from ongoing EEG signals can establish the possibility of implementing passive brain-computer interfaces (pBCIs) as a part of aviation/driving assistant systems. In this study, we investigated the feasibility of identifying the existence and expression of perturbations in four different conditions by using EEG signals. Fifteen healthy participants experienced four various postural changes while they sat in a glider cockpit. Sudden perturbations were exposed by a robot connected to a glider and moved to the right and left directions with tilting angles of 5 and 10 degrees. Perturbations occurred in an oddball paradigm in which participants were not aware of the time and expression of the perturbations. We employed a hierarchical approach to separate the perturbation and rest, and then discriminate the expression of perturbations. The performance of the BCI system was evaluated by using classification accuracy and F1 score. Asynchronously, we achieved average accuracies of 89.83 and 73.64% and average F1 scores of 0.93 and 0.60 for binary and multiclass classification, respectively. These results manifest the practicality of pBCI for the detection of balance disturbances in a realistic situation.

Continuous 2D trajectory decoding from attempted movement: across-session performance in able-bodied and feasibility in a spinal cord injured participant

Abstract: Objective. In people with a cervical spinal cord injury (SCI) or degenerative diseases leading to limited motor function, restoration of upper limb movement has been a goal of the brain-computer interface field for decades. Recently, research from our group investigated non-invasive and real-time decoding of continuous movement in able-bodied participants from low-frequency brain signals during a target-tracking task. To advance our setup towards motor-impaired end users, we consequently chose a new paradigm based on attempted movement. Approach. Here, we present the results of two studies. During the first study, data of ten able-bodied participants completing a target-tracking/shape-tracing task on-screen were investigated in terms of improvements in decoding performance due to user training. In a second study, a spinal cord injured participant underwent the same tasks. To investigate the merit of employing attempted movement in end users with SCI, data of the spinal cord injured participant were recorded twice; once within an observation-only condition, and once while simultaneously attempting movement. Main results. We observed mean correlations well above chance level for continuous motor decoding based on attempted movement in able-bodied participants. Additionally, no global improvement over three sessions within five days, both in sensor and in source space, could be observed across all participants and movement parameters. In the participant with SCI, decoding performance well above chance was found. Significance. No presence of a learning effect in continuous attempted movement decoding in able-bodied participants could be observed. In contrast, non-significantly varying decoding patterns may promote the use of source space decoding in terms of generalized decoders utilizing transfer learning. Furthermore, above-chance correlations for attempted movement decoding ranging between those of observation only and executed movement were seen in one spinal cord injured participant, suggesting attempted movement decoding as a possible link between feasibility studies in able-bodied and actual applications in motor impaired end users.

Editorial: Long Term User Training and Preparation to Succeed in a Closed-Loop BCI Competition

Abstract: 1 Institute of Neural Engineering, Graz University of Technology, Graz, Austria, 2 BioTechMed Graz, Graz, Austria, 3 Intelligent Systems Research Centre, Ulster University, Derry, United Kingdom, 4 Inria Bordeaux Sud-Ouest/LaBRI (Univ. Bordeaux, CNRS, Bordeaux INP), Talence, France, 5 School of Information Science and Technology, East China of University of Science and Technology, Shanghai, China, Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria

Measuring Spinal Cord Potentials and Cortico-Spinal Interactions After Wrist Movements Induced by Neuromuscular Electrical Stimulation

Abstract: Electroencephalographic (EEG) correlates of movement have been studied extensively over many years. In the present work, we focus on investigating neural correlates that originate from the spine and study their connectivity to corresponding signals from the sensorimotor cortex using multivariate autoregressive (MVAR) models. To study cortico-spinal interactions, we simultaneously measured spinal cord potentials (SCPs) and somatosensory evoked potentials (SEPs) of wrist movements elicited by neuromuscular electrical stimulation. We identified directional connections between spine and cortex during both the extension and flexion of the wrist using only non-invasive recording techniques. Our connectivity estimation results are in alignment with various studies investigating correlates of movement, i.e., we found the contralateral side of the sensorimotor cortex to be the main sink of information as well as the spine to be the main source of it. Both types of movement could also be clearly identified in the time-domain signals.

Continuous error processing during a closed-loop 2D tracking task

Abstract: Abstract The usefulness of error-related potentials (ErrPs) for control in non-invasive Brain-Computer interface (BCI) research has been established over the last decades. To continuously correct for erroneous action of an end effector (e.g., robot arm) in a BCI however, these neural correlates relating only to the discrete perception of errors remain problematic. Using a pre-recorded dataset offering feedback in a 2D tracking task in different correct or erroneous conditions, we analyzed whether error processing during continuous feedback can be observed from the electroencephalogram (EEG). Within this dataset comprising 30 sessions of recordings, we were able to detect significant differences between correct and erroneous conditions. Furthermore, minimal significant difference between two erroneous conditions is reported, confirming the direct connection between error and cognitive response.

Corrigendum: Mental State Detection Using Riemannian Geometry on Electroencephalogram Brain Signals

Abstract: [This corrects the article DOI: 10.3389/fnhum.2021.746081.].

Direction decoding of physical and visual perturbations from EEG

Abstract: It has been shown that perturbation evoked potentials could be decoded from rest electroencephalographic (EEG) signals. In this study, we investigated the neural responses of right and left perturbations in two different situations. Two types of sensorimotor perturbation consisted of visual field rotation (visual perturbation) and mediolateral pull at the waist (physical perturbation). Our results suggested that direction of perturbation can be distinguished in physical perturbation with high accuracy in single trials. No promising result was observed in differentiating the direction of perturbation in visual tasks. The findings of our study offer new possibilities in using human machine interface to compensate the imbalance events.

Using linear parameter varying autoregressive models to measure cross frequency couplings in EEG signals

Abstract: For years now, phase-amplitude cross frequency coupling (CFC) has been observed across multiple brain regions under different physiological and pathological conditions. It has been suggested that CFC serves as a mechanism that facilitates communication and information transfer between local and spatially separated neuronal populations. In non-invasive brain computer interfaces (BCI), CFC has not been thoroughly explored. In this work, we propose a CFC estimation method based on Linear Parameter Varying Autoregressive (LPV-AR) models and we assess its performance using both synthetic data and electroencephalographic (EEG) data recorded during attempted arm/hand movements of spinal cord injured (SCI) participants. Our results corroborate the potentiality of CFC as a feature for movement attempt decoding and provide evidence of the superiority of our proposed CFC estimation approach compared to other commonly used techniques.