Editorial: Hybrid brain-robot interfaces for enhancing mobility
Stefano Tortora
Fiorenzo Artoni
Silvestro Micera
Luca Tonin
Solaiman Shokur- 1Department of Information Engineering, University of Padova, Padova, Italy
- 2Padova Neuroscience Center, University of Padova, Padova, Italy
- 3Functional Brain Mapping Laboratory, Department of Basic Neuroscience, Faculty of Medicine, University of Geneva, Geneva, Switzerland
- 4Translational Neural Engineering Lab, Institute Neuro X, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland
- 5Department of Excellence in Robotics and AI, Institute of BioRobotics Interdisciplinary Health Center, Scuola Superiore Sant'Anna, Pisa, Italy
Editorial on the Research Topic
Hybrid brain-robot interfaces for enhancing mobility
Recent years have seen a strong research effort in the field of neurotechnologies and neuroprosthetics—technologies that interact with the user's nervous system to restore lost or impaired neurological functions. For example, bionic limbs have allowed people with amputation to recover significant levels of dexterity (Mendez et al., 2021), and the stimulation of the spinal cord has suggested the possibility to restore locomotion in people with paralysis (Wagner et al., 2018) (see Losanno et al., 2023 for a review). However, with the advancement of these assistive devices, there is a need for the decoding of the motor intention to allow users to control their devices in an intuitive and robust manner.
In this direction, brain-machine interfaces (BMIs) have been largely proposed and exploited to recognize user's intentions through the decoding of cortical neural patterns and translate them into actions for a variety of assistive devices, such as wheelchairs, telepresence robots, exoskeletons, and robotic arms (Tonin and Millán, 2021). Despite the substantial improvements achieved by recent BMI systems, neurorobots driven by the sole brain activity are not fully acceptable in both clinical and home-care settings. Indeed, BMIs based on non-invasive recording, e.g., electroencephalography (EEG), are generally characterized by low accuracy and low informative content due to the intrinsic unreliability and non-stationarities of the driving signals. On the other hand, invasive BMIs provide clearer brain signals, potentially enhancing the decoding of users' intentions, but come with higher costs and risks due to the required surgical intervention. All these limitations lead to a higher workload required to use these neurotechnologies in everyday life, slowing down their acceptance and their translational impact.
To overcome these limitations, a recent approach proposes to integrate different human-machine interfacing modules to either improve the accuracy of the motor decoding or increase the number of degrees-of-freedom (DoFs) for controlling the robotic device (Shokur et al., 2021), and the development of novel software frameworks for neurorobotics (Tonin et al., 2022). This approach led to the development of hybrid brain-machine interface (h-BMI) solutions combining a BMI system with at least one additional (neuro)physiological interface (Hong and Khan, 2017), such as electromyography (Tortora et al., 2020) or electrooculography (Huang et al., 2019). In this sense, it would be desirable to have a variety of motor decoding modules that could be integrated and merged in order to personalize the neurotechnology to the specific user's needs, possibilities, and preferences. The current Research Topic gives an overview of such modules.
Connan et al. investigated the use of a tactile myography interface to decode the motor intent from the measurement of the volumetric variation of the muscles during contraction. This technique is an interesting alternative to more standard electromyography decoding. In the proposed experimental scenario, the participants were first asked to perform single hand and wrist actions (e.g., rest, power, flexion, extension, pronation, and supination). The recorded data were used to train the decoding algorithm. They demonstrated that the proposed interface is able to decode both single and combined actions and can be proficiently used to control two DoFs in an online goal-reaching task.
When residual movements of the upper and lower limbs are lacking due to a severe motor impairment, the user may benefit from alternative modalities relying on motor functions that are still available. Mohammadi et al. proposed a control interface for an assistive upper-limb exoskeleton with five DoFs based on an intraoral tongue-computer interface (ITCI) for individuals with tetraplegia. They showed not only that the proposed ITCI can be used to successfully control the exoskeleton in an activity of daily living without visual feedback, but also that it can achieve performance comparable to a standard joystick.
An alternative to using already available motor functions is to learn a new function for controlling a neuroprosthesis. Pinheiro et al. demonstrated the feasibility of using auricular muscles to control a visual cursor. The proposed method exploits the electromyographic recording of auricular muscle contraction to allow a self-paced continuous modulation of the cursor's velocity and position in a 2D space. In their experiment, they show that naive users can achieve successful control of the system with short training time. The main advantage of this approach is that auricular muscles are vestigial muscles that are not normally used, and they could thus represent an ideal solution for restoring a missing motor function without hindering other residual ones.
The final goal is to go beyond the current human-machine interfacing and achieve a more natural human-robot integration. Cornelio et al. suggest that the sense of agency (SoA)—the experience of feeling in control when voluntarily interacting with the assistive technology—represents a key aspect to obtain such an integration. To shed light on the concept of agency, their review paper proposes a categorization of the key elements that compose the SoA, describing how agency arises from each category of human-robot interaction. The aim is to provide the research community with guidelines to better understand and enhance the SoA in their systems, as well as discuss the opportunities and challenges to obtain a tight integration between humans and technology.
Despite the importance of SoA in the development of innovative neurotechnology, quantitative approaches to measure the rise of agency in human-robot interaction are still scarce, and qualitative questionnaire-based evaluations are mostly used. Marchesotti et al. address this issue by investigating neural correlates of visuomotor integration in human-machine interaction. In their experiment, they employed a bimanual robotic interface. During the interaction, the participants were provided with experimentally manipulated visual feedback through a virtual reality system while somatosensory evoked responses were measured through EEG recording. The group showed that the activity of the right posterior parietal cortex is responsive to the incongruency in the human-robot interaction and is correlated with a reduced sense of agency experienced by the subjects.
In conclusion, the current Research Topic has presented several new directions for motor decoding modules for assistive devices. These modules could add to the already large catalog of motor decoding strategies, such as the use of joysticks, eye tracking, sip-and-puff, or BMIs. Hybrid solutions integrating several of these modules can be a pragmatic solution to propose personalized solutions and foster the translation of brain-robot interfaces into clinical applications for enhancing mobility.
Author contributions
ST: Conceptualization, Writing—original draft. FA: Writing—review and editing. SM: Writing—review and editing. LT: Writing—review and editing. SS: Supervision, Writing—original draft.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Hong, K.-S., and Khan, M. J. (2017). Hybrid brain-computer interface techniques for improved classification accuracy and increased number of commands: a review. Front. Neurorobot. 11, 35. doi: 10.3389/fnbot.2017.00035
Huang, Q., Zhang, Z., Yu, T., He, S., and Li, Y. (2019). An EEG-/EOG-based hybrid brain-computer interface: application on controlling an integrated wheelchair robotic arm system. Front. Neurosci. 13, 1243. doi: 10.3389/fnins.2019.01243
Losanno, E., Mender, M., Chestek, C., Shokur, S., and Micera, S. (2023). Neurotechnologies to restore hand functions. Nat. Rev. Bioeng. 1, 390–407. doi: 10.1038/s44222-023-00054-4
Mendez, V., Iberite, F., Shokur, S., and Micera, S. (2021). Current solutions and future trends for robotic prosthetic hands. Annu. Rev. Control Robot. Auton. Syst. 4, 595–627. doi: 10.1146/annurev-control-071020-104336
Shokur, S., Mazzoni, A., Schiavone, G., Weber, D. J., and Micera, S. (2021). A modular strategy for next-generation upper-limb sensory-motor neuroprostheses. Med 2, 912–937. doi: 10.1016/j.medj.2021.05.002
Tonin, L., Beraldo, G., Tortora, S., and Menegatti, E. (2022). ROS-neuro: an open-source platform for neurorobotics. Front. Neurorobot. 16, 886050. doi: 10.3389/fnbot.2022.886050
Tonin, L., and Millán, J. R. (2021). Noninvasive brain-machine interfaces for robotic devices. Annu. Rev. Control Robot. Auton. Syst. 4, 191–214. doi: 10.1146/annurev-control-012720-093904
Tortora, S., Tonin, L., Chisari, C., Micera, S., Menegatti, E., Artoni, F., et al. (2020). Hybrid human-machine interface for gait decoding through Bayesian fusion of EEG and EMG classifiers. Front. Neurorobot. 14, 582728. doi: 10.3389/fnbot.2020.582728
Keywords: brain-robot interface (BRI), electromyography (EMG), electroencephalography (EEG), sense of agency (SoA), neuroprosthesis
Citation: Tortora S, Artoni F, Micera S, Tonin L and Shokur S (2023) Editorial: Hybrid brain-robot interfaces for enhancing mobility. Front. Neurorobot. 17:1264045. doi: 10.3389/fnbot.2023.1264045
Received: 20 July 2023; Accepted: 01 August 2023;
Published: 15 August 2023.
Edited and reviewed by: Florian Röhrbein, Technische Universität Chemnitz, Germany
Copyright © 2023 Tortora, Artoni, Micera, Tonin and Shokur. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Stefano Tortora, stefano.tortora@unipd.it