Extra robotic arms (XRAs) are gaining interest in neuroscience and robotics, offering potential tools for daily activities. However, this compelling opportunity poses new challenges for sensorimotor control strategies and human-machine interfaces (HMIs). A key unsolved challenge is allowing users to proficiently control XRAs without hindering their existing functions. To address this, we propose a pipeline to identify suitable HMIs given a defined task to accomplish with the XRA. Following such a scheme, we assessed a multimodal motor HMI based on gaze detection and diaphragmatic respiration in a purposely designed modular neurorobotic platform integrating virtual reality and a bilateral upper limb exoskeleton. Our results show that the proposed HMI does not interfere with speaking or visual exploration and that it can be used to control an extra virtual arm independently from the biological ones or in coordination with them. Participants showed significant improvements in performance with daily training and retention of learning, with no further improvements when artificial haptic feedback was provided. As a final proof of concept, naïve and experienced participants used a simplified version of the HMI to control a wearable XRA. Our analysis indicates how the presented HMI can be effectively used to control XRAs. The observation that experienced users achieved a success rate 22.2% higher than that of naïve users, combined with the result that naïve users showed average success rates of 74% when they first engaged with the system, endorses the viability of both the virtual reality–based testing and training and the proposed pipeline. , A nonintrusive human-machine interface for controlling extra arms was tested using a neurorobotic platform.
Publication scientifique
Human motor augmentation with an extra robotic arm without functional interference
Autres publications de la plateforme
Real-time Self-contact Retargeting of Avatars down to Finger Level
DELAHAYE, Mathias; Herbelin, Bruno; Boulic, Ronan
ICAT-EGVE 2023 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
Extrastriate activity reflects sensorimotor-induced bias in estimating number of visual humans
Albert, Louis; Herbelin, Bruno; Bernasconi, Fosco; Blanke, Olaf
Cerebral Cortex
An embodied body morphology task for investigating self-avatar proportions perception in...
Boban, Loën; Boulic, Ronan; Herbelin, Bruno
IEEE Transactions on Visualization and Computer Graphics
Impact of immersive virtual reality compared to a digital static approach...
Franco, Julie; Glize, Bertrand; Laganaro, Marina
Neuropsychologia
Noninvasive modulation of the hippocampal-entorhinal complex during spatial navigation in humans
Beanato, Elena; Moon, Hyuk-June; Windel, Fabienne; Vassiliadis, Pierre; Wessel, Maximillian J.; Popa, Traian; Pauline, Menoud; Neufeld, Esra; De Falco, Emanuela; Gauthier, Baptiste; Steiner, Melanie; Blanke, Olaf; Hummel, Friedhelm C.
Science Advances
Who says you are so sick? An investigation on individual susceptibility...
Tian, Nana; Boulic, Ronan
IEEE Transactions on Visualization and Computer Graphics
Journal de publication
Science Robotics
Auteurs:
Dominijanni, Giulia; Pinheiro, Daniel Leal; Pollina, Leonardo; Orset, Bastien; Gini, Martina; Anselmino, Eugenio; Pierella, Camilla; Olivier, Jérémy; Shokur, Solaiman; Micera, Silvestro
Date de publication:
Plateforme:
Études récentes de la plateforme
La réalité virtuelle pour combattre les troubles du langage
Evaluation linguistique dans des contextes communicatifs
Certains patients signalent un écart entre leurs performances dans le milieu médical et dans leur vie quotidienne.
Les...

Soulager l’anxiété des adolescents
Jeux vidéo pour soulager l’anxiété
Les jeux vidéo dédiés à la santé mentale sont devenus un outil de choix pour accompagner les adolescents, en...








