Third Arm
The goal of this project, launched at the end of 2018, is to allow subjects to control an additional robotic limb in combination with the natural arms and hands, while performing activities of daily living. To achieve this goal, NCCR Robotics researchers are going to develop a novel bidirectional human-machine interface (HMI). Decoding will be based on the combined processing of electroencephalographic (EEG), electromyographic (EMG) and kinematic information from are- as such as neck and trunk while sensory feedback will be provided using while sensory feedback will be provided using non-invasive techniques. In parallel, a wearable robotic device – i.e. the “third arm” – will be developed. It will enable complex motion behaviour combined with intuitive user control, and it will be adaptable to different tasks and users. The project is led by Silvestro Micera, who is collaborating with Aude Billard on the interfaces used to control of the third arm. Jaime Paik’s lab is developing the robotic arm using soft pneumatic actuators, while Roger Gassert at ETH Zurich and Laura Marchal-Crespo at the University of Bern are developing training protocols and participative design methods to make sure the new robot fits the needs of users.
Labs involved: A. Billard, R. Gassert, L. Marchal-Crespo, S. Micera, J. Paik
Related publications
- E. Krausz, D. Lamotte, I. Batzianoulis, L. Hargrove,S. Micera and A. Billard, “Intent Prediction Based on Biomechanical Coordination of EMG and Vision-Filtered Gaze for End-Point Control of an Arm Prosthesis”, IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 6, pp. 1471– 1480, June 2020
- Valle et al. “Hand Control With Invasive Feedback Is Not Impaired by Increased Cognitive Load”, Frontiers in Bioengineering and Biotechnoly, vol. 3, no. 8, 287, April 2020.
- Cracchiolo et al., “Decoding of grasping tasks from intraneural recordings in trans-radial amputee”, Journal of Neural Engineering , vol. 17, no. 2, 026034, Apr. 2020.
- A. Robertson, O. C. Kara & J. Paik “Soft pneumatic actuator-driven origami-inspired modular robotic ‘pneumagami’” The International Journal of Robotics Research, March 2020.
- A. Sonar, A. P. Gerratt, S. P. Lacour & J. Paik “Closed-loop haptic feedback control using a self-sensing soft pneumatic actuator skin”, Soft robotics, vol. 7 no. 1, pp. 22–29, Feb. 2020.
- Wenk, J. Penalver-Andres, R. Palma, K. A.Buetler, R. Müri, T. Nef, L. Marchal-Crespo. “Reaching in Several Realities: Motor and Cognitive Benefits of Different Visualization Technologies” IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, Canada, 2019, pp. 1037–1042.
- Hennig, J. Gantenbein, J. Dittli, H. Chen, S. P.Lacour, O. Lambercy, and R. Gassert, “Development and Evaluation of a Sensor Glove to Detect Grasp Intention for a Wearable Robotic Hand Exoskeleton”, IEEE RAS / EMBS International Conference on Biomedical Robotics & Biomechatronics, New York, USA, 2020.
- T. Meyer , J. Dittli , A. Stutz, O. Lambercy, and R.Gassert, “A Method to Evaluate and Improve the Usability of a Robotic Hand Orthosis from the Caregiver Perspective”, IEEE RAS / EMBS International Conference on Biomedical Robotics & Biomechatronics, New York, USA, 2020.
- Bützer, O. Lambercy, J. Arata, and R. Gassert,“Fully Wearable Actuated Soft Exoskeleton for Grasping Assistance in Everyday Activities”, Soft Robotics, 2020.