Society-centred Industry 5.0

The goal of the project is to improve security in the interaction between humans and robots, as well as improving the productivity of collaborative robots in the assembly process.

PURPOSE

The project aims to implement new sustainable solutions based on collaborative robots that use mixed reality (MR) and artificial intelligence (AI), as well as analysing the performance of the implemented solutions in the robot platforms available at each of the project partners.

These proposed solutions will combine proprioception and exteroception features with cognition to improve the performance of the perceptual and reactive control systems of collaborative robots. More specifically, mixed reality with multimodal feedback will be integrated into the robot platforms to realise human-robot collaboration, improve assembly efficiency and minimise errors.

In addition, machine learning techniques based on deep learning will be integrated to identify human intentions and to predict possible failures that may occur during the human-robot collaboration to improve safety and reduce costs.

PARTNER

Goodtech Solutions AB
Ritsumeikan University
Karlstad University (project coordinator)

Project was financed by VINNOVA.

Human-Robot Interaction based on human body gesture recognition

The journal paper "A Gesture-Based Behaviour-Driven Development Approach for End-User Cobot Programming" was accepted for publication to Robotica!
Our project was presented at the workshop on Robotics and Industry 5.0 at UCLouvain, Belgium!
Two conference contributions were accepted at SII 2025 in Munich, Germany.
The project proposal submitted by Lotfi El Hafi on "Sustainable Human-Robot Synergy in Extended Reality by Foundation Model Integration for Super Smart Society 5.0" was granted by Ritsumeikan University International Collaborative Research Promotion Program (2024-2026). The collaboration partners are: Ritsumeikan University, Karlstad University, University of Southern Denmark and UCLouvain.
A prize award was given at ISRM2024 till our paper contribution "From Gestures to Behaviors: An Empirical Study on Behaviour-Driven Development Scenarios to Support End-User Programming of Collaborative Robots"!
A conference contribution was accepted and presented at ISRM2024 in Djerba, Tunisia
New press release: A new era for collaborative industrial robots
Two conference contributions were accepted and presented at WC2023 in Tokyo, Japan
Presentation of further projects results at Research & Innovation Week 2023 in Umeå, Sweden
An article at The New Värmland Newspaper
Presentation of preliminary results at Research & Innovation Week 2022 in Kyushu, Japan
The project proposal submitted by Gustavo Alfonso Garcia Ricardez on "Multi-modal Human-Robot Co-adaptive Planning for Collaborative Tasks using Mixed Reality and Artificial Intelligence" was granted by Ritsumeikan UniversityInternational Collaborative Research Promotion Program (2022-2023). The collaboration partners are: Ritsumeikan University and Karlstad University.