Human–robot collaboration has gained attention in the field of manufacturing and assembly tasks, necessitating the development of adaptable and user-friendly forms of interaction. To address this demand, collaborative robots (cobots) have emerged as a viable solution. Deep Learning has played a pivotal role in enhancing robot capabilities and facilitating their perception and understanding of the environment. This study proposes the integration of cobots and Deep Learning to assist users in assembly tasks such as part handover and storage. The proposed system includes an object classification system to categorize and store assembly elements, a voice recognition system to classify user commands, and a hand-tracking system for close interaction. Tests were conducted for each isolated system and for the complete application as used by different individuals, yielding an average accuracy of 91.25%. The integration of Deep Learning into cobot applications has significant potential for transforming industries, including manufacturing, healthcare, and assistive technologies. This work serves as a proof of concept for the use of several neural networks and a cobot in a collaborative task, demonstrating communication between the systems and proposing an evaluation approach for individual and integrated systems.

The rising demand for adaptable and user-friendly forms of interaction in the field of manufacturing and assembly tasks has led to increased attention on human-robot collaboration. Collaborative robots (cobots) have emerged as a promising solution to address this demand. In this study, we propose the integration and application of cobots along with a pre-trained deep learning model to assist users in assembly activities, specifically part handover and storage. The human-robot interaction is facilitated through a hand tracking system that enables a close approach to the user's hand. Testing on the system yielded 99% accuracy. The incorporation of deep learning models in cobot applications holds substantial potential for industry transformation, with implications spanning manufacturing, healthcare, and assistive technologies. This research serves as a compelling proof of concept, showcasing the effective implementation of deep learning models to facilitate close human-robot interactions.