The integration of human–robot teams is increasingly essential in dynamic task environments, particularly in sectors like warehouse management, assembly lines, search and rescue operations, material handling, and autonomous driving. This trend leverages the complementary strengths of humans and robots to enhance efficiency and tackle complex objectives. However, significant challenges arise due to differences in task execution, communication modes, empathy, mental model understanding, and adaptability between humans and robots. This survey article examines the complexities of human–robot collaboration (HRC), focusing on the “3Cs” of teamwork: collaboration, communication, and cognition. It introduces a novel 3Cs rating system to evaluate HRC systems, offering a comprehensive analysis of current research trends and identifying key challenges. The findings highlight a prevalent lack of robot adaptation based on human states and performance, underscoring the need for improved communication metrics and consistent definitions of collaborative frameworks. Key contributions include the development of the 3Cs rating system, an in-depth analysis of HRC research trends, and the identification of critical areas requiring further investigation to realize the full potential of human–robot teams. This article aims to guide future research and development, promoting more effective human–robot collaborations.
Multimodal fusion networks play a pivotal role in leveraging diverse sources of information for enhanced machine learning applications in aerial imagery. However, current approaches often suffer from a bias towards certain modalities, diminishing the potential benefits of multimodal data. This paper addresses this issue by proposing a novel modality utilization-based training method for multimodal fusion networks. The method aims to guide the network’s utilization on its input modalities, ensuring a balanced integration of complementary information streams, effectively mitigating the overutilization of dominant modalities. The method is validated on multimodal aerial imagery classification and image segmentation tasks, effectively maintaining modality utilization within of the user-defined target utilization and demonstrating the versatility and efficacy of the proposed method across various applications. Furthermore, the study explores the robustness of the fusion networks against noise in input modalities, a crucial aspect in real-world scenarios. The method showcases better noise robustness by maintaining performance amidst environmental changes affecting different aerial imagery sensing modalities. The network trained with 75.0% EO utilization achieves significantly better accuracy (81.4%) in noisy conditions (noise variance = 0.12) compared to traditional training methods with 99.59% EO utilization (73.7%). Additionally, it maintains an average accuracy of 85.0% across different noise levels, outperforming the traditional method’s average accuracy of 81.9%. Overall, the proposed approach presents a significant step towards harnessing the full potential of multimodal data fusion in diverse machine learning applications such as robotics, healthcare, satellite imagery, and defense applications.