1 October 2025 in Journal of Physics: Conference Series
Vision-based perception systems, operating in the visible and infrared spectrums, are increasingly integrated into autonomous marine navigation to enhance situational awareness. However, their reliability in detecting and classifying targets is highly sensitive to environmental and operational conditions, raising critical concerns about trustworthiness – especially when system outputs are used to support human or AI-based navigation decisions. Ensuring operational safety demands robust methods to evaluate when such systems can be trusted in real time. This paper proposes a novel framework for online assessment of vision-based perception systems in maritime environments. The method enables real-time performance monitoring under dynamic and challenging conditions by analyzing sensor data in the context of changing environmental factors. A key feature of the framework is a degradation metric that signals reduced system reliability, which can be used to alert onboard or remote operators when perception outputs should no longer be relied upon. We validate our framework using real-world data collected in Danish coastal waters, demonstrating its ability to detect data quality degradation and identify conditions where vision-based systems may provide unreliable outputs. By enabling selective trust and timely intervention, the proposed approach supports safer integration of vision-based technologies in autonomous and assisted ship navigation, while mitigating information overload for human operators.