Maritime transport plays a critical role in global logistics. Compared to road transport, the pace of research and development is much slower for maritime transport. It faces many major challenges, such as busy ports, long journeys, significant accidents, and greenhouse gas emissions. The problems have been exacerbated by recent regional conflicts and increasing international shipping demands. Maritime Autonomous Surface Ships (MASSs) are widely regarded as a promising solution to addressing maritime transport problems with improved safety and efficiency. With advanced sensing and path-planning technologies, MASSs can autonomously understand environments and navigate without human intervention. However, the complex traffic and water conditions and the corner cases are large barriers in the way of MASSs being practically deployed. In this paper, to address the above issues, we investigated the application of Large Language Models (LLMs), which have demonstrated strong generalization abilities. Given the substantial computational demands of LLMs, we propose a framework for LLM-assisted navigation in connected MASSs. In this framework, LLMs are deployed onshore or in remote clouds, to facilitate navigation and provide guidance services for MASSs. Additionally, certain large oceangoing vessels can deploy LLMs locally, to obtain real-time navigation recommendations. To the best of our knowledge, this is the first attempt to apply LLMs to assist with ship navigation. Specifically, MASSs transmit assistance requests to LLMs, which then process these requests and return assistance guidance. A crucial aspect, which has not been investigated in the literature, of this safety-critical LLM-assisted guidance system is the knowledge and safety performance of the LLMs, in regard to ship handling, navigation rules, and skills. To assess LLMs’ knowledge of navigation rules and their qualifications for navigation assistance systems, we designed and conducted navigation theory tests for LLMs, which consisted of more than 1500 multiple-choice questions. These questions were similar to the official theory exams that are used to award the Officer Of the Watch (OOW) certificate based on the Standards of Training, Certification, and Watchkeeping (STCW) for Seafarers. A wide range of LLMs were tested, which included commercial ones from OpenAI and Baidu and an open-source one called ChatGLM, from Tsinghua. Our experimental results indicated that among all the tested LLMs, only GPT-4o passed the tests, with an accuracy of 86%. This suggests that, while the current LLMs possess significant potential in regard to navigation and guidance systems for connected MASSs, further improvements are needed.

Device-free indoor localization may play a critical role in improving passengers’ safety in large vessels, particularly for scenarios without equipped radios. However, due to dynamic internal and external influences from the sailing ship such as changing sailing speed, existing localization systems suffer huge accuracy degradation in a mobile ship environment. The challenges are mainly due to rich and arbitrary ship motions and the resulting complicated impacts on the indoor wireless channels. To address the challenges, in this paper, we first propose a ship motion descriptor to extract discriminative latent representation from complex ship motions by leveraging deep-learning techniques. Based on this representation, we then design a novel fingerprint roaming model, i.e., MoLoc, to automatically learn the predictive fingerprint variation pattern and transfer the online fingerprint measurement to adapt to dynamic ship motions in real-time. Furthermore, an unsupervised learning strategy is proposed to train the fingerprint roaming model using unlabelled onboard collected data which does not incur any labor costs. We have implemented and extensively evaluated MoLoc on real-world cruise ships, where experimental results demonstrate that MoLoc improves localization accuracy from 63.2% to 92.8% compared to the state-of-the-art localization methods including Pilot, LiFS, SpotFi, and AutoFi, while achieving a mean error of 0.68m.

Efficient and safe ship evacuation strategy plays a critical role in protecting passengers’ lives when ships encounter accidents. Existing wireless sensor network (WSN)-based emergency navigation methods mainly consider the dynamics of hazards and accordingly plan evacuation paths to minimize human exposure to the environmental hazards, such as fire and smoke. However, without sufficient consideration of the ship capsizing time and the impact of dynamic ship inclination on the passengers’ walking speed, these methods may fail to evacuate passengers before the deadline. In this paper, we propose ANT, a deadlineaware adaptive emergency navigation strategy for dynamic hazardous ship evacuation with WSNs, which informs each passenger about a hazard-avoided evacuation path to successfully reach lifeboats within the specified deadline under all circumstances. To achieve this aim, ANT analyzes the process of ship capsizing to predict the specific limited evacuation time and the worst-case traversal delay. Next, an online evacuation path planning strategy is proposed based on a real-time adaptive routing algorithm to maximize navigation efficiency while ensuring user safety.We evaluate ANT by conducting prototype experiments and extensive simulations. The results demonstrate that ANT improves the navigation success ratio by 40% and 5%, compared with state-of-the-art emergency navigation systems, namely, medial axis-based approach and ENO-based oscillation-free emergency navigation approach, respectively.

Being able to track passengers’ movement without invasion of their privacy plays an important role in cruise ships; it enables crucial location-based services, such as maritime search and rescue, tourist services, and epidemic prevention. The past few years have witnessed commodity WiFi holding great potential that provides such services available thanks to its ubiquitous in indoor scenarios. However, existing WiFi-based tracking methods suffer from huge performance degradation in sailing ships due to their complex metal structures and dynamic hull deformation caused by engines and waves/payloads pressure. In this article, we present CRLoc, a deep learning-based passive human tracking system that can overcome the practical limitations of traditional WiFi-based localization approaches applied in a multipath-rich and mobile ship environment, and provide decimeter-level tracking accuracy in cruise ships. Specifically, we make two contributions, i.e., we propose a super-resolution parameter estimation algorithm that better characterizes ship indoor environments, and a deep neural network-based end-to-end solution to remove the impact of noise, interference, and mobility in ships. The real-world implementation and extensive experiments in several passenger ships demonstrate that CRLoc tracks human motions with a median error of 92 cm, better than state-of-the-art localization methods. To our knowledge, this is one of the first WiFi-based passive human motion tracking system in a cruise ship environment.

Security check-in life-support areas, e.g., bridge, engine room, is crucial for cruise ships due to numerous and diverse passenger identities. Instead of conventional security check approaches, such as facial recognition and fingerprint identification, device-free approaches enabled by WiFi-based gait recognition have attracted considerable attention owing to their low cost, non-intrusiveness, and privacy protection. Despite the excellent performance of existing indoor methods, they cannot be trivially extended to cruise ships because of the unique characteristics of hull deformation caused by vibrating engines and waves. This stems from the flexible structure of cruise ships, which introduces additional noise to the WiFi signals. To address this challenge, we propose WiCrew, a device-free gait recognition system that detects crew identity anomalies in cruise ships. WiCrew consists of two components: 1) a spatial separation algorithm that separates the signal components from ship vibration and human activity; 2) a speed-independent adversarial learning framework that identifies the ship’s crew using human gaits at an arbitrary walking speed. Extensive experiments on a cruise ship demonstrate the effectiveness of WiCrew. While the crew members walk at speed of 0.7 to 1.8 m/s, the average recognition accuracy reaches 82%, which is similar to vision-based approaches.