The use of underwater vehicles, either remotely operated vehicles (ROVs) or autonomous underwater vehicles (AUVs), has become increasingly relevant in the operation and maintenance (O&M) routines of offshore wind farms. This article provides a critical review of how these platforms are being integrated into inspection and maintenance tasks, contributing not only to safer and more precise operations but also to greater autonomy in challenging marine environments. Beyond the technical and operational aspects, this review highlights their growing connection with artificial intelligence, digital twins, and multi-robot collaboration. The studies analyzed indicate a progressive shift away from conventional methods, traditionally dependent on crewed vessels and manual inspections, toward more automated, sustainable, and integrated approaches that align with the environmental and social commitments of the offshore wind sector. Finally, emerging trends and persisting obstacles, notably energy autonomy, are discussed, outlining the requirements for consolidating a robust, connected, and sustainability-oriented model for offshore maintenance.