OceanNav: Language-Conditioned World Models for Underwater Visual Navigation via Embodied Agents
ID:1428
Oral Presentation
2027-01-15 14:30 (China Standard Time)
Session:Session 67 - Marine Robotics and Systems for Ocean Science Applications
Abstract
Marine robots, operating as embodied agents, are essential for ocean science applications, but complex ocean environments—including communication bottlenecks, energy constraints, and hydrodynamic disturbances—severely degrade visual perception and physical interaction. While existing underwater vision-language-navigation (VLN) algorithms enable natural-language instruction following, traditional reactive policies fail to adapt to unpredictable ocean currents and intermittent signal loss, highlighting the urgent need for world models that equip embodied agents with predictive state estimation and forward-looking planning.
To address these challenges, we propose OceanNav, a language-conditioned world model framework for underwater visual navigation tasks. Designed for resource-constrained marine platforms, OceanNav unifies language grounding, predictive world modeling, and active physical control to navigate visually degraded environments. It grounds the agent's spatial awareness by fusing temporal visual features with multi-modal physical sensing—including inertial sensing (IMU), Doppler velocity log (DVL), and depth measurements—into a task-oriented latent belief state. Utilizing edge computing architecture, the embodied agent locally executes real-time topological planning and large-model inference without relying on high-bandwidth continuous communication. Unlike purely reactive systems, OceanNav utilizes natural language instructions alongside an initial ego-centric observation to anticipate future states via open-loop trajectory prediction. It predicts target visibility, relative pose, and observation uncertainty, ensuring continuous language-conditioned subgoal planning even when real-time visual observations are unreliable. By tightly coupling high-level semantic understanding with low-level physical dynamics, OceanNav provides a robust framework for autonomous navigation and inspection in complex marine environments.
To address these challenges, we propose OceanNav, a language-conditioned world model framework for underwater visual navigation tasks. Designed for resource-constrained marine platforms, OceanNav unifies language grounding, predictive world modeling, and active physical control to navigate visually degraded environments. It grounds the agent's spatial awareness by fusing temporal visual features with multi-modal physical sensing—including inertial sensing (IMU), Doppler velocity log (DVL), and depth measurements—into a task-oriented latent belief state. Utilizing edge computing architecture, the embodied agent locally executes real-time topological planning and large-model inference without relying on high-bandwidth continuous communication. Unlike purely reactive systems, OceanNav utilizes natural language instructions alongside an initial ego-centric observation to anticipate future states via open-loop trajectory prediction. It predicts target visibility, relative pose, and observation uncertainty, ensuring continuous language-conditioned subgoal planning even when real-time visual observations are unreliable. By tightly coupling high-level semantic understanding with low-level physical dynamics, OceanNav provides a robust framework for autonomous navigation and inspection in complex marine environments.
Speaker
Author
Important Dates
-
Jan 30
2026
Session / Event proposals open
-
Mar 31
2026
Session / Event proposals close
(Extended to April 7) -
Apr 30
2026
Session acceptance notifications
-
Apr 30
2026
Abstract submissions & registration open
-
Jun 30
2026
Abstract submissions close
(Extended to July 21) -
Aug 31
2026
Abstract acceptance notifications
-
Sep 15
2026
Scientific program released
-
Oct 15
2026
Early bird registration closes
-
Jan 12–15
2027
XMAS 2027
