The Xiamen Symposium on Marine Environmental Sciences

2027 Xiamen Symposium on Marine Environmental Sciences

January 12-15, 2027

OceanNav: Language-Conditioned World Models for Underwater Visual Navigation via Embodied Agents
ID:1428 Oral Presentation

2027-01-15 14:30 (China Standard Time)

Session:Session 67 - Marine Robotics and Systems for Ocean Science Applications

Abstract
Marine robots, operating as embodied agents, are essential for ocean science applications, but complex ocean environments—including communication bottlenecks, energy constraints, and hydrodynamic disturbances—severely degrade visual perception and physical interaction. While existing underwater vision-language-navigation (VLN) algorithms enable natural-language instruction following, traditional reactive policies fail to adapt to unpredictable ocean currents and intermittent signal loss, highlighting the urgent need for world models that equip embodied agents with predictive state estimation and forward-looking planning.
To address these challenges, we propose OceanNav, a language-conditioned world model framework for underwater visual navigation tasks. Designed for resource-constrained marine platforms, OceanNav unifies language grounding, predictive world modeling, and active physical control to navigate visually degraded environments. It grounds the agent's spatial awareness by fusing temporal visual features with multi-modal physical sensing—including inertial sensing (IMU), Doppler velocity log (DVL), and depth measurements—into a task-oriented latent belief state. Utilizing edge computing architecture, the embodied agent locally executes real-time topological planning and large-model inference without relying on high-bandwidth continuous communication. Unlike purely reactive systems, OceanNav utilizes natural language instructions alongside an initial ego-centric observation to anticipate future states via open-loop trajectory prediction. It predicts target visibility, relative pose, and observation uncertainty, ensuring continuous language-conditioned subgoal planning even when real-time visual observations are unreliable. By tightly coupling high-level semantic understanding with low-level physical dynamics, OceanNav provides a robust framework for autonomous navigation and inspection in complex marine environments.
Speaker
Xiaoliang Fan Fujian Ocean Innovation Center;School of Informatics, Xiamen University

Author
Xiaoliang Fan Fujian Ocean Innovation Center;School of Informatics, Xiamen University

    Important Dates

    • Jan 30

      2026

      Session / Event proposals open

    • Mar 31

      2026

      Session / Event proposals close
      (Extended to April 7)

    • Apr 30

      2026

      Session acceptance notifications

    • Apr 30

      2026

      Abstract submissions & registration open

    • Jun 30

      2026

      Abstract submissions close
      (Extended to July 21)

    • Aug 31

      2026

      Abstract acceptance notifications

    • Sep 15

      2026

      Scientific program released

    • Oct 15

      2026

      Early bird registration closes

    • Jan 12–15

      2027

      XMAS 2027