Skip to main navigation Skip to search Skip to main content

Robot Navigation via Foundation Language Models: A Review

  • Haotian Pan
  • , Shibo Huang
  • , Jian Yang
  • , Jinpeng Mi*
  • , Ke Li
  • , Xiong You
  • , Peidong Liang
  • , Jinbo Yang
  • , Yingjie Liu
  • , Jianfeng Zhang
  • , Muyu Wang
  • , Jie Yang
  • , Xinyu Zhang
  • , Lijun Zhao
  • , Mingsong Chen
  • , Jie Zhou
  • , Xian Wei
  • *Corresponding author for this work
  • East China Normal University
  • Information Engineering University
  • University of Shanghai for Science and Technology
  • Fujian (Quanzhou) – HIT Research Institute of Engineering and Technology
  • Harbin Institute of Technology

Research output: Contribution to journalArticlepeer-review

Abstract

Recently, with advances in Large Language Models(LLMs), robot navigation models have demonstrated superior generalization capabilities across environment perception, decision-making, reasoning, planning, instruction understanding, and human-robot interaction. In this article, we systematically review recent LLM-based robot navigation research articles and categorize them into a novel taxonomy comprising perception, planning, control, interaction, and coordination. We also present an overview of the principal datasets, simulations, and metrics used in robot navigation, analyzing the distinctive characteristics of the datasets and the performance of the main LLM-based methods. Furthermore, we discuss the challenges hindering the integration of LLMs into robot navigation and provide opportunities and potential directions for future development.

Original languageEnglish
Article number291
JournalACM Computing Surveys
Volume58
Issue number11
DOIs
StatePublished - Aug 2026

Keywords

  • Large Language Models (LLMs)
  • Vision-and-Language Navigation (VLN)
  • dataset generation
  • decision-making
  • embodied intelligence
  • environment perception
  • human-robot interaction
  • instruction following
  • multi-robot coordination
  • planning
  • reasoning
  • robot navigation
  • semantic mapping
  • semantic navigation
  • sim-to-real transfer
  • simulation platform

Fingerprint

Dive into the research topics of 'Robot Navigation via Foundation Language Models: A Review'. Together they form a unique fingerprint.

Cite this