| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Sat, 22 Nov 2025 04:15:03 GMT
access-control-allow-origin: *
strict-transport-security: max-age=31556952
etag: W/"692138c7-8034"
expires: Tue, 30 Dec 2025 06:45:13 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: 6791:318CF6:9AA1CD:ADCAD2:695372A0
accept-ranges: bytes
date: Tue, 30 Dec 2025 06:35:13 GMT
via: 1.1 varnish
age: 0
x-served-by: cache-bom-vanm7210088-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1767076513.235679,VS0,VE223
vary: Accept-Encoding
x-fastly-request-id: 67925f9b5dfd887db1fe97e30de09d2e860839da
content-length: 5853
CMU-VLN: The official webpage for Vision-Language Navigation Project in Zhang Lab in CMU.
0:07
0:21
0:40
1:18
0:16
0:48
1:08
1:11
0:07
0:29
0:49
1:03
Object Navigation
Haokun Zhu1,
Zongtai Li1,
Zihan Liu1,2,
Kevin Guo1,
Yuxin Cai1,3,
Guofei Chen1,
Chen Lv3
Wenshan Wang1
Jean Oh1
Ji Zhang1
1Carnegie Mellon University,
2New York University,
3Nanyang Technological University
Contributions
- We propose a cross-embodiment system—supporting wheeled robots, quadrupeds, and humanoids—that incrementally builds a multi-layer representation of the environment, including room, viewpoint, and object layers, enabling the VLM to make more informed decisions during the object navigation.
- We design an efficient two-stage navigation policy based on this representation, combining high-level planning guided by the VLM's reasoning and low-level exploration with VLM's assistance.
- Our system not only supports standard object navigation but also enables conditional object navigation—such as navigation conditioned on object attributes or spatial relations—through its multi-layer representation.
- We conduct extensive real-world evaluations, including three long-range tests spanning an entire building floor and 75 unit tests conducted within multi-room environments (51 on wheeled robots, 18 on quadrupeds and 6 on humannoids).
Wheeled Robot: Long-range Object Navigation
Key Moments - Click image to jump • Click 🔍 to zoom
0:07
Robot finds a refrigerator, but not in a loundge, continues.
0:21
Robot transits to the next room selected by the VLM.
0:40
Robot transits to the next room selected by the VLM.
1:18
Robot finds the refrigerator in the loundge, completes.
Key Moments - Click image to jump • Click 🔍 to zoom
0:16
Robot transits to the next room selected by the VLM.
0:48
Robot finds blue and grey trash cans, but not in a classroom, continues.
1:08
The robot aborts exploring the current room and transits to the classroom.
1:11
Robot finds the blue trash can in a classroom, completes.
Key Moments - Click image to jump • Click 🔍 to zoom
0:07
Robot finds a microwave oven but not near the fridge, continues.
0:29
Robot finds a microwave oven but not near the fridge, continues.
0:49
Robot transits to the next room selected by the VLM.
1:03
Robot finds a microwave oven near the fridge, completes.
Wheeled Robot: Object Navigation
35 demos - demos - Click any video to view in detail
Page 1 of 4
Wheeled Robot: Object Navigation with Self-attribute Condition
10 demos - Click any video to view in detail
Page 1 of 3
Wheeled Robot: Object Navigation with Spatial Condition
6 demos - Click any video to view in detail
Quadruped: Object Navigation
7 demos - Click any video to view in detail
Page 1 of 2
Quadruped: Object Navigation with Self-attribute Condition
6 demos - Click any video to view in detail
Page 1 of 2
Quadruped: Object Navigation with Spatial Condition
5 demos - Click any video to view in detail
Page 1 of 2
Humanoid: Object Navigation
demos - Click any video to view in detail
Coming Soon!
×
×