V-IRL: Grounding Virtual Intelligence in Real Life

Jihan Yang¹, Runyu Ding¹, Ellis Brown², Xiaojuan Qi¹, Saining Xie²,

¹The University of Hong Kong  ²New York University

project page | arXiv

• [2024-04-18] NEW!! Release code for benchmark along with installation & curation & evaluation guideline.

• [2024-04-09] NEW!! Release code for agents and installation & deployment & running guideline.

• [2024-02-06] Release basic platform code.

• Basic Platform Code
• Agents
  • Peng
  • Aria
  • Vivek
  • RX-399
  • Imani
  • Hiro
  • Ling
  • Local
  • Diego
• Benchmarks
• Install & Deployment guideline
• Platform Document

Please refer to INSTALL.md for installation of V-IRL

Please refer to GETTING_STARTED.md to learn more usage about this project.

Please refer to FQA.md to learn solution for some potential issues.

If you find this project useful in your research, please consider cite:

@inproceedings{yang2024virl,
  title={V-irl: Grounding virtual intelligence in real life},
  author={Yang, Jihan and Ding, Runyu and Brown, Ellis and Qi, Xiaojuan and Xie, Saining},
  booktitle={European conference on computer vision},
  year={2024}
}