[about]   [papers]   [travels]   [talks]  

Chenglei Si (チェンレイ・シ)

[email] [scholar] [twitter] [github]
3rd Year PhD at Stanford NLP

About

At Stanford, I'm advised by the wonderful Tatsu Hashimoto and Diyi Yang. Before coming to Stanford, I did my undergrad at the University of Maryland where I was advised by Jordan Boyd-Graber. I also had the fortune to work with many amazing research mentors and collaborators, including Michael Bernstein, Hal Daumé III, He He, Danqi Chen, Sherry Wu, Zhiyuan Liu, Min-Yen Kan, and many others.

I'm interested in how LLMs can transform scientific research, and new forms of human-AI co-intelligence. Towards this end, I split my time between working with LLMs and running human studies. When not writing papers, I also write research related threads for fun. During the summer of 2025, I visited FutureHouse as a research intern, where I was working on research agents and reasoning models for chemistry and biology.

Collaboration / Mentorship / Talk: Thank you for your interest! I've decided to spend the entire calendar year of 2026 on a new project and I want to be 100% committed to it. Therefore, I will unfortunately have to turn down all collaboration requests, talk invitations, and workshop co-organizations unless I have already agreed to it or if we have strong connections such that you think you can persuade me to reconsider.

Selected Papers

• The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas
  Chenglei Si, Tatsunori Hashimoto, Diyi Yang
  preprint [paper] [data] [tweet] [Science Coverage]
  


• Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
  Chenglei Si, Diyi Yang, Tatsunori Hashimoto
  ICLR 2025 [paper] [code] [tweet] [Nature News] [Newsweek] [Synced]
  


• Predicting Empirical AI Research Outcomes with Language Models
  Jiaxin Wen, Chenglei Si, Yueh-han Chen, He He, Shi Feng
  NeurIPS 2025 [paper] [tweet]
  

Talks

• Fall 2024: The Dream of Automating Research
  Stanford, USC, MIT, Northeastern, MILA, Intel, Samaya AI
  [slides] [podcast]
  


• Summer 2025: Progress on Automating Research
  UVA, alphaXiv, Ai2, CMU, COLM Visions Workshop
  [slides (v1)] [slides (v2)]
  

Conference Travels

• Oct 2025, COLM @ Montreal (co-organizer, LM4Sci)
• Apr 2025, ICLR @ Singapore
• Dec 2024, NeurIPS @ Vancouver
• Jun 2024, NAACL @ Mexico City
• Oct 2023, UIST @ San Francisco
• July 2023, ACL @ Toronto
• May 2023, ICLR @ Kigali
• Dec 2022, EMNLP @ Abu Dhabi
• July 2022, NAACL @ Seattle