| CARVIEW |
Chi Han 韩迟
Email: chihan3 [at] illinois [dot] edu;
Chi Han is a PhD candidate at UIUC CS, advised by Prof. Heng Ji. Previously, he obtained his Bachelor's degree from YaoClass, Tsinghua University. Expected graduation in June 2026.
[Twitter]; [Google Scholar]; [GitHub]; [Curriculum Vitae];My Research
My long-term research goal is to develop a principled science for analyzing and reprogramming large language models (LLMs) to fundamentally bridge their gaps across domains and scientific disciplines. I believe that there exist hidden laws governing the internal mechanisms of LLMs, pointing toward a systematic framework for understanding and steering these seemingly black-box systems. Such a framework would help overcome their fundamental flaws and enable scientific discoveries beyond human capability.
I am on the academic job market for Fall 2026. If you are interested in my research and would like to discuss potential faculty positions, please feel free to reach out to me via email at chihan3 [at] illinois [dot] edu.
Awards and Honors
[2025 - 2026] Received the Mavis Future Faculty Fellowship.[2025 - 2026] Received the Amazon AICE PhD Fellowship.[2024 - 2025] Received the IBM PhD Fellowship.[Aug 2024] First-authored paper LM-Steer won an Outstanding Paper Award at ACL 2024. The live demo is hosted at HuggingFace Space.[Jun 2024] First-authored paper LM-Infinite won an Outstanding Paper Award at NAACL 2024.
News, Service and Experiences
[Oct 2025] Invited to the Summit for AI Institutes Leadership (SAIL) conference[2024-2025] Co-organizer of UIUC-NLP Seminar series.[Mar 2025] Gave an invited talk titled "Towards a Physiology of Language Models: Elucidating and Utilizing Hidden Language Representation" at Northeastern University, USA.[Feb 2025] Organized a Workshop on "Towards Knowledgeable Foundation Models" at AAAI 2025.[Feb 2025] Organized a Tutorial on "The Lifecycle of Knowledge in Large Language Models: Memorization, Editing, and Beyond" at AAAI 2025.[Feb 2025] Organized a Tutorial on "The Quest for A Science of Language Models" at AAAI 2025.(Video Recording on Underline.io)[Oct 2024] Gave a guest lecture on "Towards A Physiology of Language Model Representations" at Case West Reserve University.[Oct 2024] Gave a guest talk at CS 546: Advanced Topics in Natural Language Processing on the science of LMs while serving as a TA.[Oct 2024] Gave an invited talk at UIUC ML Seminar on "Towards A Physiology of Language Model Representations".[Sep 2024] Serving as Area Chair for EMNLP 2024 & 2025 Demos.[Sep 2024] Our work LM-Infinite and LM-Steer are covered by UIUC News.[Aug 2024] Became a P2 paragliding pilot.[2023-2024] BBQ Co-Chair for the UIUC AI and DAIS group.
Publications ( show selected / show all by date )
mCLM: A Function-Infused and Synthesis-Friendly Modular Chemical Language Model
Carl Edwards*, Chi Han*, Gawon Lee, Thao Nguyen, Bowen Jin, Chetan Kumar Prasad, Sara Szymkuć, Bartosz A. Grzybowski, Ying Diao, Jiawei Han, Ge Liu, Hao Peng, Martin D. Burke, Heng Ji
Eliminating Position Bias of Language Models: A Mechanistic Approach
Ziqi Wang, Hanlin Zhang, Xiner Li, Kuan-Hao Huang, Chi Han, Shuiwang Ji, Sham M. Kakade, Hao Peng, Heng Ji
Can Language Models Follow Multiple Turns of Entangled Instructions?
Chi Han,
EMNLP 2025 Findings, Homepage, Paper, Github Repository, HuggingFace Dataset
LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models
Chi Han, Qifan Wang, Hao Peng, Wenhan Xiong, Hugo Chan, Heng Ji, Sinong Wang
NAACL 2024 (Outstanding Paper Award), Paper, Codes, Video
LM-Steer: Word Embeddings Are Steers for Language Models
Chi Han, Jialiang Xu, Manling Li, Yi Ren Fung, Chenkai Sun, Nan Jiang, Tarek Abdelzaher, Heng Ji
ACL 2024 (Outstanding Paper Award), Paper, Codes, HuggingFace Live Demo, Slides, Poster
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
Rui Pan, Xiang Liu, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang
Large Language Models on Graphs: A Comprehensive Survey
Bowen Jin, Gang Liu, Chi Han, Meng Jiang, Heng Ji, Jiawei Han,
TKDE, Paper, Github Repo: "Awesome Language Model on Graphs"
CREATOR: Disentangling Abstract and Concrete Reasonings of Large Language Models through Tool Creation
Cheng Qian, Chi Han, Yi Ren Fung, Yujia Qin, Zhiyuan Liu, Heng Ji,
Understanding the Effect of Data Augmentation on Knowledge Distillation
Ziqi Wang, Chi Han, Wenxuan Bao, Heng Ji
Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learning
Chi Han, Qizheng He, Charles Yu, Xinya Du, Tonghang Hang, Heng Ji
Visual Concept-Metaconcept Learning
Chi Han*, Jiayuan Mao*, Chuang Gan, Joshua B. Tenenbaum, Jiajun Wu,
