| CARVIEW |
Biography
Chao Peng (彭péng, 超chāo)
I am a Principal Research Scientist at ByteDance (字节跳动). I received my PhD degree from Laboratory for Foundations of Computer Science (LFCS), The University of Edinburgh under supervision of Prof. Ajitha Rajan.
At ByteDance, I lead the Software Engineering Lab, where we conduct research on AI agents for software engineering. My research interest lies in the area of software testing, program repair and optimisations, and the synergy with machine learning and compiler techniques. I am also responsible for academic development and university collaboration.
My work appears in premier venues such as ICSE, FSE, ASE, ACL, NeurIPS and I serve/served on ASE/FSE/ISSTA program committees, as Steering Committee member of AIware, Program co-chair for AIware 2026 and Industry Track co-chair for FORGE 2026. I received the ACM SIGSOFT Distinguished Reviewer Award (FSE2025).
Outside of work, I enjoy going to the gym.
Email:
prefix="chao.peng"
domain="acm"
email=${prefix}@${domain}.org
- LLM4Code
- Software Testing
- Program Repair
-
PhD in Informatics, 2021
University of Edinburgh, UK
-
MSc in High Performance Computing and Data Science, 2017
University of Edinburgh, UK
-
BEng in Computer Science and Technology, 2016
Xuzhou University of Technology, China
LLM4SE Research Overview
News
- 22 Dec 2025 Two papers are accepted by FSE 2026 (direct acceptance rate: 9.5%): Reducing Cost of LLM Agents with Trajectory Reduction, and GraphLocator: Graph-guided Causal Reasoning for Issue Localization. Congratulations to Wei and Yuan-an!
- 18 Dec 2025 I am invited to join the program committee of ASE 2026.
- 17 Dec 2025 One more paper, Agent-Based Ensemble Reasoning for Repository-Level Issue Resolution, got accpeted by ICSE 2026 after a major revision. Congratulations to Zhao!
- 12 Nov 2025 I am invited to serve as the program co-chair for AIware. Please consider submitting to us.
- 5 Nov 2025 I am invited to join the program committee of ISSTA 2026.
- 16 Oct 2025 Three papers are accepted by ICSE 2026: More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents, Enhancing Issue Localization Agent with Tool-Interactive Training, and LLM-based Agents for Automated Bug Fixing: How Far Are We?
- 25 Sep 2025 Our paper Repo2Run: Automated Building Executable Environment for Code Repository at Scale is accepted by NeurIPS 2025 as a Spotlight Paper [pdf]. Congratulations to Ruida! The framework is available at GitHub.
- 12 Sep 2025 Our paper RepoMasterEval: Evaluating Code Completion via Real-World Repositories is accepted by the Industry Track of ASE 2025.
- 14 Aug 2025 Our paper CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generation is accepted by the Research Track of ASE 2025.
- 11 Aug 2025 Invited to serve as the Co-chair for the Industry Track of FORGE 2026. This year, we will feature invited talks from leading practitioners and innovators at the forefront of AI-driven software engineering. Stay tuned!
- 1 Aug 2025 We are happy to publish the technical report of Trae Agent, the SOTA agent on the SWE-bench Verified Leaderboard.
- 24 Jun 2025 Selected as the Distinguished Reviewer for FSE'25.
- 7 Jul 2025 I am invited to give keynote talks at AIware'25 and the AgenticSE workshop, both co-located with ASE'25 in Seoul.
- 18 Jun 2025 Invited to join the program committee of the FSE'26.
- 17 Jun 2025 Our paper Go-Oracle: Automated Test Oracle for Go Concurrency Bugs is accepted by the Technical Track of ESEM 2025.
- 13 Jun 2025 Invited to join the program committee of the Industrial Track of SANER 2026 and the first International Workshop on Autonomous Agents in Software Engineering (AgenticSE) colocated with ASE 2025.
- 16 May 2025 Our paper SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuning is accepted by the Main Track of ACL 2025. Congratulations to Zexiong!
-
21 Dec 2024 Invited to join the steering committee of AIware. The next conference will be colocated with ASE 2025. Please consider submitting to us!
-
16 Dec 2024 Our paper DialogAgent: An Auto-engagement Agent for Code Question Answering Data Production is accepted by the SEIP track of ICSE 2025.
-
29 Nov 2024 Our ppaer Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study is accepted by COLING 2025.
-
12 Nov 2024 AI IDE Workshop is accepted by FSE 2025. Please consider submit paper to us! See you in Norway!
-
4 Aug 2024 Our paper RepoSim: Evaluating Prompt Strategies for Code Completion via User Behavior Simulation is accepted by the NIER track of ASE 2024.
-
14 Jun 2024 I am invited to join the organisation committee of the 6th International Workshop on Automated Program Repair (APR 2025), co-located with ICSE 2025. Please consider submitting your paper to the workshop!
-
18 Apr 2024 Our paper Neat: Mobile App Layout Similarity Comparison based on Graph Convolutional Networks is accepted by the Industry Track of FSE 2024.
-
16 Apr 2024 Invited to join the program committee of FSE 2025. Please consider submitting to us!
-
21 Dec 2023 Our paper Hawkeye: Change-targeted Testing for Android Apps based on Deep Reinforcement Learning is accepted by the SEIP track of ICSE 2024.
-
8 Aug 2023 Our paper Effective Concurrency Testing for Go via Directional Primitive-constrained Interleaving Exploration is accepted by ASE 2023.
-
31 Jul 2023 Our paper AG3: Automated Game GUI Text Glitch Detection based on Computer Vision is accepted by the Industry Track of FSE 2023.
-
19 May 2022 Invited to give a talk on mobile app testing at University of Edinburgh.
-
28 Apr 2023 Our paper NxtUnit: Automated Unit Test Generation for Go is accepted by the Industry Track of EASE 2023.
-
19 Dec 2022 Our paper Characterizing and Finding SystemSetting-Related Defects in Android Apps is accepted by TSE.
-
29 Sep 2022 Invited to give a talk on mobile app testing at ECNU.
-
8 Aug 2022 Our paper Fastbot2: Reusable Automated Model-based GUI Testing for Android Enhanced by Reinforcement Learning is accepted by the Industry Track of ASE 2022.
-
22 Jun 2022 Our papers MUBot: Learning to Test Large-Scale Commercial Android Apps like a Human and Automated Server Testing: an Industrial Experience Report are accepted by the Industry Track of ICSME 2022.
-
05 Jul 2021 Joined ByteDance as a Tech Expert / Senior Researcher within the Quality Lab
-
30 Jun 2021 Our paper Testing Smart Contracts: Which Technique Performs Best? is accepted by ESEM 2021.
-
15 Jun 2021 Our paper CAT: Change-focused Android GUI Testing is accepted by ICSME 2021.
-
28 Dec 2020 Started project with ByteDance on Android testing.
-
23 Nov 2020 Started part-time programming language research intern at Huawei Edinburgh Research Centre mentored by Dan Ghica, the PL group lead.
-
20 Jan 2020 Our paper Automated Test Generation for OpenCL Kernels Using Fuzzing and Constraint Solving is accepted by PPoPP’s GPGPU Workshop 2020.
-
28 Oct 2019 Joined Huawei London Research Centre as a Mobile GPU Intern mentored by Graham Connor, the Chief GPU Scientist.
-
30 Sep 2019 Our papers SIF: A Framework for Solidity Contract Instrumentation and Analysis and SolAnalyser: A Framework for Analysing and Testing Smart Contracts are accepted by APSEC 2019.
-
31 Jul 2019 We are excited to release SIF - a code analysis and instrumentation framework for Solidity smart contracts.
-
30 May 2019 My PhD research proposal On the Correctness of GPU programs is accepted by ISSTA 2019 Doctoral Symposium.
-
24 Jan 2019 Our paper CLTestCheck: Measuring Test Effectiveness for GPU Kernels is accepted by FASE 2019.
-
01 Sep 2017 Started my PhD at University of Edinburgh with Dr. Ajitha Rajan fully funded by School of Informatics Scholarship.
-
17 Nov 2016 Our Team EPCC selected to participate in the final round of the ISC Student Cluster Competition.
Featured Publications
- LLM4Code
- [Techinical Report] Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling
- [ICSE'26] Tool-integrated Reinforcement Learning for Repo Deep Search
- [ACL'25] SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuning
- [COLING'25] Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study
- [NeurIPS'25] Repo2Run: Automated Building ExecutableEnvironment for Code Repository at Scale
- [ICSE'26] An Empirical Study on LLM-based Agents for Automated Bug Fixing
- [ASE'25 Industry Track] RepoMasterEval: Evaluating Code Completion via Real-World Repositories
- GUI Testing
- [FSE'24 Industry] Neat: Mobile App Layout Similarity Comparison based on Graph Convolutional Networks
- [TSE] Characterizing and Finding SystemSetting-Related Defects in Android Apps
- [ASE'22 Industry] Fastbot2: Reusable Automated Model-based GUI Testing for Android Enhanced by Reinforcement Learning
- [ICSE'24 SEIP] Hawkeye: Change-targeted Testing for Android Apps based on Deep Reinforcement Learning
- Software Testing
- [ASE'23] Effective Concurrency Testing for Go via Directional Primitive-constrained Interleaving Exploration
- [ESEM'21] Testing Smart Contracts: Which Technique Performs Best?
- [APSEC'19] SolAnalyser: A Framework for Analysing and Testing Smart Contracts
- [FASE'19] CLTestCheck: Measuring Test Effectiveness for GPU Kernels
Service
| Organising/Steering Committee | AIware@ASE 2025, AI IDE@FSE 2025, APR@ICSE 2025 |
| Program Co-chair | AIware 2026 |
| Industry Co-chair | FORGE 2026 Industry Track |
| PC Member (Research/Technical Track) | LLM4Code 2026, FSE 2026, AgenticSE 2025, ASE 2025, FSE 2025, MSR 2023(Junior PC), A-Mobile 2022, PRDC 2022 |
| PC Member (Industry Track) | SANER 2026, ASE 2025, MSR 2025, SANER 2025, ISSRE 2024, APSEC 2024, MSR 2024 |
| PC Member (Artifact Evaluation) | OSDI 2022, USENIX ATC 2022, ISSTA 2022, 2021, 2020 |
| Reviewer | TOSEM, TSE, STVR, IEEE Software |
| Sub-reviewer | ICSE 2019 Software Engineering in Practice Track |
| Student Volunteer | PLDI 2020, ISSTA 2019, ETAPS 2019 |
Teaching
[Part-time Postgraduate Student Mentor] School of Computer Science, Fudan University. Mar 2022 - Present
[Sub-supervisor] MSc Projects. School of Informatics, the University of Edinburgh. Apr 2018 - Aug 2018, Apr 2019 - Aug 2019
[Teaching Assistant, Tutor and Marker] Software Testing. School of Informatics, the University of Edinburgh. Jan 2018 - Apr 2018, Jan 2019 - Apr 2019, Jan 2021 - Apr 2021
[Marker] Computer Programming Skills and Concepts. School of Informatics, the University of Edinburgh. Nov 2017 - Dec 2017, Dec 2018 - Jan 2019
[Demonstrator] Introduction to Java Programming. School of Informatics, the University of Edinburgh. Sep 2017 - Dec2017, Sep 2018 - Dec 2018
Awards
Scholarship
- School of Informatics Scholarship (fully-funded PhD scholarship)
- Outstanding Graduate Scholarship at Xuzhou University of Technology
- China National Scholarship of 2014⁄15 Academic Year
- China National Encouragement Scholarship of 2013⁄14 Academic Year
- China National Scholarship of 2012⁄13 Academic Year
Honours
- Spot Bonus at ByteDance
- Nominee for Teaching Awards: Best Student Who Tutors Award
- Certificate of Achievement for Participating in the 6th Annual HPCAC Student Cluster Competition
- Top Ten Role Models of Study in Xuzhou University of Technology
- Excellent Graduate of Xuzhou University of Technology
- Jiangsu Province-Level Excellent Student Cadre
Work Experience
- Project: Testing and benchmarking for compilers
- Mentor: Dan Ghica (PL Group Lead)
- Micro benchmarking for mobile GPUs
- Mentor: Graham Connor (Chief GPU Scientist)