Mar 6, 2025

GSM8K-Platinum: Revealing Performance Gaps in Frontier LLMs

 We present GSM8K-Platinum, a revised version of the GSM8K benchmark that reveals meaningful differences in frontier model capabilities

Feb 6, 2025

Do Large Language Model Benchmarks Test Reliability?

 We introduce the concept of so-called platinum benchmarks to better quantify model reliability

Jun 25, 2024

D3M: Improving Group Robustness via Dataset Selection

May 6, 2024

Using ContextCite for LLM reliability

 We use our method ContextCite to detect unverified statements and discover poisoned documents.

May 6, 2024

ContextCite: Attributing Model Generation to Context

 We present ContextCite, a method for attributing statements generated by language models back to specific information provided in-context.

Apr 18, 2024

Editing Predictions by Modeling Model Computation

 We use our component modeling framework to design targeted model edits.

Apr 18, 2024

Decomposing Predictions by Modeling Model Computation

 We introduce a framework called component modeling for studying how model components collectively shape ML predictions.

Mar 4, 2024

How Can We Harness Pre-Training to Develop Robust Models?

 We explore a simple principle for harnessing pre-training to develop robust models.