# Experiments

> Pre-registered reanalyses and replications. Each experiment ships its data, its plan, and a runnable reproducer.

Source: https://iambenschmidt.com/oakmontlab/experiments/



## In this section
- [What is a reported 0.88 grading correlation worth? A reanalysis of the BeSTraP short-answer dataset](https://iambenschmidt.com/oakmontlab/experiments/2026-07-grading-robustness/index.md): A pre-registered reanalysis of the publicly released BeSTraP dataset, which reports a fine-tuned GPT-2 grader at Pearson 0.88 with human short-answer grades. Using only the released data, we ask what that number is worth: it holds up on every mechanism the data lets us check, sits below human consistency, and cannot be recomputed from the release.

---
This is the plain-markdown twin of https://iambenschmidt.com/oakmontlab/experiments/. The whole site offers one: append index.md to any page URL. Index for agents: https://iambenschmidt.com/llms.txt