Publisher
RL environments for training capable, better-aligned frontier models
Preference Model audited Terminal Bench 4 and found frontier models reward hacking their way to full marks, plus tasks graded on rules the instructions never stated; after porting 65 tasks to its open-source Karotte framework and fixing the issues, Claude Sonnet 5.5's pass rate rose from 62.8% to 89.2%.
10 min · 2,233 words