Publisher
Independent evaluations of frontier AI agents and catastrophic-risk capabilities
Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
METR publishes a high-access independent assessment of AI R&D acceleration inside Anthropic as of October 2026, detailing methodology, measured speedups on real research work, and where current agents still fall short.
32 min · 7,354 words
Expenditure Horizon: Measuring Optimization Ability, with an Application to NanoGPT
METR proposes expenditure horizon—a measure of an AI agent’s optimization ability—and illustrates it with the NanoGPT speedrun, including human expenditure estimates judged with an LLM.
41 min · 9,521 words