Benchmark·October 2026

ESCAPES

327 bugs that passed code review and tests, reached real users, and were fixed. We rewound 33 open-source products to the code before each fix and asked one question: how many could have been caught before a user hit them?

Escapes caught before the user reported them

One scan per product, on its code as of 1 July 2026. 235 of the 327 bugs were already in that code and were reported by users in the weeks after. The share of those 235 each system had already found.

brekenruns the product

76 bugs · 32%

Claude Fable 5.1Claude Code

37 bugs · 16%

Claude Opus 5.5Claude Code

33 bugs · 14%