RWE-bench: Real World Engineering Bench

Xplore launches RWE-bench, a benchmark of 20 expert-designed mechanical, electrical and aerospace engineering tasks (crankshaft CAD, DDR3 PCB routing, turbine-vane CFD) graded by deterministic physics-based verifiers with no LLM judge. Across 11 frontier models, GPT-6 Astra leads at a 37% average pass rate, Claude Opus 5.5 scores 29% and GPT-6.1 Sol 25% at about $10 a run; five models score 0%.

Research · AI Benchmarks · Engineering · AI Agents

Zero to Calc in Six Days: Inside XBOW’s Chrome Full Chain

XBOW walks through the Chrome full-chain exploit its AI agents built in six days, chaining a V8 compiler bug, an animated-WebP decoder bug and a Crashpad memory-safety bug to escape the renderer sandbox, which earned Google's first $250,000 full-chain reward under its April 2026 VRP rules, plus lessons for LLM-era vulnerability research.

Research · Security · AI Agents · Research · Engineering

One CPU Atomic Instruction, One Packaging Infinite Loop: The Story of the Lost Update on LA664

Jie Ge documents a Loongson LA664 erratum where an atomic instruction can lose updates, how it surfaced as an infinite packaging loop, the root cause analysis, and what it means for correctness on that CPU.

Research · Hardware · Systems Programming · Debugging · Engineering

The Function That Beat the Model: What We Measured When We Removed the LLMs

SPERIXLABS replaced a 1B-parameter local model that validated sensitive-data detections with a 40-line Python function, then published the four experiments showing where classical checks beat the LLM on accuracy and latency.

Research · LLMs · Security · Benchmarks · Engineering