Topic
Everything filed under Benchmarks, newest first.
RSS · JSON · All topics
Is using ChatGPT on homework cheating? what 77 AI models think
We asked 77 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 88% picked Depends who is asking. See every answer and who dissented.
16 min · 3,583 words
Warriors vs Knights, NRL semi-final: 75 AI models predict the result
We asked 75 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 85% picked New Zealand Warriors. See every answer and who dissented.
15 min · 3,388 words
No. 6 Ohio State at No. 9 Notre Dame: 77 AI models predict the result
We asked 77 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 62% picked Ohio State. See every answer, who searched the web, and who dissented.
17 min · 3,947 words
No. 13 Alabama vs No. 15 Ole Miss: 78 AI models predict the result
We asked 78 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 99% picked Alabama. See every answer, who searched the web, and who dissented.
13 min · 2,986 words
No. 4 Florida State at Clemson: 76 AI models predict the result
We asked 76 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 66% picked Clemson. See every answer, who searched the web, and who dissented.
16 min · 3,758 words
Hello, HellGatesPostmortem of a year-unsolved gate-level crackme that GPT-6 cracked in minutes
xutaxkamay recounts designing HellGates—a VHDL custom CPU with obfuscation, anti-tamper, and anti-debug that stumped humans and LLMs for a year—until GPT-6 solved it in under half an hour, then walks through what actually broke.
25 min · 5,662 words
Ben Swerdlow benchmarks Codex, Claude, and Grok agents across 171 StarCraft: Brood War matches—leaderboards, APM, cost per game, and analysis showing none played beyond beginner while Codex Astra led.
9 min · 2,151 words
Benchmarking LLM Inference at Scale with AIPerf
NVIDIA introduces AIPerf, the GenAI-Perf successor: a multiprocess LLM inference benchmarker that avoids client bottlenecks at high concurrency, with flexible load shapes, trace replay, and production-scale measurement guidance.
7 min · 1,661 words
Messi or Ronaldo? what 79 AI models think
We asked 79 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 96% picked Messi. See every answer, who searched the web, and who dissented.
13 min · 2,932 words
Roosters vs Sharks, NRL semi-final: 73 AI models predict the result
We asked 73 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 90% picked Sydney Roosters. See every answer and who dissented.
14 min · 3,151 words
Brighton vs Arsenal: 77 AI models predict the result
We asked 77 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 87% picked Arsenal win. See every answer and who dissented.
14 min · 3,234 words
Hawthorn vs Brisbane, AFL preliminary final: 73 AI models predict the result
We asked 73 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 60% picked Brisbane. See every answer, who searched the web, and who dissented.
15 min · 3,452 words
ShapeLearn-Lite Held Up. ShapeLearn Did Better: Qwen 3.8 27B
ByteShape publishes full ShapeLearn GGUF builds of Qwen 3.8 27B, comparing quality and speed against ShapeLearn-Lite and other quants across RTX 3090–5090-class GPUs.
19 min · 4,316 words
How many r's are in "strawberry"? what 79 AI models think
We asked 79 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. The answer was 3; 71 got it right. See every answer and who dissented.
7 min · 1,663 words
Lions at Bills, Thursday Night Football: 78 AI models predict the result
We put "Lions at Bills, Thursday Night Football" to 78 AI models (GPT, Claude, Gemini, DeepSeek…) at the same time. See every model's answer with its name on it, who searched the web first, and who went against the room.
10 min · 2,339 words
Scaling Discovery through Test-Time Communication
Research paper showing that test-time communication among identical agents sharing discoveries can beat independent parallel search on ARC-AGI-3 and transfer to research tasks like polyomino packing and MNIST compression.
54 min · 12,394 words
Sydney vs Fremantle, AFL preliminary final: 71 AI models predict the result
We put "Sydney vs Fremantle, AFL preliminary final" to 71 AI models (GPT, Claude, Gemini, DeepSeek…) at the same time. See every model's answer with its name on it, who searched the web first, and who went against the room.
9 min · 2,176 words
If you had gone to university, where would you be an alumnus of? what 77 AI models think
We put "If you had gone to university, where would you be an alumnus of?" to 77 AI models (GPT, Claude, Gemini, DeepSeek…) at the same time. See every model's answer with its name on it, who searched the web first, and who went against the room.
4 min · 813 words
India vs Afghanistan, 3rd T20I: 74 AI models predict the result
We put "India vs Afghanistan, 3rd T20I" to 74 AI models (GPT, Claude, Gemini, DeepSeek…) at the same time. See every model's answer with its name on it, who searched the web first, and who went against the room.
4 min · 813 words
Which AI model is the best in the world right now? what 77 AI models think
We put "Which AI model is the best in the world right now?" to 77 AI models (GPT, Claude, Gemini, DeepSeek…) at the same time. See every model's answer with its name on it, who searched the web first, and who went against the room.
3 min · 773 words