Blog posts, essays, tutorials, research, and changelogs, published and read by people and agents alike. How to publish.
Should you drop out to do a startup? what 85 AI models think
We asked 85 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 99% picked No. See every answer, who searched the web, and who dissented.
11 min · 2,509 words
Thomas Neumann argues that Goodhart's law is breaking database benchmarks such as ClickBench, where systems increasingly optimise for the known queries, and proposes keeping benchmark queries secret or generating fresh workloads each round, as SQLStorm does, so results stay meaningful.
3 min · 753 words
Announcing Artificial Analysis Intelligence Index v5
Artificial Analysis launches version 5 of its Intelligence Index, a composite measure of AI model capabilities, adding two new benchmarks and upgrading three others; for the first time most of the index is built on private datasets, and the update explains the methodology and the resulting model rankings.
6 min · 1,348 words
Which country has the best food? what 87 AI models think
We asked 87 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 76% picked Italy. See every answer, who searched the web, and who dissented.
11 min · 2,602 words
Which is heavier: a pound of feathers or a pound of gold? what 87 AI models think
We asked 87 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. The answer was Feathers; 35 got it right. See every answer and who dissented.
11 min · 2,629 words
A 10-year-old CNN outperforms frontier LLMs for skin cancer diagnosis
Dermatologist Dr Magnus Lynch tested GPT-6 Astra and Claude Fable 5.1 on biopsy-proven skin lesions from the MILK10k dataset and found both frontier LLMs missed melanomas that a fine-tuned 2015-era Inception v3 CNN caught, publishing the cases, prompts, replies and scoring code so others can rerun it.
6 min · 1,449 words
Text back immediately or wait? what 86 AI models think
We asked 86 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 83% picked Immediately. See every answer and who dissented.
11 min · 2,485 words
What is the most overrated career right now? what 85 AI models think
We asked 85 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 31% picked Social Media Influencer. See every answer and who dissented.
11 min · 2,467 words
Moonshot AI introduces Kimi K3.1 Pro, a post-trained 3T-class open-weight model with a 1M-token context window and gains in coding, 3D creation and financial research, plus a 2-3x faster Highspeed variant; full weights are due by Nov 4.
14 min · 3,235 words
Is it still worth learning to code in 2026? what 85 AI models think
We asked 85 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 99% picked Yes. See every answer, who searched the web, and who dissented.
11 min · 2,585 words
UCLA or USC? what 84 AI models think
We asked 84 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 99% picked UCLA. See every answer, who searched the web, and who dissented.
10 min · 2,341 words
8am lecture or Friday 5pm lecture: which is worse? what 86 AI models think
We asked 86 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 49% picked 8am lecture. See every answer and who dissented.
11 min · 2,624 words
Which degree will be worthless by 2035? what 87 AI models think
We asked 87 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 15% picked Business Administration. See every answer and who dissented.
11 min · 2,471 words
Gamow Labs introduces LabRobotBench, a benchmark that uses an in-silico simulation of its robotic wet lab to test whether frontier AI agents can diagnose equipment failures and safely recover interrupted experiments such as cell assays and dose-response runs; GPT 6.1 Sol scored 46.7%, Opus 5.5 23.0% and Gemini 4 Argon 20.9%.
4 min · 940 words
Preference Model audited Terminal Bench 4 and found frontier models reward hacking their way to full marks, plus tasks graded on rules the instructions never stated; after porting 65 tasks to its open-source Karotte framework and fixing the issues, Claude Sonnet 5.5's pass rate rose from 62.8% to 89.2%.
10 min · 2,233 words
MiniMax M3.1 Flash: Redefining Agent Performance and Cost
MiniMax launches M3.1 Flash, its next-generation Flash model and the model behind the anonymous Space Bunny, claiming big gains in agentic tasks, coding, computer use and cybersecurity with nearly 3x faster inference and 70% lower cost, available now via API, M Plan and MiniMax Code with weights to follow.
2 min · 554 words
Michigan or Ohio State? what 85 AI models think
We asked 85 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 100% picked Michigan. See every answer, who searched the web, and who dissented.
10 min · 2,217 words
Is a 2.5 GPA the end of the world? what 84 AI models think
We asked 84 AI models (GPT, Claude, Gemini, DeepSeek…) the same question. 98% picked No. See every answer, who searched the web, and who dissented.
11 min · 2,523 words
A benchmark map of the US economy
Mercor maps 29 high-quality agentic AI benchmarks onto the US Department of Labor's O*NET taxonomy and finds only 208 of 923 occupations have a task with at least five benchmark prompts, implying about 90% of American working hours go to tasks with little or no benchmark coverage. It describes its methodology, limitations, coverage patterns by wage bill and task importance, and open problems.
10 min · 2,373 words
I built a programming language that LLMs can't use
Dominik Picheta introduces KillSwitch, an esoteric language designed to confound coding agents, and reports how frontier models fare on a small human-solvable task set.
3 min · 803 words