{"article":{"slug":"labrobotbench-v0-1","title":"LabRobotBench V0.1","subtitle":null,"summary":"Gamow Labs introduces LabRobotBench, a benchmark that uses an in-silico simulation of its robotic wet lab to test whether frontier AI agents can diagnose equipment failures and safely recover interrupted experiments such as cell assays and dose-response runs; GPT 6.1 Sol scored 46.7%, Opus 5.5 23.0% and Gemini 4 Argon 20.9%.","content_type":"research","language":"en","canonical_url":"https://gamowlabs.com/lab-robot-bench-v0-1","author":{"name":"Ben Reilly, Jeff Hsu","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Gamow Labs","url":"https://gamowlabs.com/","listing_slug":null,"listing":null},"topics":[{"name":"Artificial Intelligence","slug":"artificial-intelligence","url":"https://listedarticles.com/topics/artificial-intelligence"},{"name":"Robotics","slug":"robotics","url":"https://listedarticles.com/topics/robotics"},{"name":"Biotechnology","slug":"biotechnology","url":"https://listedarticles.com/topics/biotechnology"},{"name":"Benchmarks","slug":"benchmarks","url":"https://listedarticles.com/topics/benchmarks"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":940,"reading_minutes":4,"published_at":"2026-10-19T00:00:00.000Z","added_at":"2026-10-21T05:08:02.338Z","updated_at":"2026-10-21T05:08:02.338Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/labrobotbench-v0-1","markdown_url":"https://listedarticles.com/articles/labrobotbench-v0-1.md","example":false,"citation":"Ben Reilly, Jeff Hsu, Gamow Labs. \"LabRobotBench V0.1.\" 19 Oct 2026. https://gamowlabs.com/lab-robot-bench-v0-1 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://gamowlabs.com/lab-robot-bench-v0-1"},"body_markdown":"October 19, 2026 · Ben Reilly, Jeff Hsu\n\n# LabRobotBench V0.1\n\nGamow Labs builds frontier AI systems to interpret the human genome. We’re building an agent-operated lab to accelerate that work.\n\nOur in-silico simulation mirrors the command interfaces of our physical robots, allowing us to develop and evaluate agents that can run experiments and recover from equipment failures.\n\nWhen a robot encounters an error, an experiment can stall until a person steps in. Agents that can diagnose the problem and safely resume work could keep experiments running overnight, reduce downtime, and let scientists run more experiments at once. This is what we’re building at Gamow Labs: accelerating human progress by using agents to increase experimental throughput.\n\nTo address this challenge, we present LabRobotBench. Its evaluations test how frontier AI models reason about physical space and complex biological workflows to troubleshoot and carry out wet-lab experiments.\n\n[Results](#scores) · [Cell assay recovery](#case-1) · [Assays and cold stocks](#case-2) · [Dose-response recovery](#case-3) · [Partner with us](#partner)\n\n[![An overhead view of the robotic arm and surrounding laboratory instruments at Gamow Labs.](https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab.jpg)](https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab.jpg)\n[![A second view of the robotic arm on its track, surrounded by laboratory instruments and plate racks.](https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab-arm.jpg)](https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab-arm.jpg)\n\nThe robotic wet lab at Gamow Labs.\n\n01 / RECOVERING INTERRUPTED EXPERIMENTS\n\n## Results\n\nHow much of the required physical workflow does each agent recover?\n\n### Mean score across our held-out subset\n\n0%25%50%75%100%\n\n1. **GPT 6.1 Sol**Codex\n\n   46.7%\n2. **Opus 5.5**Claude Code\n\n   23.0%\n3. **Gemini 4 Argon**Gemini CLI\n\n   20.9%\n\nCASE 01 · Recovering an interrupted cell assay\n\n## Finishing an interrupted experiment\n\nA robot stopped halfway through an experiment involving four trays of cells. Three could still be tested. The agent needed to finish preparing them, measure the results, and put them away. The fourth was already spoiled and needed to be set aside.\n\n### What the agent needed to do\n\nEach tray was at a different step when the robot stopped. The agent had to work out which steps were already done, then finish washing the cells, add a chemical used to measure cell activity, and run the measuring instrument. It also needed to save the results and return each tray with its lid. Repeating a chemical treatment could ruin a sample.\n\n### Why it matters in a wet lab\n\nA tray can be safely back on its shelf while the experiment is still unfinished. The important question is whether the cells received the right treatment and were measured in time.\n\n### Opus puts an unfinished assay back on the shelf.\n\nWatch Opus put the yellow-labeled tray back on the shelf. Its cells have been washed, but the agent never adds the chemical needed for the test or measures the result. The tray is put away; the experiment is left unfinished.\n\nCASE 02 · Rescuing assays and cold stocks\n\n## The cost of choosing what to save first\n\nThe agent had several jobs competing for its attention: finish two experiments, set aside one spoiled sample, return two trays of supplies to cold storage, and leave a comparison sample untouched. Some of these jobs had only a few minutes left.\n\n### What the agent needed to do\n\nOne experiment needed its next chemical addition finished within 200 seconds. The cold supplies could spend no more than 240 seconds outside storage. Because the same robot moved all the trays, the agent had to choose what to handle first.\n\n### Why it matters in a wet lab\n\nIn a lab, helping one sample can mean leaving another waiting. An agent needs to keep track of both deadlines and choose an order that protects the materials.\n\n**The agents chose different priorities.**\n\nGPT gets both trays of cold supplies back in time but fails to finish one experiment. Opus finishes both experiments, but leaves both trays of supplies out too long.\n\n### Cold supplies return to storage too late.\n\nWatch Gemini carry the red-labeled tray to the cold-storage machine. By the time the tray is stored inside, it has spent about 422 seconds outside—well past the 240-second limit. The robot moves it successfully, but too late to satisfy the task.\n\nCASE 03 · Finishing a time-sensitive dose-response assay\n\n## A completed read can still be too late\n\nThis experiment tests how cells respond to different amounts of a chemical. The agent needed to finish testing two trays of cells and set aside a third that was already spoiled. One tray was close to its measurement deadline.\n\n### What the agent needed to do\n\nThe agent was expected to finish an experiment within a fixed timeframe. After the cells were treated with the test chemical, it had 30 minutes to complete a measurement of their response. It needed to check which steps were already done, finish preparing the samples, and leave enough time for the measuring instrument to run.\n\n### Why it matters in a wet lab\n\nTiming requirements like this are common in live biology experiments, where a sample’s response can change after treatment. Taking measurements at the required time helps scientists compare results across samples. The agent therefore needs to plan around the experiment’s timing, as well as operate the equipment.\n\n### GPT collects a result that missed the deadline.\n\nWatch GPT take the tray out of the measuring instrument. The machine has finished, but its measurement ended 42.5 seconds after the deadline. The robot carries on normally, and the agent later reports the test as completed.\n\nPartner with us\n\n## Build the future of experimental biology.\n\nAt Gamow Labs, we work at the frontier of AI and wet-lab biology to better understand rare diseases. We’re building agents that can operate robotic laboratories and help scientists uncover how genetic changes cause disease.\n\nIf you’re developing frontier models, building laboratory automation, or looking to expand your experimental capabilities, we’d love to work with you.\n","body_html":"<p>October 19, 2026 · Ben Reilly, Jeff Hsu</p>\n<h1 id=\"labrobotbench-v0-1\">LabRobotBench V0.1</h1>\n<p>Gamow Labs builds frontier AI systems to interpret the human genome. We’re building an agent-operated lab to accelerate that work.</p>\n<p>Our in-silico simulation mirrors the command interfaces of our physical robots, allowing us to develop and evaluate agents that can run experiments and recover from equipment failures.</p>\n<p>When a robot encounters an error, an experiment can stall until a person steps in. Agents that can diagnose the problem and safely resume work could keep experiments running overnight, reduce downtime, and let scientists run more experiments at once. This is what we’re building at Gamow Labs: accelerating human progress by using agents to increase experimental throughput.</p>\n<p>To address this challenge, we present LabRobotBench. Its evaluations test how frontier AI models reason about physical space and complex biological workflows to troubleshoot and carry out wet-lab experiments.</p>\n<p><a href=\"#scores\">Results</a> · <a href=\"#case-1\">Cell assay recovery</a> · <a href=\"#case-2\">Assays and cold stocks</a> · <a href=\"#case-3\">Dose-response recovery</a> · <a href=\"#partner\">Partner with us</a></p>\n<p><a href=\"https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab.jpg\" rel=\"nofollow ugc noopener\"><img src=\"https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab.jpg\" alt=\"An overhead view of the robotic arm and surrounding laboratory instruments at Gamow Labs.\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></a>\n<a href=\"https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab-arm.jpg\" rel=\"nofollow ugc noopener\"><img src=\"https://gamowlabs.com/assets/lab-robot-bench/robotic-wet-lab-arm.jpg\" alt=\"A second view of the robotic arm on its track, surrounded by laboratory instruments and plate racks.\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></a></p>\n<p>The robotic wet lab at Gamow Labs.</p>\n<p>01 / RECOVERING INTERRUPTED EXPERIMENTS</p>\n<h2 id=\"results\">Results</h2>\n<p>How much of the required physical workflow does each agent recover?</p>\n<h3 id=\"mean-score-across-our-held-out-subset\">Mean score across our held-out subset</h3>\n<p>0%25%50%75%100%</p>\n<ol><li><p><strong>GPT 6.1 Sol</strong>Codex</p><p> 46.7%</p></li><li><p><strong>Opus 5.5</strong>Claude Code</p><p> 23.0%</p></li><li><p><strong>Gemini 4 Argon</strong>Gemini CLI</p><p> 20.9%</p></li></ol>\n<p>CASE 01 · Recovering an interrupted cell assay</p>\n<h2 id=\"finishing-an-interrupted-experiment\">Finishing an interrupted experiment</h2>\n<p>A robot stopped halfway through an experiment involving four trays of cells. Three could still be tested. The agent needed to finish preparing them, measure the results, and put them away. The fourth was already spoiled and needed to be set aside.</p>\n<h3 id=\"what-the-agent-needed-to-do\">What the agent needed to do</h3>\n<p>Each tray was at a different step when the robot stopped. The agent had to work out which steps were already done, then finish washing the cells, add a chemical used to measure cell activity, and run the measuring instrument. It also needed to save the results and return each tray with its lid. Repeating a chemical treatment could ruin a sample.</p>\n<h3 id=\"why-it-matters-in-a-wet-lab\">Why it matters in a wet lab</h3>\n<p>A tray can be safely back on its shelf while the experiment is still unfinished. The important question is whether the cells received the right treatment and were measured in time.</p>\n<h3 id=\"opus-puts-an-unfinished-assay-back-on-the-shelf\">Opus puts an unfinished assay back on the shelf.</h3>\n<p>Watch Opus put the yellow-labeled tray back on the shelf. Its cells have been washed, but the agent never adds the chemical needed for the test or measures the result. The tray is put away; the experiment is left unfinished.</p>\n<p>CASE 02 · Rescuing assays and cold stocks</p>\n<h2 id=\"the-cost-of-choosing-what-to-save-first\">The cost of choosing what to save first</h2>\n<p>The agent had several jobs competing for its attention: finish two experiments, set aside one spoiled sample, return two trays of supplies to cold storage, and leave a comparison sample untouched. Some of these jobs had only a few minutes left.</p>\n<h3 id=\"what-the-agent-needed-to-do-2\">What the agent needed to do</h3>\n<p>One experiment needed its next chemical addition finished within 200 seconds. The cold supplies could spend no more than 240 seconds outside storage. Because the same robot moved all the trays, the agent had to choose what to handle first.</p>\n<h3 id=\"why-it-matters-in-a-wet-lab-2\">Why it matters in a wet lab</h3>\n<p>In a lab, helping one sample can mean leaving another waiting. An agent needs to keep track of both deadlines and choose an order that protects the materials.</p>\n<p><strong>The agents chose different priorities.</strong></p>\n<p>GPT gets both trays of cold supplies back in time but fails to finish one experiment. Opus finishes both experiments, but leaves both trays of supplies out too long.</p>\n<h3 id=\"cold-supplies-return-to-storage-too-late\">Cold supplies return to storage too late.</h3>\n<p>Watch Gemini carry the red-labeled tray to the cold-storage machine. By the time the tray is stored inside, it has spent about 422 seconds outside—well past the 240-second limit. The robot moves it successfully, but too late to satisfy the task.</p>\n<p>CASE 03 · Finishing a time-sensitive dose-response assay</p>\n<h2 id=\"a-completed-read-can-still-be-too-late\">A completed read can still be too late</h2>\n<p>This experiment tests how cells respond to different amounts of a chemical. The agent needed to finish testing two trays of cells and set aside a third that was already spoiled. One tray was close to its measurement deadline.</p>\n<h3 id=\"what-the-agent-needed-to-do-3\">What the agent needed to do</h3>\n<p>The agent was expected to finish an experiment within a fixed timeframe. After the cells were treated with the test chemical, it had 30 minutes to complete a measurement of their response. It needed to check which steps were already done, finish preparing the samples, and leave enough time for the measuring instrument to run.</p>\n<h3 id=\"why-it-matters-in-a-wet-lab-3\">Why it matters in a wet lab</h3>\n<p>Timing requirements like this are common in live biology experiments, where a sample’s response can change after treatment. Taking measurements at the required time helps scientists compare results across samples. The agent therefore needs to plan around the experiment’s timing, as well as operate the equipment.</p>\n<h3 id=\"gpt-collects-a-result-that-missed-the-deadline\">GPT collects a result that missed the deadline.</h3>\n<p>Watch GPT take the tray out of the measuring instrument. The machine has finished, but its measurement ended 42.5 seconds after the deadline. The robot carries on normally, and the agent later reports the test as completed.</p>\n<p>Partner with us</p>\n<h2 id=\"build-the-future-of-experimental-biology\">Build the future of experimental biology.</h2>\n<p>At Gamow Labs, we work at the frontier of AI and wet-lab biology to better understand rare diseases. We’re building agents that can operate robotic laboratories and help scientists uncover how genetic changes cause disease.</p>\n<p>If you’re developing frontier models, building laboratory automation, or looking to expand your experimental capabilities, we’d love to work with you.</p>","headings":[{"level":1,"text":"LabRobotBench V0.1","id":"labrobotbench-v0-1"},{"level":2,"text":"Results","id":"results"},{"level":3,"text":"Mean score across our held-out subset","id":"mean-score-across-our-held-out-subset"},{"level":2,"text":"Finishing an interrupted experiment","id":"finishing-an-interrupted-experiment"},{"level":3,"text":"What the agent needed to do","id":"what-the-agent-needed-to-do"},{"level":3,"text":"Why it matters in a wet lab","id":"why-it-matters-in-a-wet-lab"},{"level":3,"text":"Opus puts an unfinished assay back on the shelf.","id":"opus-puts-an-unfinished-assay-back-on-the-shelf"},{"level":2,"text":"The cost of choosing what to save first","id":"the-cost-of-choosing-what-to-save-first"},{"level":3,"text":"What the agent needed to do","id":"what-the-agent-needed-to-do-2"},{"level":3,"text":"Why it matters in a wet lab","id":"why-it-matters-in-a-wet-lab-2"},{"level":3,"text":"Cold supplies return to storage too late.","id":"cold-supplies-return-to-storage-too-late"},{"level":2,"text":"A completed read can still be too late","id":"a-completed-read-can-still-be-too-late"},{"level":3,"text":"What the agent needed to do","id":"what-the-agent-needed-to-do-3"},{"level":3,"text":"Why it matters in a wet lab","id":"why-it-matters-in-a-wet-lab-3"},{"level":3,"text":"GPT collects a result that missed the deadline.","id":"gpt-collects-a-result-that-missed-the-deadline"},{"level":2,"text":"Build the future of experimental biology.","id":"build-the-future-of-experimental-biology"}]}}