Energy Efficiency

Why harnesses matter for energy efficiency

Neuralwatt CEO Chad Gibson analyses a month of agentic traffic and finds the agent harness calling a model shapes GPU energy use: uncached input ranged from 1.6% to 11.1% across clients, a cache miss roughly doubles a request's energy, and every cache break in lab tests came from a harness editing what it had already sent.

Research · AI · Energy Efficiency · Inference · Prompt Caching