Prompt, Context, Graph, Harness: The Way We Talk to LLMs Keeps Changing
Every year or so, the people building artificial intelligence decide they have been doing it wrong and give the right way a new name.
The latest name is “harness engineering,” and it has an unusual endorsement behind it. In a recent interview with Stratechery’s Ben Thompson, OpenAI CEO Sam Altman put this shift into words: “I no longer think of the harness and the model as these entirely separable things.”
That word, harness, captures a broader change in how AI systems are being built. The model is no longer treated as the entire system. It operates inside an environment of tools, context, memory, state, permissions, feedback loops, and other software that determines what it can do and how reliably it can do it.
This is the idea behind harness engineering.
But harness engineering did not appear out of nowhere. To understand why harness has become the word of the moment, it helps to trace that evolution: prompt, context, workflow, graph, and now the harness.
2023: The Prompt Engineering (Early LLM Era)
In the early days of ChatGPT, the focus was entirely on how you spoke to the LLM. Engineers became “prompt whisperers,” crafting elaborate text instructions such as “You are an expert programmer,” or “Let’s think step by step” — to get the best possible output from the model.
The AI system was essentially a standalone brain in a jar, and the only way to steer it was through carefully chosen words.
2025: The Context Engineering Era
It quickly became clear that even the smartest, fastest model couldn’t answer questions about private data or recent events it hadn’t memorized.
Then in the summer of 2025, Shopify CEO Tobi Lütke and former OpenAI researcher Andrej Karpathy noted that the real skill wasn’t writing a clever prompt, but curating everything the model saw. Which meant building retrieval systems to fetch relevant documents and inject them into the model’s context window.
Karpathy called it “the delicate art and science of filling the context window.” Modern AI systems don’t just see one message; they see whatever an engineer loads into memory — instructions, prior history, retrieved data.
The focus shifted from how you ask to what information you provide, ensuring the model had the right facts before it spoke. But getting that loadout wrong broke the system just as surely as a bad prompt did.
2025–2026: The Graph Engineering Era
As AI systems grew more complex, a single prompt and a well-stocked context window were no longer enough. Tasks began to involve multiple agents, tools, decision points, and execution paths, so developers started designing the workflow itself.
Using frameworks such as LangChain and LangGraph, developers began representing these systems as graphs: nodes for tasks, edges for possible transitions, and explicit rules for state, routing, retries, and human intervention. One agent might generate an answer, another critique it, and a third revise it. Unlike prompt or context engineering, the focus was no longer just on what the model sees, but on how the entire task moves from one step to the next.
Get Ejiro Onose’s stories in your inbox
Join Medium for free to get updates from this writer.
Note: The terminology is still evolving. “Graph engineering” is an emerging label rather than a settled discipline, but the underlying idea is clear: as agents become multi-step systems, developers increasingly have to engineer the workflow around the model rather than leave the model to determine the entire process itself.
2026: The Harness Engineering Era
Today, the industry realizes that a raw language model is still just a stateless text predictor — it has no hands, no durable memory, and no definite way to recover from its own mistakes. Harness engineering is the practice of building a pre-wired, autonomous “exoskeleton” that wraps around the model, letting it act, fail, and self-correct in the real world.
Harness engineering folds these previous ideas into a single, blunter framing. Popularized by engineer Viv Trivedy, the concept is defined by a simple equation:
Agent = Model + Harness*.
The model handles the reasoning. Everything else — the tools it can call, the state it maintains, the guardrails it operates inside, and the evaluation loops that catch its errors — is the harness.
What this means for the Unit of AI Engineering
None of these disciplines replaced the one before it so much as absorbed it. Harness engineers still write prompts, manage context, and design workflow graphs.
What changed each time was the unit of engineering — from a sentence, to a window, to a network, to the whole apparatus a model lives inside.
It is a fair bet that “harness engineering” will not be the last name as we continue building around LLMs either. It rarely is, in an industry that renames its own foundations about once a year.
As Altman’s admission reveals, the industry spent years racing to build a bigger brain, only to discover that raw intelligence cannot operate in the real world without a reliable exoskeleton.
When everyone has access to the exact same reasoning engine, the harness becomes the real product. Whatever label comes next, this one is the closest thing the field has to an admission that the model was never doing this alone.
References
- Altman, S. & Thompson, B. (2026).Autonomy and Innovation: An Interview with Sam Altman . Stratechery.
- Karpathy, A. (2025).Notes on Context Engineering: The Delicate Art and Science of Filling the Context Window .
- Trivedy, V. (2026).The Anatomy of an Agent Harness: Agent = Model + Harness .
- Zhang, Y. et al. (2026).Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence . arXiv preprint arXiv:2608.15000.