the frequency of changes in tech is invalidating our understanding

Product teams are using LLMs to increase the frequency of change in technology, and near a certain limit, the sample rate (the human decision maker's rate of understanding and evaluating technology) would need to more than double every time the frequency of changes does in order to retain validity, but that's not happening. The result is that these teams think they're measuring signal, but are actually measuring noise and filtering that through an LLM to produce signal-shaped noise.

Software orgs experiencing this effect are giving up any ability to control their development cycles, resulting in frequent and costly outages that arrive without any pre-warning, and neither better prompting nor clever engineering is going to resolve this problem because the high pace of change is incompatible with the pace at which we can form a mental model of a system and comprehend it.