Pray for Chaos

Nov 1, 2026

There’s two basic ways AI can play out, one is order, the other is chaos.

Order is the very dangerous one. If it turns out that models are actually capable of patching all the exploits, it’s hard to imagine what will disrupt the status quo. Fortunately, this seems unlikely, but that doesn’t mean order won’t prevail in the short term. At the end of my Yudkowsky debate we found a tangible point of disagreement. He thinks AI will be able to find a solution to the Prisoner’s dilemma. I know there already is a solution (it’s defect), EA people just aren’t happy about it.