Doom Debates! · AI Research & Frontier Labs · October 2026
Wright was explaining why even well-informed people have trouble picturing superintelligence. His answer is that it may not be one very smart model but many pretty smart ones working together, the way a company knows things none of its employees do. He goes on to apply the same idea to swarms of AI agents.
been compared in the past when I was even nerdier than I am now. I've been compared in the past to Sheldon from, you know, the Big Bang Theory.
Okay, that's a that's a that
…there's another thing going on here, uh, in terms of people having trouble, maybe still, including, I, you know, I'd say smart, well-informed people, imagining pretty well-informed people, imagining what's coming. And it was so well illustrated by the Open AI breakout. It's like, you know, when you ask what is super intelligence, I've said this before, but one way to say it is like, you know, you could say the Boeing Corporation is a superintelligence. No one human could know how to build an airliner, but the Boeing Corporation is an information processing system that collectively knows that. And from a sufficient distance, it just looks like a giant brain. And when you put a lot of pretty smart brains together, like the people who work at Boeing, you get pretty amazing shit that no single brain could do. And it's the same way with agent swarms, you know? And, you know, as I've said, it's Like, well, what's the difference between AGI and superintelligence? Well, maybe just a difference between an LLM and the agent swarm it can sponsor, right? I…
Yeah, so let's help the people with their ontology, right? Because the same way that we would have liked people to realize that the chatbots aren't going to look like chatbots, right? So today they look like agents, but the agents still stay in your computer and the agents still have an off-button…
Yeah, I think right now, you know, it's great that the discourse has moved to a point where people are demanding some kind of governmental action. But it's true that you're hearing things like build an off switch and make super intelligence illegal. I'm not saying those are bad things. It might be…
Yeah, I want to help people understand that it's, you know, the type of thing it is, right? It's not chatbot and it's not exactly even agent. I mean, in a technical sense, it still is because agent just means outcome steering entity. So it is still going to be a lot of fun. It has a goal,