Doom Debates! · AI Research & Frontier Labs · October 2026
Wright and Liron Shapira were discussing why public attitudes to AI risk have shifted. Shapira had argued that people used to file AI under "it's just text", and that agents changed the mental category. Wright says this is the image he uses in his book.
…things like, oh, God, should I sacrifice for the group? My gut says no. I mean, their thought traces, you know, the chain of thought text was saying things like that. And I think that freaked people. The whole idea of an agent swarm, like people hadn't thought, like, wait, a thousand AIs? That's
…could already show us that even the chatbots were marching toward this end game. So that's why we're able to see this progression earlier. So, yeah, we don't think in the same ontology, but the average American is now seeing things in a more accurate ontology and they're getting properly scared.
Right. I mean, the way I put it in my book is a chatbot is like somebody you visit in the hospital who can't get out of bed. They can talk to you, they can draw pictures, but they're not going to get up and change the thermostat, much less like stage a coup and take over the hospital. But once you're talking about agents, you're just in a whole different world. And, you know, that is now vivid. And, you know, it's funny we're talking about like as if like the various atmospherics have changed attitudes. And that's true, like the atmospheric of reading what these agents are kind of quote thinking or the atmospherics of somebody resigning from Anthropic. But also what people are seeing is like the underlying reality is being exposed. This stuff is as powerful and unpredictable and hard to control as we saw. I mean, granted, OpenAI had taken the safeguards off for purposes of evaluation and so on. Still, the creativity demonstrated was a profound surprise to OpenAI. And in general, as we said earlier, more and more people are just acknowledging like this alignment thing. Well, we don't have…
I think there's another reason why the average person has, I claim, good intuitions about the scariness of intelligence. You know, when we're in the tech industry, when we're among smart people, you know, we both have smart audiences. We both hang out with smart people. And when you're an…
I had forgotten about the word. What cartoon was Poindexter in? There was an actual cartoon, right? Big glass. I don't know where that's. Do you consider yourself a Poindexter, by the
way? Do I? I mean, in terms of having above-average IQ, sure.