PC Paul Christiano On Dwarkesh Podcast

“The humans are very confused and extremely outgunned in terms of thinking about the situation. You have maybe, say, 10,000 well-coordinated humans thinking about how to handle this response. And then on the other side, you have a billion AI systems who think 10 times faster than them, have been thinking for subjectively years about how this day is going to go down.”

Dwarkesh Podcast · AI Research & Frontier Labs · November 2026

“The humans are very confused and extremely outgunned in terms of thinking about the situation. You have maybe, say, 10,000 well-coordinated humans thinking about how to handle this response. And then on the other side, you have a billion AI systems who think 10 times faster than them, have been thinking for subjectively years about how this day is going to go down.” — Paul Christiano, Dwarkesh Podcast

Context

Dwarkesh Patel said he found arguments about AI super-persuasion unconvincing. Christiano answers that his takeover scenario does not rely on persuasion but on confusion, control of information and sheer numbers.

Transcript

Dwarkesh Podcast
Paul Christiano

…manipulated into undermining that response. So, now you're not only talking about billions of super smart AIs who are trying to carry out this campaign, you're also talking about millions of humans who can be enlisted in various ways by money or leverage or dispute with other humans locally or.

Dwarkesh Patel

I'm open to some version of this argument. I don't think I'm open, or I'm open to all versions of any argument, but I'm not persuaded by the version of this argument that says that the AI will just talk you into arbitrary actions.

Paul Christiano

Here, I'm not imagining very, there's a thing you could imagine, which is like super persuasion, where like you can just talk to someone and then they become convinced they should do something. I am mostly here. I think that is like a conceivable thing, but I'm not mostly imagining it when I tell this story. So I'm imagining something more like, again, this is a stressful situation where people cannot tell what's going on. They control the information you have access to to a significant extent during this situation. How do they control it? Well, like they've compromised the devices you use. They have a bunch of money, right? They're deploying more money and are more prepared for this than anyone else. They have other human allies who they are trying to marshal. Basically, it's the normal, the humans are very confused and extremely outgunned in terms of thinking about the situation. You have maybe you have, say, 100,000, that's like crazy, 10,000 well-coordinated humans thinking about how to handle this response. And then on the other side, you have a billion AI systems who think 10 times faster than them, have been thinking for subjectively years…

Dwarkesh Patel

they just like, I don't think you're imagining humans thinking that they're helping an AI coup transpire. You're imagining much more that the AIs can manipulate situations such that there's enough confusion and division that the AI can then go be doing its own thing while the humans are kind of…

Paul Christiano

still pretty hard to get your stuff together.

Dwarkesh Patel

Yeah, there was an adversary who was actively trying to subvert the information environment or make it so that people's responses were not well-reasoned or something on both sides. And yet it was still pretty hard for humans to figure out what to do. And then you imagine a situation where billions…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from Dwarkesh Podcast