PC Paul Christiano On Dwarkesh Podcast

“We are fairly likely to have the self-sustaining acceleration where in eight months you double the pace, and in the next four months you double the pace again, and in two months, you double the pace again. … If you're a person who just wants to get to the end point as quickly as possible, you do not care how good a lawyer your AI system is for a while. You just care how good it is at driving the development of better architectures and better optimizers and better learning algorithms.”

Dwarkesh Podcast · AI Research & Frontier Labs · November 2026

“We are fairly likely to have the self-sustaining acceleration where in eight months you double the pace, and in the next four months you double the pace again, and in two months, you double the pace again. … If you're a person who just wants to get to the end point as quickly as possible, you do not care how good a lawyer your AI system is for a while. You just care how good it is at driving the development of better architectures and better optimizers and better learning algorithms.” — Paul Christiano, Dwarkesh Podcast

Context

Pressed on why superhuman capability could arrive within a year rather than the four to eight years current trends imply, Christiano says automating ML research itself would create a self-reinforcing loop, so labs would aim AI at that first.

Transcript

Dwarkesh Podcast
Paul Christiano

…ton of capability to push that forward and to do a bunch of automation, like the construction of many more environments and so on, just looks very likely to lead to systems that can quite quickly rise to at least human level and likely way past human level, including on very messy real world tasks.

Dwarkesh Patel

…for many years now. And it doesn't seem like we're a year away or like a further year of scaling away from this big a jump. And so am I correct in understanding that you're just imagining something like we've already done, but like a much, just a much bigger qualitative jump along those same lines?

Paul Christiano

…acceleration where we see, you know, in eight months you double the pace, and in the next four months, you double the pace again, and in two months, you double the pace again. And at some point in that process, right, at the beginning of that process, it will be focused primarily on these virtual tasks, right? Because your main priority is making the self-sustaining loop faster and faster. If you're a person who just wants to get to the end point as quickly as possible, you do not care how good a lawyer your AI system is for a while. You just care how good it is at driving the development of better architectures and better optimizers and better learning algorithms. That's all you, or even constructing new environments or orchestrating like this kind of messy, right? Maybe you care about one slightly messy task, which is constructing environments that help you build the skills that are relevant in the real world, but you don't care about almost any of the real world tasks where we're seeing the slowest progress. And so you're focused on that and you're…

Dwarkesh Patel

Yeah. And so this goes back to the thing you're saying of you should imagine the systems in the future are less about fine-tuning GPT-6 to do something, but more like GPT-12, maybe just being able to do it out of the box with very little experience.

Paul Christiano

GPT-12 will also be great at fine-tuning GPT-12. Exactly. So if GPT-12 is like, I find that my chemistry intuition is not very good. GPT-12 will be great at saying, okay, I'm going to direct a thousand humans, and here's the data I think I most need. We're going to do one day of data collection of…

Dwarkesh Patel

Yeah. And okay, so this is a, I think you just answered a question which I meant to ask you. So it seems like a big thing that has driven your concern over the last few days is this new result from Meter, where they find that Anthropic's pace of AI progress on well-scoped tasks has doubled. And so…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from Dwarkesh Podcast