RS Rich Sutton Argues that agents unable to keep learning from experience after deployment are capped from the start, a view described as the big world hypothesis: the world i...

“The world is infinitely complex, and any simulation of it is like microscopic.”

Training Data · AI Research & Frontier Labs · August 2026

His answer to the synthetic-data strategy every frontier lab is betting on. Sutton's big world hypothesis says the world is massively more complex than any agent or any simulator — so an agent that cannot keep learning from its own experience is capped from the start.

Training Data · 2026-08-18 Listen to the episode → More from Rich Sutton → More AI Research & Frontier Labs quotes →

Transcript

Training Data Around 14:28 into the episode

Sonya Huang

But you can have infinite synthetic worlds. The existing world is finite.

Khurram Javed

…So it could totally learn from its own experience, but it wouldn't be able to. It doesn't matter how much synthetic data you generate. It doesn't matter if you generate synthetic data that captures 50 different universes. It would not allow you to do that task without humans figuring it out first.

Rich Sutton

…minds matter to us. You know, like I talked to you guys about investing today, so I care what you're going on. Your minds, and how could I get synthetic data on such a thing? Really, you can't even get synthetic data on anything. You can't get synthetic data on how the drone is going to interact with its environment, in the physical world, and the friction and wear in the motors of this robot. The world is infinitely complex, and any simulation of it is like microscopic. The big world hypothesis, let's say what it is, is that the world is massively more complex than your mind, than any agents, any agent. And this is obvious because the world contains many other agents. So, because the world is massively complex, there's no way you can do anything like anything that might claim to be optimal or perfect. You're going to be imperfect, and you have to have…

Sonya Huang

Yeah. I'm going to push on this one more time. And sorry, I'm being argumentative for the sake of being argumentative, but I'm trying to understand. My understanding is that the newest cohort of self-driving car companies, many of them were primarily trained in sim, and then they, you know, have to…

Khurram Javed

Yeah. So, I think the important question to ask here is: how many engineers were involved in building that simulation? And are we ready to say that the only problem worth solving are those where we can hire a large team of engineers to first make a simulation? And I'm sure they had to do multiple…

Rich Sutton

it actually drives, again, something unexpected will happen.

Speaker names from our own diarization · position estimated from where the line sits in the episode

More from Training Data

“When we got AlphaZero right, you know, we gave up on the human data and finally focused on what would it be like to build an algorithm that could discover for itself. So once we got it right, that algorithm, it took just a few hours. Like it took a few hours to outperform the two years of work which we'd done with human in the loop.” — David Silver, Training Data

“The world already has tens of thousands, if not hundreds of thousands, of really talented researchers all pursuing exactly the same approach… Am I going to be the 100,001 person that's pursuing that approach? … There's this other lamppost that right now no one is looking under.” — David Silver, Training Data