Google DeepMind: The Podcast · AI Research & Frontier Labs · November 2026
Fry compared today's approach with training narrow systems like DeepMind's Atari agents. He says narrow tasks are a solved problem given data and a model; the real test is transfer to things the model was never trained on.
…over-optimizing for a single task. Because with machine learning, we already solved that. We know how to do it. The parameters of that is very, very simple. We know that we have a class of models that if you have a narrow task and if you have data, that model will learn how to solve that task.
I mean, this is what you were doing with Atari all those years ago.
…even before that, with deep learning, we basically verify that you can train a neural network on data. And if you have enough data and if you have a model, you'll get the result. I don't think anyone questions that anymore. There were times we were questioning that. We are not questioning that anymore. So then, when we think about intelligence, it's not about a collection of these narrow things. The intelligence is the generalization over these. Intelligence is transfer from these into something that you haven't seen before. That's the capability. That's what amazes people with LLMs. Because we are just inputting the knowledge there, it actually generalizes into all sorts of things that you didn't think before, that you didn't think that you build a model for that kind of task, but it actually does that. That's the kind of generality that you want. That is why we think about scaling these with more data and more…
Because it's the generality. Because it's the
generality. I'm not claiming that these models generalize and transfer to very unknown things. I think on that part, we are still very, very early. But the goal of building intelligence, the goal of building AGI, has always been the only single goal. And we are trying to find ways on how to do that…
There is this perception that Google DeepMind now has a lot of eggs in the Gemini basket, as it were. How confident are you that you would notice the next big thing, the next big advance, and be able to implement it in your models?