“The language models have the problem that they're starting at the end point. They're starting at the pinnacle of human achievement and thinking we can build artificial general intelligence from that. And it's theoretically possible. I wouldn't rule it out, I guess. But for me, language is built on all of these other more basic cognitive capacities. And can you just skip them and skip to the final? I'm not so sure.”
sputnikintelligence.com
Asked whether agency could emerge in AI, developmental psychologist Michael Tomasello gives his core objection to building general intelligence by starting from language, which he sees as resting on more basic capacities like shared attention.
…of it as a really important tool. And I don't see any reason why we shouldn't just keep pushing the envelope and trying to make them more agitative. And that's my suggestion: look at natural agents and how they work and use that as a model and see if that'll help us get further in that direction.
…of zoom out and we're being externalists rather than internalists, and we just see this huge collection of kind of cognitive atoms that weren't evolved towards a particular capability, but the capability just suddenly appeared in that milieu. I mean, could that be something that's happening in AI?
I'm not technically sophisticated enough to have an informed opinion about that, but that's what it would need to do. It would need to be able to, as I say, formulate new goals, formulate new strategies. In evolution, what happens all the time is what they call pre-adaptation. So the textbook example is the opposable thumb was for climbing, and then we come down onto the savanna and it's useful for picking up things and whatever. So you have something adapted for one thing, and then now you're in a new context, and the organism, the agent, figures out creatively how to apply it in a new way. Yeah, I know that a lot of AI mechanisms do some surprising things, but again, I'm just not technically knowledgeable enough to know exactly what's possible there. I will say that I do think that a lot of the AI models focus almost exclusively on learning. Everything's learning, learning, learning, learning. But learning only exists to help the agent make adaptive decisions. So learning is a sub-process. It's important. Obviously, it's really important. But you could, in theory, have an organism like a thermostat that just behaves in a situation without learning. Now, it turns out that pretty much all…
Yeah, and that really stuck with me in your book when you were saying that you don't actually need to have learning per se, like a lot of behavioral adaptation can be explained just through this egentic lens. That was very fascinating. But I'm kind of interested. I mean, there's so many directions…
How can you know that I'm self-censoring? I don't say you're self-centering. I'm sure you believe everything you're saying. But what I'm saying is if you believe something different,
you wouldn't be sitting where you're sitting. Do you see what I'm saying? So, you know, where do these goals come from?