Future of Life Institute Podcast · AI Research & Frontier Labs · November 2026
Gus asked why labs push toward recursive self-improvement while saying alignment is unsolved. Max, flagging it as speculation, argues a pause would hurt OpenAI and Anthropic far more than the ad-funded giants.
…to. When people say things which are obviously against their financial interests, that's when I listen. It's just like when George W. Bush went on TV and said there were no weapons of mass destruction in Iraq, you know, then I listened because that was obviously not in the self-interest to say.
…DeepMind is for them to spend an increasing amount of resources when the AIs get good at AI research to then have the AIs do safety research. So to explore the paradigms that we've tried to sort of build up over the years, the technical solutions to alignment and to AI safety more broadly. Yes.
I'm just speculating now. I'm saying things I don't know. But there is another model that could explain why OpenAI and Anthropic are the only two companies here in the US that are leaning in hard to recursive self-improvement, which is that they're the only two companies with a business model requiring it. Think about it. Google, Meta, XAI, SpaceXAI, they're all sitting on a money printer. They have fantastic cash flow from selling ads, right? Microsoft, fantastic cash flow from Amazon from selling products of various kinds and cloud services. So even if we just paused the development of more risky AI systems that we don't yet know how to control, all of the companies I just named will be fine.…
And I take it that you are not optimistic around technical solutions to AI safety, mechanistic interpretability or AI Bot approaches like that.
Well, of course, I'm optimistic that there exists technical solutions if we had a lot of time to find them and basically created the right incentives that they actually got deployed, right? I think it's just wishful thinking if we tell ourselves that, oh, yeah, these things will automatically get…
Do you think the market will push for safer AI? So is it the case that there simply won't be demand to buy AI agents? They'll go rogue and commit cybercrime when you want them to do something else. You could say, is deployment of AI Bot by safety or bottleneck by alignment?