Future of Life Institute Podcast · AI Research & Frontier Labs · November 2026
Gus asked whether market forces will push toward safer AI, or whether deployment is bottlenecked by alignment. Max dismisses alignment as a slogan the companies adopted once they couldn't promise control.
…like any other industry and say you can only make the money and test these things, deploy these things once you've met the safety standards, yeah, then by definition, we're going to get the technical solutions in time. Because that's the only way the companies make any money off of it, right?
Do you think the market will push for safer AI? So is it the case that there simply won't be demand to buy AI agents? They'll go rogue and commit cybercrime when you want them to do something else. You could say, is deployment of AI Bot by safety or bottleneck by alignment?
I think alignment itself is mostly a PR slogan of companies who have realized that they don't know yet how to make controllable things. So they stop talking about control and they start talking about alignment and whatever they mean by that.
That is all under the category of sort of the risk of losing control. Even if we manage to avoid that, there are three other dangers with AI. Maybe you could sketch those out for us.
Yeah, suppose we solve the control problem. So AIs will always do what their owner tells them to do. And the way I think about it, three quite different ways this can go wrong. One is we end up in 1984, where the AI is very obedient to Big Brother, who then, with the aid of this vastly…
It sounds though to me right now, and I'm guessing also to the listeners that we are in quite a tough spot where we have an enormous problem of not losing control of AI. And even if we solve that, we have these other risks that we have to handle. Are you optimistic that we'll sort of make it…