SN Satya Nadella On The Pragmatic Engineer

“In a world where you now know scaling laws work, except with scaling comes new capability, but not alignment … we're getting more and more capable and less and less reliable, which is the most dangerous place to be in. And so that means you have to separate out architecturally authority from intelligence. If your intelligence has authority and it's unreliable, you have a massive insider risk problem. And so you've got to treat these agents as insider risk.”

The Pragmatic Engineer · Hands-On Engineering Podcasts · November 2026

“In a world where you now know scaling laws work, except with scaling comes new capability, but not alignment … we're getting more and more capable and less and less reliable, which is the most dangerous place to be in. And so that means you have to separate out architecturally authority from intelligence. If your intelligence has authority and it's unreliable, you have a massive insider risk problem. And so you've got to treat these agents as insider risk.” — Satya Nadella, The Pragmatic Engineer

Context

Nadella was describing the trust architecture he wants enterprises to build around AI agents. His point is that capability is outrunning reliability, so agents should not hold authority by default.

Transcript

The Pragmatic Engineer
Satya Nadella

…test For that, you should be able to replace any model and still hill climb on an eval that's your private eval. Yeah. If you can't do that, then you have to ask yourself, how are you a sovereign firm? That means you do not have control of your own output. So that's kind of the first. You're just

Gergely Orosz

sitting on a ticking time bomb.

Satya Nadella

Yeah, I mean, you're done. I mean, like, is my point. And so then the next thing is you now need a trust architecture, right? Which is you kind of have to, like, in a world where you now know scaling laws work, except with scaling comes new capability, but not alignment. In fact, no mechanistic understanding that hopefully someday there's a science breakthrough. But right now, we're getting more and more capable and less and less reliable, like, which is the most dangerous place to be in. And so that means you have to separate out architecturally authority from intelligence. If your intelligence has authority and it's unreliable, again, you're taken, right? You…

Gergely Orosz

As an engineer, all I'm hearing and all I'm seeing is there's so much new type of work that needs to be done. So many novel systems need to be built, which we don't have a blueprint for. I mean, and probably the best way to do is, well, build it, also talk with peers who are building it at the same…

Satya Nadella

Correct. And in fact, in fact, one of the things we have our conference, Ignite, coming up next week. And I'm excited about it because that's kind of what I want to make sure we do a good job is communicating that, hey, this is all doable. Like there are blueprints. There is a lot of innovation…

Gergely Orosz

as an engineer, one of the things that I feel very lacking is all of these AI models, they run in the cloud on someone else's server or a super expensive B200 that I cannot afford, or my company will not buy it for me. Or if you are, I mean, you're lucky. But would it not be nice if it just ran on…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from The Pragmatic Engineer