DP David Pierce Editor-at-large at The Verge who covers consumer technology and product reviews, and writes the Installer newsletter of recommendations.

“We've just added this black box around every single thing that gets made, so that even when something does go wrong, even if in theory all of these systems are better, it is harder and takes longer for us to figure out what went wrong and how to fix it. And the idea that we are just going to solve AI problems with AI solutions … is just not there yet.”

The Vergecast · Tech Strategy & Big Tech · November 2026

“We've just added this black box around every single thing that gets made, so that even when something does go wrong, even if in theory all of these systems are better, it is harder and takes longer for us to figure out what went wrong and how to fix it. And the idea that we are just going to solve AI problems with AI solutions … is just not there yet.” — David Pierce, The Vergecast

Context

David Pierce responds to Nilay Patel's point about brittleness. He argues that as more code is written by agents nobody fully understands, outages get harder and slower to diagnose, whatever a company says about AI's role in any one failure.

Transcript

The Vergecast Around 28:59 into the episode
David Pierce

…anonymous didn't do this, as I saw a bunch of people saying on social media this week, no, there's not a nation state behind it. It's all relatively explainable things up and down the line. It still feels like the summation of this is going to last a long time for people. Yes. Do you feel that way?

Nilay Patel

…ways. And you're like, well, this broke. Not I had a bad day. Like I, Claude, decided I was alive and thus I will now issue a refusal to do the thing. Like whatever that thing is is going to increase the feeling of brittleness as more and more of these automations like do weirder things.

David Pierce

Yeah. And importantly, the people who built those deterministic tools that fail are thus well equipped to go figure it out. Like the other thing next to the brittleness is it's also opaque now, right? Like I think about Satya Nadella saying we didn't use AI. I bet if you go back far enough in the life of that code, someone was using AI to generate that code because all of these companies can't stop telling us about how they don't write their own code anymore, that AI is doing it. Microsoft itself proudly acknowledges the extent to which the people who write code no longer write code. They're babysitting swarms of agents. And so what has happened is we've just added this black box around every single thing that gets made so that even when something does go wrong, even if in theory all of these systems are better, when something does go wrong, it is harder and takes longer for us to figure out what went wrong and how to fix it. And the idea that we are just going to solve AI problems with AI solutions, like you said at the beginning, is just, it's just not there yet.

Nilay Patel

Yeah. I mean, look, this is a remarkable set of coincidences this last week, but I do think more people are more aware that there are single points of failure all through the economy. Yeah. And you can feel a lot of ways about that. But the main way I feel is, boy, it would be better if we had more…

David Pierce

There should be more than one router that keeps planes in the air. It's just an idea that I had. All right, we should move on from this. Again, I think there's going to be a lot to talk about about these things and presumably more of these things happening as we continue to expose all of the…

Speaker 2

Support for the show comes from Firefox. Have you ever searched for a product once and then it just follows you around online for days? It's the perfect way to spoil a gift for someone you share a device with. That's not what going online used to be like. Before, it felt efficient and full of…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from The Vergecast