PW

Pete Warden

Things Pete Says on Podcasts

Where to Find Them

Pete Warden has been a guest on The Data Exchange with Ben Lorica (2 times) , Gradient Dissent: Conversations on AI , Software Engineering Radio - the podcast for professional software developers and Software Misadventures .

Recently: “Why AI Wants to Be Local” on The Data Exchange with Ben Lorica (November 2026); “SE Radio 660: Pete Warden on TinyML” on Software Engineering Radio - the podcast for professional software developers (March 2025); “TinyML, Sensor-Driven AI, and Advances in Large Language Models” on The Data Exchange with Ben Lorica (June 2024); “Pete Warden - On launching "AI in a Box" and building a hardware edge AI company - #24” on Software Misadventures (October 2023); “Pete Warden — Practical Applications of TinyML” on Gradient Dissent: Conversations on AI (October 2021).

What They Said

Asked to look 12 to 24 months ahead for local and open models, Pete Warden gives the thesis behind the episode title. He argues that models, unlike search, don't need a data center behind every query.

The Data Exchange with Ben Lorica · 2026-11-19 Permalink → Listen →
The Data Exchange with Ben Lorica Around 27:17 into the episode
Pete Warden

Yeah. And I'm always terrible at predictions. So.

Ben Lorica

But you, one thing Pete is super good at for our listeners is to know what to work on. So that's an indication. Well, just tell us what you're working on.

Pete Warden

Yes. So, so what I see from like, you know, from being deep in the technical side, you know, most, most of what I end up working on is because I've been working on something and it becomes blindingly obvious that the only reasonable technical solution is X. And so of course I want to work on X. And what I see and what I've seen for the last few years is the gravitational pull of running this stuff locally or on-prem or however you want to call it. I often say like AI Wants to be local. Like unlike if you think about something like Google search, you need massive databases, you need armies of servers, you need all of this stuff. If you look at what Claude and Chat GPT are doing, you can run that entirely on one laptop with no internet connectivity. So the shape of these models is perfect for running locally, unlike almost everything else we've seen over the last like couple of decades where the cloud has made more sense. So what I expect is all of these pressures, cost for enterprises, especially, worries about privacy, worries about capabilities going away, worries about changes. You know, if you built an application on top of a particular version of Claude, even if you're using the same version in…

Ben Lorica

the other thing too is I think a lot of enterprises are recognizing that the moat or the remote is really not the model. It's the compounding loop around the model, right? So if you use the model more, you learn more and things like that. So why in the world would you send that to a commercial…

Pete Warden

Why not do fine-tuning on your own model? Yeah,

Ben Lorica

yeah. I mean, own that loop.

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

Collections They Appear In