The TWIML AI Podcast · AI Builders · November 2026
Sam Charrington asked why falling per-token prices on providers' pricing pages don't show up as lower bills for enterprises. Sadeepa explains that agents burn far more tokens than chatbots, which is why spending keeps climbing.
…for that is running on-prem, could actually save about 60%, up to 60% of the token cost. So that's something that we are looking internally, and our customers are very well aware of that as well. And they're looking for how they can move the workloads appropriately to on-prem versus on-the-cloud.
…oh, these are going down. Like the models are getting better, the costs are going down. Is it obvious to the folks that you talk to why that doesn't necessarily reflect in their bill? Like, did they inherently get that? Or do you have to explain like the role of agents and how agents change that?
I think we a lot of folks are getting it now. You know, just because the number of tokens consumed by a chatbot versus agent is quite different. I think we. All the numbers from like 20x to 50x more for agents on the token consumption. So, even the per token price goes down when you have a 50x increase in the usage, the total bill is going to be up. So, I think that that is the reality that our customers are facing today.
What about on the value side? Do you see folks starting to kind of wrap their arms around the value that these agents are bringing to the organization? Like, how do folks grapple with that?
It is a fantastic question. And I think I'm part of the Tokenomics Foundation board. So, this is the question that we are trying to answer as the board. Just like, how do we give a good framework and ways to measure the value of these tokens? But as you know, the token, each token is not the same…
Thinking a little bit about the Apple story and some of the other stories about, again, like companies clamping down on token budgets, I think there's like a surface-level read on those stories that's primarily about spend less. But there's also like this more nuanced read that is more about be…