TS
Tuhin Srivastava

Tuhin Srivastava

Things Tuhin Says on Podcasts

Where to Find Them

Tuhin Srivastava has been a guest on No Priors (2 times) , Practical AI (2 times) , TBPN (2 times) , MLOps.community , Gradient Dissent: Conversations on AI , The Generalist , The Generalist , The Information's TITV , AI Engineering Podcast , Greymatter , The Stack Overflow Podcast and Scaling DevTools .

Recently: “Why inference is harder than you think” on The Generalist (November 2026); “Why inference is harder than you think” on The Generalist (November 2026); “Baseten CEO Tuhin Srivastava on the AI Inference Crunch, Custom Models, and Building the Inference Cloud” on No Priors (May 2026); “China's Acquisition Spree, TikTok's Survival Deal, Intel Slips | Tuhin Srivastava, Bryce Strauss, Max Spero, Russ d'Sa” on TBPN (January 2026); “Airbnb CEO Brian Chesky on AI Strategy & New CTO, Microsoft’s Anthropic Deal | Jan 14, 2026” on The Information's TITV (January 2026); “The CEO Behind the Fastest-Growing AI Inference Company | Tuhin Srivastava” on Gradient Dissent: Conversations on AI (November 2025).

What They Said

“Until now we've been pretty surprised each time. … If I compare our January forecast in 2025 to what we actually finished, we're off by 4x.” — Tuhin Srivastava, The Generalist

Asked how far off Baseten's revenue forecasts have been, given how fast inference demand has grown, Tuhin says they have underestimated every year since 2023. This is how far the 2025 forecast missed.

The Generalist · 2026-11-17 Permalink → Listen →
The Generalist Around 06:08 into the episode
Tuhin Srivastava

…like halfway through the year and like 23 we were completely off 24 we were completely off 25 we were completely off 26 it looks like we're gonna be completely off no we were definitely completely off and so it's like everything just kind of like oh could it go any faster could it go any faster

Mario Gabriele

when you say completely off are you off by like an order of magnitude one like a 2x 3x like do you get better at forecasting that or do you get surprised each time a little bit

Tuhin Srivastava

um until now i think we've been pretty surprised each time that's like hey this market is bigger and than ever inference is you know the final market to some extent yeah no it's it's off by a lot like i i think our if i compare our jan forecast in 25 to our end of to what we actually finished we're off we're off by 4x wow yeah

Mario Gabriele

when you say inference is the final market i've heard you say that before i really like love the framing of it but i don't know what that means it sounds very cool yeah but what does that mean yeah

Tuhin Srivastava

well it means nothing no i'm just joking the um all we are somewhat alluding to there is that if ai is going to eat the world you know it all that's going to matter is where that you know how that ai is run i see and you know like and even in a world where there is you know a gi yeah the only thing…

Mario Gabriele

to yeah to optimize to run the way this works to

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.
“Inference is one of the most misunderstood markets in the world, because people think you just take vLLM, slap it onto GPUs and call it a day. In a supply-constrained market, operating at large scale with what I would call quite flaky technology, GPUs fail all the time, chips fail all the time, and running at very high utilization in a market where demand is growing exponentially, there's so much complexity at every layer.” — Tuhin Srivastava, The Generalist

Asked how Baseten's financing needs change as it buys more compute, Tuhin first explains why inference is much harder than people assume. He then describes typical terms for large compute deals.

The Generalist · 2026-11-17 Permalink → Listen →
The Generalist Around 32:16 into the episode
Tuhin Srivastava

Just because the supply chain is so scaled up.

Mario Gabriele

As you start to continue to have to scale up that supply, how do the different financial requirements change for your business? Do you start to have to build up a big debt practice? Or, you know, I could imagine lots of different ways of getting the oxygen into the system that you need.

Tuhin Srivastava

Oh, totally. I don't know about live debt practice, but one of the very interesting things about inference is like inference in a lot of ways, I think it's maybe like one of the most misunderstood markets in the world because people think you just take VLM, which is open source framework, you slap it onto GPUs and you call it a day in a supply-constrained market, operating at large scale with what I would call quite flaky technology, which is, you know, GPUs fail all the time, chips fail all the time, and running at very high utilization in a market where the demand is growing exponentially. There's so much complexity at every layer of this. And then when you add the fact that there is CapEx involved, and whether that means, you know, through building data centers yourself or whether that means through, you know, like if you are looking at a couple of billion dollars of compute expenditure over a given period, in today's market, that probably requires about a five-year term and a 30% prepayment. I guess, you know, play that out. Yeah. So let's say you wanted to do $10 billion of spend. For five years, it's called five billion with 30% prepay. That's one and a half billion dollars of prepay you have to do.…

Mario Gabriele

This is where the two years of Macquarie doing infrastructure

Tuhin Srivastava

ended up being really

Speaker 4

helpful in the end, right? That was probably painful two years, but uh, it's come back around in a way, right? Yeah,

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

Collections They Appear In