JV Jesse Vincent On MLOps.community

“The future I expect we're going to end up with is a couple of calls to a really high-end frontier model that you ask the hard questions, and then all of the workaday stuff is either hosted open-weights models or local open-weights models. And you don't have to pay anywhere near the same for that.”

MLOps.community · AI Builders · November 2026

“The future I expect we're going to end up with is a couple of calls to a really high-end frontier model that you ask the hard questions, and then all of the workaday stuff is either hosted open-weights models or local open-weights models. And you don't have to pay anywhere near the same for that.” — Jesse Vincent, MLOps.community

Context

Asked whether per-token pricing will survive, Jesse Vincent notes that a mid-sized open-weights model now runs on a laptop at roughly last year's frontier level, and predicts how AI spending will split.

Transcript

MLOps.community Around 24:44 into the episode
Jesse Vincent

…And it has the intelligence level that's around Opus 4.5. And what's interesting is Opus 4.5 is what we had last December when everybody discovered that it was good. And so now that's a thing you can have on your laptop and not pay for. I mean, you pay in electricity and like burning your lap, but

Demetrios Brinkmann

so in your eyes, it's like, well, if we're going to go that way, there's, it's going to be really hard to do pay-per-token.

Jesse Vincent

So what I think, I mean, the future I kind of expect we're going to end up with is you have a couple of calls to a really high-end frontier model that you ask the hard questions. And then all of the workaday stuff is either, you know, hosted open weights models or local open weights models. And you don't have to pay anywhere near the same for that.

Speaker 3

And you probably are going to get to a place where that's just a separate machine that you have on your desk.

Demetrios Brinkmann

And it's like a desktop. I mean,

Jesse Vincent

so I mean, that's, I mean, that's certainly, you know, Microsoft partnering with NVIDIA to ship these RTX surface machines. You know, that's pretty clear, or sorry, DGX surface machines. That's like pretty clear where they're going. It is Apple has done some really interesting stuff around their…

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from MLOps.community