MLOps.community · AI Builders · November 2026
Asked whether per-token pricing will survive, Jesse Vincent notes that a mid-sized open-weights model now runs on a laptop at roughly last year's frontier level, and predicts how AI spending will split.
…And it has the intelligence level that's around Opus 4.5. And what's interesting is Opus 4.5 is what we had last December when everybody discovered that it was good. And so now that's a thing you can have on your laptop and not pay for. I mean, you pay in electricity and like burning your lap, but
so in your eyes, it's like, well, if we're going to go that way, there's, it's going to be really hard to do pay-per-token.
So what I think, I mean, the future I kind of expect we're going to end up with is you have a couple of calls to a really high-end frontier model that you ask the hard questions. And then all of the workaday stuff is either, you know, hosted open weights models or local open weights models. And you don't have to pay anywhere near the same for that.
And you probably are going to get to a place where that's just a separate machine that you have on your desk.
And it's like a desktop. I mean,
so I mean, that's, I mean, that's certainly, you know, Microsoft partnering with NVIDIA to ship these RTX surface machines. You know, that's pretty clear, or sorry, DGX surface machines. That's like pretty clear where they're going. It is Apple has done some really interesting stuff around their…