“On a Claude model, the token might be really expensive, but it might use very few tokens to get to the right outcome. And on some of these open models, it has to use absolutely shit tons of them and they're cheap. But then it's slow and it's compute intensive… I just think that kind of pure cost per token conversation is almost dead now.”

…really doesn't mean shit anymore. It really doesn't mean anything because a token can be useful and a token can be wasteful. I mean, don't we have jobs now where like the same exact job on some models can take like a thousand times more tokens? And obviously, then you have what does a token cost?

Yes.

Well, it is. And then the other thing that the other tests don't put in there is the cost of on-prem infrastructure. And what the signals testing shows was even at 16, even at 33% non-utilization, meaning your hardware is sitting there 33% of the time, it's still a tenth the cost of what you can do…

Yeah, well, you had a, it was really kind of in the midweek, but it's kind of like an amalgamation of just so many things happening in the macro at the same time. Right. Inflation has caused interest rate hikes, interest rate hikes, which impact bond yields. Bond yields are rising, which basically…

Gosh, I can wake up now.