“When it comes down to something that's repeatable … you get into a different set of economics where you care about costs per completed task, which is a lot different than looking in the media where everyone cares about cost per million tokens. … How do I make sure that I get the minimum acceptable task completion for the lowest amount of cost? Because everything outside of that is our margin.”
sputnikintelligence.com
Asked how an AI app company chooses between frontier and open-weight models, Daniel Saedi says they build with frontier models, then move repeatable tasks to whatever is cheapest at acceptable quality, measuring cost per completed task rather than per token.
…actually get that campaign off the ground and monitor it in real time and let people focus on things they actually care about, like telling stories and coming up with slogans. So we use both open source and closed source models in that process. And yeah, happy to dive into how we actually do that.
…and Anthropic or the Chinese Open-Weight and either use them as the intelligence that powers the thing or you use them to like build out your product as coding. So like you're in the market for it. You have the whole menu of options and you're like really in the market for all of them potentially.
…costs per completed task, which is a lot different than, you know, looking in the media where everyone cares about cost per million tokens. It's purely an input-output thing. For us, it's all about, hey, a marketer has these sets of tasks that they're trying to do. That's either, you know, creating an audience. It could be creating a set of taglines for an advertisement. And so for us, it's how do I make sure that I get the minimum acceptable task completion for the lowest amount of cost? Because everything outside of that is our margin.
By the way, I hope our producers aren't listening to this. One of them
is sat right there in the corner.
I hope our producers aren't listening to this. And hopefully they're just like going to tune out for a moment. But anyway, yesterday I went on TVPN and they sent me the raw the raw video file and the Google Drive had Gemini built into it, which I didn't realize. And so I just asked, again, close…