Newcomer Pod · Startups & Venture · November 2026
Newcomer noted that Anthropic thinks it can stop others from distilling its models. Ghodsi, who says he is bullish on American open-source models, explains why he thinks that can't be done.
…models were distilled of all the information on the internet, right? Distillation is just so powerful. It just works so well. It works even better when you're doing it on reasoning thraces and so on. And it's nearly impossible to stop distillation, right? Because it's very hard to do. Anthropic
thinks they're going to stop people from distilling.
I think fully stopping distillation is literally impossible because how can you discern what questions you're asking from a model is being going to be used for distillation? Some of it is just legitimate usage. And this stuff also leaks out, right? So as a result of that, I just think it's really, really effective to do reinforcement learning for specific use cases and compress the price down for use cases that are repetitive that you do again and again and again. And most of the work in the economy is in that class. Now, there are things we need to do, like new drugs that we need to discover and diseases that we want to cure and financial models and so on, that where we need the latest, latest, best intelligence possible. That will remain, and we will use frontier models. But as our smart router shows that I just mentioned earlier, you can cut the cost down significantly. You can specialize the models. We specialize a lot of the models. I also think we're going to see more open source models come out of the United…
out of the model game.
For now, yeah. You would have to change your mind. Well, it's a how much of your market cap do you have to spend on GPUs, okay, to be able to get it. And has that come
down or no? It has