Asked for his first reaction to Google's new Gemini model, Wolfram described it as a cybersecurity and coding model. His point is that low cost per task matters because finding and fixing old vulnerabilities at scale burns a lot of tokens.
Yeah.
…folks, cybersecurity gets it. And Google is working on releasing this to ultra subscribers. All right, let's go wide and let's talk about this, folks. Wolfa, were you surprised? You weren't that excited about Argon, I remember, because it refused some prompts of yours. Immediate thoughts on Carbon?
So Carbon, it's basically their cyber security and coding model, the state of the art right now in all of AI, I guess. Since it's only available in limited quantity, that limits its reach. But the pricing is very interesting because it is very competitive compared to other models. Let me just check on the page where we are. So the pricing was $1.80 for the median task house according to Arena, which is 72% cheaper than Opus 5.5. So this is very interesting. And making Frontier capabilities available at an affordable price is super important for developers that they can use it to secure their software. And the more affordable a model is and the more tuned for cybersecurity, the better for everybody because we are all using the software and it has to be secured. The models are finding security holds that have been there for years. And I think it's a good thing that they are being found instead of remaining hidden. We have to find them, we have to fix them, and that needs a lot of tokens and that costs a lot of money. So the cheaper the model that can do this, the better for everybody.
Google definitely leans into their competitive advantage of, hey, we have a buttload of CPUs and we can like, you know, we can do a loss leader here. Peter, I know you tested the model. Let's look at some of the evals. I don't remember seeing a chart quite like this from Gemini for a long, long…
Yeah, I think I must say the whole sequence of releases is a little bit odd. I'm not quite sure why you'd release one model. So this is Agent Arena, I'm showing right now. And Argon was seventh, which was like okay, to be honest. It kind of matches Tara, which is crazy. And now it's second. One…
want this a little bit. Bit bigger. Let's take a look. So, this is the overall chat, right? And the two preferred models on arena for chat is both Gemini models, which is from the last two weeks.
