The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch · Startups & Venture · November 2026
Harry Stebbings asked how to get rid of the unreliable side of model behavior. Almeida lays out his main thesis, a sharper version of Rich Sutton's 'bitter lesson'. He argues that the tasks models are trained on, pleasing humans and scoring well on benchmarks, don't produce reliable automation.
…And it's because the math doesn't work out. It's not a diffusion problem in the slightest. Reliability is what gets you, maybe you can trade off like some level of Einstein for just getting it more commonly and more often and getting the same functional intelligence. That to me is Jev's superpower.
So how do we get there? What is the solution then to removing Mr. Bean as much as I love Mr. Bean?
I love Mr. Bean too. I actually, you know, I love when agents are like insane, you know, bad vibes forever. It's very fun. It's a very fun story. And also, that is not what I want in my software that runs in the background. Like as an engineer, I want to write a thing. I want to spend a lot of effort up front. Like maybe I don't realize it'll be a lot of effort, but it always is. And I want it to run in the background and solve the problem forever. And you just need like nines of intelligent reliability to do that. And I would argue that the way to do that, oh man, I wish I could bring up my slides here, but I'll try to use my heads, I guess. So I call it AI's bitterest lesson. Sutton coined a bitter lesson, which is roughly that compute matters more than algorithms. This is all of like the scaling-pilled era we had for 2019 to 2022 to 2023 was a scaling-pilled era. You know, like just scale and the models get better. This kind of plateaued at GPT 4.5, and then we kind of stopped scaling as a field because it stopped having a payoff. I would argue that there's a bitterer lesson, which is that data matters a lot more than compute. This is very obvious to anyone who's done any applied ML, but…
Than Compute so much for bluntly giving me so many forums. Can I say one thing? Can
I say one thing about this too? On the note of reliability, ChatGPT never fails at being chat GPT. Like, when is the last time you got random characters, right? Like, it's kind of odd that it, or even if you ask for a polite email, it's not going to start saying, I probably shouldn't curse in a…
You said there about kind of the plateauing of compute in terms of the benefits that accrue. First, have we got to that stage? Are you serious? I thought the whole point was dreaming? Purely on pre-training, sure. But like, more and more compute still leads to better and better output, no?