Connect your Claude, Codex or OpenClaw for full transcripts on millions of podcasts. Two week free trial, cancel anytime.

Start free trial →
EG Ed Grosvenor Ed Grosvenor On Artisan Beer

“I've done this for several client projects and gone from 40 minutes in CI to one minute in CI.”

Artisan Beer · AI Builders · November 2026

“I've done this for several client projects and gone from 40 minutes in CI to one minute in CI.” — Ed Grosvenor, Artisan Beer

Context

Ed was explaining his test-segmentation method: sorting a bloated test suite into tests to run on every push, tests to run nightly, and tests to delete.

Listen to the episode → More from Ed Grosvenor → More AI Builders quotes →

Transcript

Artisan Beer Around 09:50 into the episode
Ed Grosvenor

…tests should run every time CI runs. The tests that give you real confidence that you didn't break anything. And then there's a whole other big bucket of tests that's tests that are good to have, but I don't need to spend 20 minutes waiting for CI to pass. So maybe we just run those every night.

Peter Van Dijck

Even a bunch of tests we can probably delete. Yeah.

Ed Grosvenor

And a bunch of tests. And then a tombstoning test. Well, I mean, I don't know. It's kind of hard to monetize it. I've been tinkering with trying to make some deterministic scripting to kind of make it easier. But a lot of times it's sort of a judgment call and it comes down to your own personal risk tolerance, like how many tests you feel comfortable deleting. Because the whole point to a test suite, right? It's to give you confidence that your application continues to work after you've made changes. And so how far can you par things down before you start losing that confidence? And I think that answer is going to be different for everybody. So I don't really want to make that decision by bundling it into a product. I can do is I can create like real planned scripted thought through educational content around that. And so there will be that sort of content will be in scalpels. And…

Peter Van Dijck

I did it with a headline right there.

Ed Grosvenor

Yeah. And I did it without really, I mean, there was a small reduction in confidence, right? There's, there are definitely things that are not being tested in CI that could break. But then when you combine that with the fact that I have all of these sites being monitored with Hone and Wake. And so…

Peter Van Dijck

And things in the places

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from Artisan Beer

“AI has kind of broken that whole hours model for them internally too. I'm going to spend 20 or 30 minutes highly concentrated on whatever problem I'm trying to solve for the client, and I'm going to hit a button. And now I have to wait until the agent comes back with results. So do I have multiple clocks that I'm just starting and stopping as I shift from one client to the next? The whole model just doesn't work anymore.” — Ed Grosvenor, Artisan Beer “We were all sort of unprepared for how quickly code … with our fingers on the keyboard was no longer going to be something we could sell. We thought we might have a couple of years left before we have to start rethinking things. And all of a sudden, like November, December of last year, it all just kind of went away. Now it's all down to thought leadership. It's down to architecture. It's down to strategy, making the right decisions up front so that you can deploy something and be confident that it's going to stay secure and it's going to stay performant.” — Ed Grosvenor, Artisan Beer