“It discovered that if you put a thousand emojis in a text box, it would break. … It found that the way we had you request a seat for a given team inside of Figma, it shows your team name, and we had 'a' team name seat. And if your team name starts with A, you need to use 'an'. It had just not shown up in our earlier bug bashes. It wound up being so diligent that it caught really small nits that I would never have caught on my own.”
Lenny's Newsletter · Product & Design · November 2026
Context
Mechaber runs a long-lived coding-agent thread that follows a scripted bug bash using test accounts and a browser. These are two real bugs it found, which he says show it follows directions more diligently than he does.
Transcript
…We built it. It works on mobile. I actually like right after this was this was pre-Astra, but like I spent a bunch of tokens building like a local native version just to like see what it looked like. Now I'm basically in codecs 100% of the time. One, I think browser use has gotten really good.
So good.
Really good. We have, we don't have permanent desks in the New York City office, and I don't like thinking about booking a desk every day. And so every once in a while, I have it running on a schedule to just like book my desk one day out. But it's also, it's a total beast at bug bashing. And so like in Codex, I have a little bug bash. I have like a threaded conversation that just lives here all the time. And when something new comes up for our team where we're about to launch an experiment or redesign or something, we have these FigJam files that explain here's how to bug bash it. Like here's the test account to take. Here's the path to follow. Here are the actions to do. And like, here are the things to look for. And I have started basically snagging one account for me and one account for Astra and just having it run through. So in this case, we are trying to make some of our request modals inside of Figma just like much more straightforward and much more streamlined. It's all UX stuff. It's all UX writing. It's fairly straightforward, but the like logic behind it is really complex. And so Astra is just much, much more diligent about following directions than I am. And so I will run it through and I will say…
This episode is brought to you by JIRA product discovery. With AI, a single PM can summarize research, draft a PRD, and build a working prototype. But multiplayer mode, that's broken. You can't get everyone aligned on what should actually ship with just a markdown file. JIRA Product Discovery gives…
Yeah. So one of the things that I had been thinking about for a while as our models have gotten better is like, what are all of the different ways that we can improve cadence? And so one of like I, as a growth PM, I feel like the biggest sin you can commit is wasting traffic, right? To like have…
So this is a little bit of Clairvaux lore, but for those that are new to me, I have worked at every experimentation platform company in history and did a startup literally 13 years ago, something like that, called Experiment Engine. And the whole hypothesis was like, how do you get, how do you…
More from Lenny's Newsletter
