DS Dave Smith Dave Smith Software developer who co-hosts Soft Skills Engineering, a weekly advice show for software engineers.

“There's one really simple heuristic, which is how many prompts did it take to get the document to its current state? And if the answer is less than, I don't know, 20, then you probably have a crap document when it comes to design docs, planning docs, large ticket planning docs, things like that.”

Soft Skills Engineering · Hands-On Engineering Podcasts · October 2026

“There's one really simple heuristic, which is how many prompts did it take to get the document to its current state? And if the answer is less than, I don't know, 20, then you probably have a crap document when it comes to design docs, planning docs, large ticket planning docs, things like that.” — Dave Smith, Soft Skills Engineering

Context

A listener had written in about coworkers sending him AI-written pull requests and planning documents to review. The hosts were trying to work out how a reader can tell whether a person put real thought into an AI-assisted document.

Transcript

Soft Skills Engineering Around 17:00 into the episode
Dave Smith

…every line and having it feel like human, curated, carefully written, so that a human can read it. It's just, we just can't have that anymore, I think. Whether we like it or not. You know, it's just, I don't think we can have that. So I have to ask, how do we learn to live in this new world? I

Jamison Dance

…of the it was written by AI sense, even if you are able to make it good, you know? Like, so I think we have like a signal problem to show, no, no, no, like, yes, this was produced with AI, but also I have, I have worked on it enough with my own human brain to put my stamp of approval on the output.

Dave Smith

Yeah, I think there's one really simple heuristic, which is how many prompts did it take to get the document to its current state? And if the answer is like less than, I don't know, 20, then you probably have a crap document when it comes to like design docs, planning docs, large ticket planning docs, things like that. Maybe, maybe 10 to 20, somewhere in that range. But that may be what needs to happen here. We need some kind of mechanism that says this was a one-prompt document.

Jamison Dance

Yeah, we need to like, there's some new crypto algorithm. I mean, cryptography, not cryptocurrency. Yep. Although I'm sure, sure, put an NFT on it, I

Dave Smith

guess. Then it'll be worth something. Yeah,

Jamison Dance

some new signature you add to say, like, I assert that, I don't know.

Speaker names come from our own diarization. The position is estimated from where the line sits in the episode.

More from Soft Skills Engineering