Noessel admits the limits of the design fixes in his book on AI assistants: every one of them assumes the user is willing to think. He calls this an open research gap.
Bullshit is just saying something for its effect. It might be right, but they don't care. All they want is the effect of what they're saying.
Yeah, there's absolutely no respect for the truth at all, right, yeah.
No, and that's where the sort of danger lies. Um, and AI are fantastic bullshitters in that regard. We all know that large language models were system prompted into being sycophantic for a while, and they've largely undone that, but the effect was, oh, hey, users like it when they are flattered, therefore make the AI flattering. Just horrible amounts of bullshit. But when we look at it from the user's perspec- perspective, if there is somebody who does not care about what they're-- whether what they are doing is true, and I realize that's a load-bearing word, or whether it is just effective, is a huge problem when it comes to, uh, using AI and abusing AI and abusing the output of AI. Because is this adding technical debt? Sh- sure, but hey, it raised our stock price for a quarter. Um, we all know the story of, uh, Google, and I don't remember the VP who decided to put paid results up in front of real results, and now another VP, could be the same one, who put the AI results in front of real results. Mm. But that certainly raised their stock price for a couple of quarters and has utterly ruined its credibility for users, right? Yeah. You now have to go several pages deep to get to the real references. I mean, the AI is…
I mean, one of the other things of it is the economics of it don't stack up. I mean, I think it's pretty clear that, you know, the big players are not going to earn the money back that they need to in the timeframe that they have, uh, said. So, you know, they will get-- at the very worst, there's…
Well, we're both parents, and I don't know if you had this experience with your kids, but there is a phase, and I suspect s- most people go through a phase, where you try lying, right? Yeah. When you're three years old, you try lying, and eventually you learn that there are a lot of good reasons…
No. Okay. Well, we are now definitely at the end of the show. As you know, it's named after the Brian Charles Eames film, uh, Powers of Ten, all about the relative size of things in, in the universe, and my one last question is, what one small thing is either overlooked or could be redesigned that…