Hron builds AI products for lawyers and calls verification the hardest part of legal work. The host assumes heavily hyperlinked citations take care of it. Hron's answer is that a citation can be real and still not support the sentence it is attached to, which is why he wants human lawyers checking the output.
that's the crux of legal. Like, verification and validation is the hard, hardest part building anymore. I'm assuming
you have heavily hyperlinked citations in whatever you generate.
Yeah, we absolutely do, but like verification isn't just verifying does this case exist. Yeah, you know, I make you know an AI writes a claim and it says this case supports this claim. That could be a legitimately real case, but it has nothing to do with the claim or that, or it has everything to do with it, but the claim is like maybe just slightly hyperbolic to what the case said, or it extended sort of some judgment in like a little bit too far-reaching of a way. Like, those that's the nuance of judgment legal experts provide. And that's where AI systems are tough today. And that's what we focus on when we build our products is really sort of like trying to do that as well as we can. But that's the part where I think the human judgment really comes into play and why we really, you know, encourage our human users to get involved.
I guess playing devil's advocate, what if you get so good at it, Joel, maybe I start checking out, tuning out, right? So, in other words, you know, I read the 100 of the briefs coming out of this model, they're all correct. The hundred first, maybe,
yeah. I mean, I hope that doesn't happen. I mean, you certainly see it sometimes, but like, I think, I think the risk, you know, to lawyers, like in what we say is like fiduciary professionals, is just really like too high to like suggest them checking out. But I would say, like, their mind does move towards like higher order things, which is like framing of arguments differently or like, you know, kind of like hardness testing or like trying to challenge their ideas more aggressively before they bring it to court. Like, I think that, you know, my belief is that it elevates their thinking and allows them to like be a lot more like strategic in how they prepare a brief rather than just focusing on the writing of all the words that need to go into the brief in the first place. And I think that's what we hear from our customers: that's how they benefit from it for sure. So,
it seems like a lot of the things that a first-year associate is doing, you guys are able to do now and well. And, you know, just like in coding or in math, right? So, usually you give your grad student or your junior developer some easy projects so that they can learn. So, but we're taking that off the table. So, it's almost like it's almost like we need to figure out a way to train the next generation if a lot of the ways they used to learn will get automated, right?