Asked whether HackerRank could move into code review, Ravisankar says review tools still look at the pull request even though AI has changed how code gets written, and suggests reviewing the conversation with the agent instead.
…of this can expand beyond just like hiring and beyond just Frontier Lab because you can transpose the same infrastructure to a larger business in the AI era. And that's something that we're building from ground up. It's not yet launched, but will launch pretty soon. We'll see how that goes.
Good luck. I wonder if you could move or pivot or expand into other areas of developer life. Like, could you do code reviews or open source contribution validation just as a service based on the similar models or evals criteria?
…I think, we've changed the way that we build software, but I don't think we've changed the way that we review software. I mean, yes, there is Greptile and Code Rabbit and things in those science that you can actually do auto reviews, but you're still reviewing PRs. You're still reviewing code, but you've completely changed the way that you build software. Like, I have some ideas on it, which is maybe you should review the interaction with AI. What did the person actually talk to the AI? What do they actually say? That's probably, I wouldn't say better, but that's an important signal in conjunction with your PR that you need to think about. So if I have to extrapolate, I think the shape of code review in itself will change quite a bit. We'll need to see how it changes, and then we'll obviously immediately adapt in the way that we think about hiring.
That's so interesting. And now that you said it, it's such a hacker-ranked Vivek Ravisankar that you're evaluating not just the output, let's say, of an interview answer or the author of the pull request's actual pull request, but you're also evaluating the thing that went into that, how they…
Yeah, yeah, agree. Because by the way, people do this all the time. I'm sure you have observed this, which is if you're going to give me a PR slop of, okay, there's like, you know, 50 files changed for a minor fix. Like, firstly, I'm going to probably reject that. And second, if at all I want to…
Well, I look forward to interviewing you again in two years once it's all been figured out.