“Almost all of the benchmarks are about how well a machine by itself, with no human help, can solve a problem. It's considered cheating if the human helps. I think that's the wrong mindset. We should be building benchmarks where humans and machines are encouraged to work together, and the tool designers are encouraged to make tools that work well with humans rather than without humans.”

This is not a track. Again, just like we look at what they're saying, they're saying AGI is the burning desire. AGI is where they're aiming. AGI is just around the corner. That's just a code word for saying make the models more and more human-like.

…human-level capability. Now, Eric says he's not quite as convinced as Daron that the frontier AI labs are focused on replacing humans, but he said that the technology still needs to be steered to more broadly complement humans. One way to do that, he said, was to have better benchmarks and metrics.

Eric and Darren also weighed in on how AI might affect other jobs, including paralegals, game designers, and novelists. But for now, we'll end on their advice for those of you just starting out. Okay, so in the, I guess, the minute that we have left or so, Kara asks, how do we speak to college-aged…

I mean, I would say the flexibility is very important. The general principles that Eric and I talked about, it's much better to work alongside AI than compete against AI. But also, I think the young generation, the new generation has to learn to shoulder the responsibility of being becoming…

Big plus one to that. When people hear AI, they should be thinking amplified intention, that we actually have more power